Jul 13 09:08:30.797997 ip-10-0-138-89 systemd[1]: Starting Kubernetes Kubelet...
Jul 13 09:08:31.257807 ip-10-0-138-89 kubenswrapper[2553]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 09:08:31.257807 ip-10-0-138-89 kubenswrapper[2553]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 13 09:08:31.257807 ip-10-0-138-89 kubenswrapper[2553]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 09:08:31.258375 ip-10-0-138-89 kubenswrapper[2553]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 13 09:08:31.258375 ip-10-0-138-89 kubenswrapper[2553]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 09:08:31.258943 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.258780    2553 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 13 09:08:31.263805 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263783    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 09:08:31.263805 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263803    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 09:08:31.263805 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263807    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 09:08:31.263904 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263811    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 09:08:31.263904 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263814    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 09:08:31.263904 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263817    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 09:08:31.263904 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263823    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 09:08:31.263904 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263828    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 09:08:31.263904 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263832    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 09:08:31.263904 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263835    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 09:08:31.263904 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263838    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 09:08:31.263904 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263842    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 09:08:31.263904 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263845    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 09:08:31.263904 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263849    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 09:08:31.263904 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263853    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 09:08:31.263904 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263858    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 09:08:31.263904 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263861    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 09:08:31.263904 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263864    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 09:08:31.263904 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263867    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 09:08:31.263904 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263870    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 09:08:31.263904 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263873    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 09:08:31.263904 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263875    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 09:08:31.264420 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263878    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 09:08:31.264420 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263881    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 09:08:31.264420 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263884    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 09:08:31.264420 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263886    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 09:08:31.264420 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263890    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 09:08:31.264420 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263893    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 09:08:31.264420 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263895    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 09:08:31.264420 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263898    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 09:08:31.264420 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263901    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 09:08:31.264420 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263904    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 09:08:31.264420 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263907    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 09:08:31.264420 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263911    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 09:08:31.264420 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263914    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 09:08:31.264420 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263917    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 09:08:31.264420 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263921    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 09:08:31.264420 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263923    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 09:08:31.264420 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263926    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 09:08:31.264420 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263929    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 09:08:31.264420 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263932    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 09:08:31.264420 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263935    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 09:08:31.264951 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263937    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 09:08:31.264951 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263940    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 09:08:31.264951 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263943    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 09:08:31.264951 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263945    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 09:08:31.264951 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263948    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 09:08:31.264951 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263951    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 09:08:31.264951 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263953    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 09:08:31.264951 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263956    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 09:08:31.264951 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263958    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 09:08:31.264951 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263961    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 09:08:31.264951 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263964    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 09:08:31.264951 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263967    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 09:08:31.264951 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263969    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 09:08:31.264951 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263974    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 09:08:31.264951 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263977    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 09:08:31.264951 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263980    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 09:08:31.264951 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263983    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 09:08:31.264951 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263986    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 09:08:31.264951 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263989    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 09:08:31.264951 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263992    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 09:08:31.265465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263995    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 09:08:31.265465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.263998    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 09:08:31.265465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264001    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 09:08:31.265465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264003    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 09:08:31.265465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264006    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 09:08:31.265465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264009    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 09:08:31.265465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264012    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 09:08:31.265465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264015    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 09:08:31.265465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264018    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 09:08:31.265465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264021    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 09:08:31.265465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264024    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 09:08:31.265465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264026    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 09:08:31.265465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264029    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 09:08:31.265465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264032    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 09:08:31.265465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264035    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 09:08:31.265465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264038    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 09:08:31.265465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264041    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 09:08:31.265465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264044    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 09:08:31.265465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264047    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 09:08:31.265973 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264049    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 09:08:31.265973 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264052    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 09:08:31.265973 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264055    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 09:08:31.265973 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264058    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 09:08:31.265973 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264061    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 09:08:31.265973 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264064    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 09:08:31.265973 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264067    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 09:08:31.265973 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264070    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 09:08:31.265973 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264073    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 09:08:31.265973 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264075    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 09:08:31.265973 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264078    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 09:08:31.265973 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264082    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 09:08:31.265973 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264085    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 09:08:31.265973 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264089    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 09:08:31.265973 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264094    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 09:08:31.265973 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264097    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 09:08:31.265973 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264099    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 09:08:31.265973 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264104    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 09:08:31.265973 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264903    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 09:08:31.265973 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264911    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 09:08:31.266679 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264916    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 09:08:31.266679 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264921    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 09:08:31.266679 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264924    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 09:08:31.266679 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264928    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 09:08:31.266679 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264932    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 09:08:31.266679 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264934    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 09:08:31.266679 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264938    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 09:08:31.266679 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264941    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 09:08:31.266679 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264944    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 09:08:31.266679 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264947    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 09:08:31.266679 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264950    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 09:08:31.266679 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264953    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 09:08:31.266679 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264956    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 09:08:31.266679 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264959    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 09:08:31.266679 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264962    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 09:08:31.266679 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264965    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 09:08:31.266679 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264968    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 09:08:31.266679 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264971    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 09:08:31.266679 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264974    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 09:08:31.266679 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264977    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 09:08:31.267428 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264980    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 09:08:31.267428 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264983    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 09:08:31.267428 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264986    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 09:08:31.267428 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264989    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 09:08:31.267428 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264991    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 09:08:31.267428 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264994    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 09:08:31.267428 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.264997    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 09:08:31.267428 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265001    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 09:08:31.267428 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265004    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 09:08:31.267428 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265008    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 09:08:31.267428 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265012    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 09:08:31.267428 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265016    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 09:08:31.267428 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265019    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 09:08:31.267428 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265022    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 09:08:31.267428 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265024    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 09:08:31.267428 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265027    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 09:08:31.267428 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265030    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 09:08:31.267428 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265033    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 09:08:31.267428 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265036    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 09:08:31.267428 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265038    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 09:08:31.267982 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265042    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 09:08:31.267982 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265044    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 09:08:31.267982 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265047    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 09:08:31.267982 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265050    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 09:08:31.267982 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265052    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 09:08:31.267982 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265055    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 09:08:31.267982 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265058    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 09:08:31.267982 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265060    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 09:08:31.267982 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265063    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 09:08:31.267982 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265066    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 09:08:31.267982 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265069    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 09:08:31.267982 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265071    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 09:08:31.267982 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265074    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 09:08:31.267982 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265077    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 09:08:31.267982 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265080    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 09:08:31.267982 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265082    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 09:08:31.267982 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265085    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 09:08:31.267982 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265088    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 09:08:31.267982 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265090    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 09:08:31.268465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265093    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 09:08:31.268465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265097    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 09:08:31.268465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265100    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 09:08:31.268465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265102    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 09:08:31.268465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265105    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 09:08:31.268465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265108    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 09:08:31.268465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265111    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 09:08:31.268465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265114    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 09:08:31.268465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265117    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 09:08:31.268465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265123    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 09:08:31.268465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265126    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 09:08:31.268465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265128    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 09:08:31.268465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265131    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 09:08:31.268465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265134    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 09:08:31.268465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265137    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 09:08:31.268465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265140    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 09:08:31.268465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265143    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 09:08:31.268465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265146    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 09:08:31.268465 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265148    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 09:08:31.268986 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265151    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 09:08:31.268986 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265154    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 09:08:31.268986 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265156    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 09:08:31.268986 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265161    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 09:08:31.268986 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265165    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 09:08:31.268986 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265168    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 09:08:31.268986 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265171    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 09:08:31.268986 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265174    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 09:08:31.268986 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265177    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 09:08:31.268986 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265180    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 09:08:31.268986 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265184    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 09:08:31.268986 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265187    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 09:08:31.268986 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265190    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 09:08:31.268986 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265193    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 09:08:31.268986 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265195    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 09:08:31.268986 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265199    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 09:08:31.268986 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265201    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 09:08:31.268986 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265204    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 09:08:31.268986 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265207    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 09:08:31.268986 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265621    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 09:08:31.269509 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265626    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 09:08:31.269509 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265630    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 09:08:31.269509 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265635    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 09:08:31.269509 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265638    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 09:08:31.269509 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265641    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 09:08:31.269509 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265644    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 09:08:31.269509 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265647    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 09:08:31.269509 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265650    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 09:08:31.269509 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265652    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 09:08:31.269509 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265655    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 09:08:31.269509 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265658    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 09:08:31.269509 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265661    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 09:08:31.269509 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265664    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 09:08:31.269509 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265667    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 09:08:31.269509 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265670    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 09:08:31.269509 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265689    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 09:08:31.269509 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265693    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 09:08:31.269509 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265697    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 09:08:31.269509 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265700    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 09:08:31.270016 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265705    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 09:08:31.270016 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265708    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 09:08:31.270016 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265710    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 09:08:31.270016 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265713    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 09:08:31.270016 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265716    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 09:08:31.270016 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265719    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 09:08:31.270016 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265721    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 09:08:31.270016 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265724    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 09:08:31.270016 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265728    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 09:08:31.270016 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265731    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 09:08:31.270016 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265734    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 09:08:31.270016 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265736    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 09:08:31.270016 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265739    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 09:08:31.270016 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265742    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 09:08:31.270016 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265745    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 09:08:31.270016 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265749    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 09:08:31.270016 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265752    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 09:08:31.270016 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265755    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 09:08:31.270016 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265757    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 09:08:31.270016 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265775    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 09:08:31.270552 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265778    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 09:08:31.270552 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265781    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 09:08:31.270552 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265783    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 09:08:31.270552 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265786    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 09:08:31.270552 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265789    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 09:08:31.270552 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265792    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 09:08:31.270552 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265795    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 09:08:31.270552 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265798    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 09:08:31.270552 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265801    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 09:08:31.270552 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265804    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 09:08:31.270552 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265807    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 09:08:31.270552 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265809    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 09:08:31.270552 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265815    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 09:08:31.270552 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265818    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 09:08:31.270552 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265820    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 09:08:31.270552 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265823    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 09:08:31.270552 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265827    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 09:08:31.270552 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265829    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 09:08:31.270552 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265832    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 09:08:31.270552 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265835    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 09:08:31.271081 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265840    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 09:08:31.271081 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265844    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 09:08:31.271081 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265848    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 09:08:31.271081 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265851    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 09:08:31.271081 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265854    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 09:08:31.271081 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265857    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 09:08:31.271081 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265860    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 09:08:31.271081 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265864    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 09:08:31.271081 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265867    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 09:08:31.271081 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265870    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 09:08:31.271081 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265873    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 09:08:31.271081 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265876    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 09:08:31.271081 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265878    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 09:08:31.271081 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265882    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 09:08:31.271081 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265887    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 09:08:31.271081 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265890    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 09:08:31.271081 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265893    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 09:08:31.271081 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265896    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 09:08:31.271081 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265899    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 09:08:31.271570 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265901    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 09:08:31.271570 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265904    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 09:08:31.271570 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265906    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 09:08:31.271570 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265909    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 09:08:31.271570 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265912    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 09:08:31.271570 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265916    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 09:08:31.271570 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265919    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 09:08:31.271570 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265921    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 09:08:31.271570 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265924    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 09:08:31.271570 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265926    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 09:08:31.271570 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265929    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 09:08:31.271570 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265932    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 09:08:31.271570 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265935    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 09:08:31.271570 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265937    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 09:08:31.271570 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.265940    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 09:08:31.271570 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.266004    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 09:08:31.271570 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.266191    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 09:08:31.271570 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.266198    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 09:08:31.271570 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.266204    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 09:08:31.272083 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.266212    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 09:08:31.272083 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266355    2553 flags.go:64] FLAG: --address="0.0.0.0"
Jul 13 09:08:31.272083 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266366    2553 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 13 09:08:31.272083 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266389    2553 flags.go:64] FLAG: --anonymous-auth="true"
Jul 13 09:08:31.272083 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266402    2553 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 13 09:08:31.272083 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266410    2553 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 13 09:08:31.272083 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266415    2553 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 13 09:08:31.272083 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266423    2553 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 13 09:08:31.272083 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266430    2553 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 13 09:08:31.272083 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266436    2553 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 13 09:08:31.272083 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266441    2553 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 13 09:08:31.272083 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266447    2553 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 13 09:08:31.272083 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266457    2553 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 13 09:08:31.272083 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266463    2553 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 13 09:08:31.272083 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266468    2553 flags.go:64] FLAG: --cgroup-root=""
Jul 13 09:08:31.272083 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266473    2553 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 13 09:08:31.272083 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266478    2553 flags.go:64] FLAG: --client-ca-file=""
Jul 13 09:08:31.272083 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266484    2553 flags.go:64] FLAG: --cloud-provider="external"
Jul 13 09:08:31.272083 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266490    2553 flags.go:64] FLAG: --cluster-dns="[]"
Jul 13 09:08:31.272083 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266497    2553 flags.go:64] FLAG: --cluster-domain=""
Jul 13 09:08:31.272083 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266507    2553 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 13 09:08:31.272083 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266513    2553 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 13 09:08:31.272083 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266518    2553 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 13 09:08:31.272672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266524    2553 flags.go:64] FLAG: --container-log-max-files="5"
Jul 13 09:08:31.272672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266531    2553 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 13 09:08:31.272672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266536    2553 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 13 09:08:31.272672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266542    2553 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 13 09:08:31.272672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266548    2553 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 13 09:08:31.272672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266554    2553 flags.go:64] FLAG: --contention-profiling="false"
Jul 13 09:08:31.272672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266566    2553 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 13 09:08:31.272672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266572    2553 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 13 09:08:31.272672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266577    2553 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 13 09:08:31.272672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266583    2553 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 13 09:08:31.272672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266592    2553 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 13 09:08:31.272672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266597    2553 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 13 09:08:31.272672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266603    2553 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 13 09:08:31.272672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266608    2553 flags.go:64] FLAG: --enable-load-reader="false"
Jul 13 09:08:31.272672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266618    2553 flags.go:64] FLAG: --enable-server="true"
Jul 13 09:08:31.272672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266623    2553 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 13 09:08:31.272672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266633    2553 flags.go:64] FLAG: --event-burst="100"
Jul 13 09:08:31.272672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266638    2553 flags.go:64] FLAG: --event-qps="50"
Jul 13 09:08:31.272672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266643    2553 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 13 09:08:31.272672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266649    2553 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 13 09:08:31.272672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266654    2553 flags.go:64] FLAG: --eviction-hard=""
Jul 13 09:08:31.272672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266661    2553 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 13 09:08:31.272672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266666    2553 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 13 09:08:31.272672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266678    2553 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 13 09:08:31.272672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266684    2553 flags.go:64] FLAG: --eviction-soft=""
Jul 13 09:08:31.273356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266690    2553 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 13 09:08:31.273356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266696    2553 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 13 09:08:31.273356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266702    2553 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 13 09:08:31.273356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266707    2553 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 13 09:08:31.273356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266713    2553 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 13 09:08:31.273356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266718    2553 flags.go:64] FLAG: --fail-swap-on="true"
Jul 13 09:08:31.273356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266729    2553 flags.go:64] FLAG: --feature-gates=""
Jul 13 09:08:31.273356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266736    2553 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 13 09:08:31.273356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266741    2553 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 13 09:08:31.273356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266747    2553 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 13 09:08:31.273356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266752    2553 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 13 09:08:31.273356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266772    2553 flags.go:64] FLAG: --healthz-port="10248"
Jul 13 09:08:31.273356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266779    2553 flags.go:64] FLAG: --help="false"
Jul 13 09:08:31.273356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266784    2553 flags.go:64] FLAG: --hostname-override="ip-10-0-138-89.ec2.internal"
Jul 13 09:08:31.273356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266797    2553 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 13 09:08:31.273356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266803    2553 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 13 09:08:31.273356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266808    2553 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 13 09:08:31.273356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266816    2553 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 13 09:08:31.273356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266822    2553 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 13 09:08:31.273356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266828    2553 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 13 09:08:31.273356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266833    2553 flags.go:64] FLAG: --image-service-endpoint=""
Jul 13 09:08:31.273356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266838    2553 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 13 09:08:31.273356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266843    2553 flags.go:64] FLAG: --kube-api-burst="100"
Jul 13 09:08:31.273996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266853    2553 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 13 09:08:31.273996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266859    2553 flags.go:64] FLAG: --kube-api-qps="50"
Jul 13 09:08:31.273996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266864    2553 flags.go:64] FLAG: --kube-reserved=""
Jul 13 09:08:31.273996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266869    2553 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 13 09:08:31.273996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266874    2553 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 13 09:08:31.273996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266879    2553 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 13 09:08:31.273996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266885    2553 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 13 09:08:31.273996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266889    2553 flags.go:64] FLAG: --lock-file=""
Jul 13 09:08:31.273996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266895    2553 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 13 09:08:31.273996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266905    2553 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 13 09:08:31.273996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266910    2553 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 13 09:08:31.273996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266920    2553 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 13 09:08:31.273996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266926    2553 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 13 09:08:31.273996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266932    2553 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 13 09:08:31.273996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266937    2553 flags.go:64] FLAG: --logging-format="text"
Jul 13 09:08:31.273996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266942    2553 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 13 09:08:31.273996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266949    2553 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 13 09:08:31.273996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266960    2553 flags.go:64] FLAG: --manifest-url=""
Jul 13 09:08:31.273996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266967    2553 flags.go:64] FLAG: --manifest-url-header=""
Jul 13 09:08:31.273996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266980    2553 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 13 09:08:31.273996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266986    2553 flags.go:64] FLAG: --max-open-files="1000000"
Jul 13 09:08:31.273996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266993    2553 flags.go:64] FLAG: --max-pods="110"
Jul 13 09:08:31.273996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.266999    2553 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 13 09:08:31.273996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267010    2553 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 13 09:08:31.273996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267033    2553 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 13 09:08:31.274633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267040    2553 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 13 09:08:31.274633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267045    2553 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 13 09:08:31.274633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267051    2553 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 13 09:08:31.274633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267056    2553 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 13 09:08:31.274633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267070    2553 flags.go:64] FLAG: --node-status-max-images="50"
Jul 13 09:08:31.274633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267076    2553 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 13 09:08:31.274633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267087    2553 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 13 09:08:31.274633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267092    2553 flags.go:64] FLAG: --pod-cidr=""
Jul 13 09:08:31.274633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267098    2553 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 13 09:08:31.274633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267108    2553 flags.go:64] FLAG: --pod-manifest-path=""
Jul 13 09:08:31.274633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267113    2553 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 13 09:08:31.274633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267119    2553 flags.go:64] FLAG: --pods-per-core="0"
Jul 13 09:08:31.274633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267128    2553 flags.go:64] FLAG: --port="10250"
Jul 13 09:08:31.274633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267134    2553 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 13 09:08:31.274633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267138    2553 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01d390b01b3925b0f"
Jul 13 09:08:31.274633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267142    2553 flags.go:64] FLAG: --qos-reserved=""
Jul 13 09:08:31.274633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267145    2553 flags.go:64] FLAG: --read-only-port="10255"
Jul 13 09:08:31.274633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267149    2553 flags.go:64] FLAG: --register-node="true"
Jul 13 09:08:31.274633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267153    2553 flags.go:64] FLAG: --register-with-taints=""
Jul 13 09:08:31.274633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267157    2553 flags.go:64] FLAG: --registry-burst="10"
Jul 13 09:08:31.274633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267161    2553 flags.go:64] FLAG: --registry-qps="5"
Jul 13 09:08:31.274633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267168    2553 flags.go:64] FLAG: --reserved-cpus=""
Jul 13 09:08:31.274633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267171    2553 flags.go:64] FLAG: --reserved-memory=""
Jul 13 09:08:31.274633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267626    2553 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 13 09:08:31.274633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267745    2553 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 13 09:08:31.275347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267750    2553 flags.go:64] FLAG: --rotate-certificates="false"
Jul 13 09:08:31.275347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267755    2553 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 13 09:08:31.275347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267758    2553 flags.go:64] FLAG: --runonce="false"
Jul 13 09:08:31.275347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267775    2553 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 13 09:08:31.275347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267779    2553 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 13 09:08:31.275347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267783    2553 flags.go:64] FLAG: --seccomp-default="false"
Jul 13 09:08:31.275347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267786    2553 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 13 09:08:31.275347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267790    2553 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 13 09:08:31.275347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267794    2553 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 13 09:08:31.275347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267798    2553 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 13 09:08:31.275347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267802    2553 flags.go:64] FLAG: --storage-driver-password="root"
Jul 13 09:08:31.275347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267805    2553 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 13 09:08:31.275347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267808    2553 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 13 09:08:31.275347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267811    2553 flags.go:64] FLAG: --storage-driver-user="root"
Jul 13 09:08:31.275347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267814    2553 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 13 09:08:31.275347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267818    2553 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 13 09:08:31.275347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267821    2553 flags.go:64] FLAG: --system-cgroups=""
Jul 13 09:08:31.275347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267825    2553 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 13 09:08:31.275347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267834    2553 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 13 09:08:31.275347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267837    2553 flags.go:64] FLAG: --tls-cert-file=""
Jul 13 09:08:31.275347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267840    2553 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 13 09:08:31.275347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267846    2553 flags.go:64] FLAG: --tls-min-version=""
Jul 13 09:08:31.275347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267849    2553 flags.go:64] FLAG: --tls-private-key-file=""
Jul 13 09:08:31.275347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267852    2553 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 13 09:08:31.275347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267856    2553 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 13 09:08:31.276006 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267859    2553 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 13 09:08:31.276006 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267863    2553 flags.go:64] FLAG: --v="2"
Jul 13 09:08:31.276006 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267877    2553 flags.go:64] FLAG: --version="false"
Jul 13 09:08:31.276006 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267882    2553 flags.go:64] FLAG: --vmodule=""
Jul 13 09:08:31.276006 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267886    2553 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 13 09:08:31.276006 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.267890    2553 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 13 09:08:31.276006 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268024    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 09:08:31.276006 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268029    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 09:08:31.276006 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268033    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 09:08:31.276006 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268037    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 09:08:31.276006 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268040    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 09:08:31.276006 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268043    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 09:08:31.276006 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268046    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 09:08:31.276006 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268049    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 09:08:31.276006 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268052    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 09:08:31.276006 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268056    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 09:08:31.276006 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268060    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 09:08:31.276006 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268063    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 09:08:31.276006 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268066    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 09:08:31.276006 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268069    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 09:08:31.276006 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268072    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 09:08:31.276553 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268074    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 09:08:31.276553 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268077    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 09:08:31.276553 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268080    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 09:08:31.276553 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268083    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 09:08:31.276553 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268086    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 09:08:31.276553 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268088    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 09:08:31.276553 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268091    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 09:08:31.276553 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268094    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 09:08:31.276553 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268097    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 09:08:31.276553 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268102    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 09:08:31.276553 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268105    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 09:08:31.276553 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268108    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 09:08:31.276553 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268110    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 09:08:31.276553 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268114    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 09:08:31.276553 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268116    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 09:08:31.276553 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268119    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 09:08:31.276553 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268122    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 09:08:31.276553 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268126    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 09:08:31.276553 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268129    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 09:08:31.276553 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268132    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 09:08:31.277119 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268135    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 09:08:31.277119 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268138    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 09:08:31.277119 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268141    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 09:08:31.277119 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268143    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 09:08:31.277119 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268146    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 09:08:31.277119 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268149    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 09:08:31.277119 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268152    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 09:08:31.277119 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268155    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 09:08:31.277119 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268158    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 09:08:31.277119 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268160    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 09:08:31.277119 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268163    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 09:08:31.277119 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268166    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 09:08:31.277119 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268169    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 09:08:31.277119 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268172    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 09:08:31.277119 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268175    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 09:08:31.277119 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268178    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 09:08:31.277119 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268180    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 09:08:31.277119 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268183    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 09:08:31.277119 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268186    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 09:08:31.277119 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268188    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 09:08:31.277641 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268191    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 09:08:31.277641 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268196    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 09:08:31.277641 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268199    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 09:08:31.277641 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268201    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 09:08:31.277641 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268204    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 09:08:31.277641 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268207    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 09:08:31.277641 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268209    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 09:08:31.277641 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268212    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 09:08:31.277641 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268215    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 09:08:31.277641 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268219    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 09:08:31.277641 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268222    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 09:08:31.277641 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268225    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 09:08:31.277641 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268227    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 09:08:31.277641 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268231    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 09:08:31.277641 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268233    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 09:08:31.277641 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268238    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 09:08:31.277641 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268242    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 09:08:31.277641 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268245    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 09:08:31.277641 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268249    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 09:08:31.278144 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268252    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 09:08:31.278144 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268254    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 09:08:31.278144 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268258    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 09:08:31.278144 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268261    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 09:08:31.278144 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268265    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 09:08:31.278144 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268268    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 09:08:31.278144 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268272    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 09:08:31.278144 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268275    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 09:08:31.278144 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268278    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 09:08:31.278144 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268280    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 09:08:31.278144 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268283    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 09:08:31.278144 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268285    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 09:08:31.278144 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268288    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 09:08:31.278144 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268291    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 09:08:31.278144 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268295    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 09:08:31.278144 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268299    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 09:08:31.278144 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268302    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 09:08:31.278144 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268305    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 09:08:31.278607 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268309    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 09:08:31.278607 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268313    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 09:08:31.278607 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268316    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 09:08:31.278607 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268319    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 09:08:31.278607 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268324    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 09:08:31.278607 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268327    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 09:08:31.278607 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.268330    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 09:08:31.278607 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.269330    2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 09:08:31.278607 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.276697    2553 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 13 09:08:31.278607 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.276717    2553 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 13 09:08:31.278607 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.277628    2553 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 13 09:08:31.278607 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.277636    2553 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 13 09:08:31.278607 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277702    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 09:08:31.278607 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277708    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 09:08:31.278607 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277712    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 09:08:31.279092 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277715    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 09:08:31.279092 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277718    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 09:08:31.279092 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277721    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 09:08:31.279092 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277724    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 09:08:31.279092 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277727    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 09:08:31.279092 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277730    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 09:08:31.279092 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277733    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 09:08:31.279092 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277736    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 09:08:31.279092 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277739    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 09:08:31.279092 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277741    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 09:08:31.279092 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277744    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 09:08:31.279092 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277747    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 09:08:31.279092 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277750    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 09:08:31.279092 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277752    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 09:08:31.279092 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277755    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 09:08:31.279092 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277768    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 09:08:31.279092 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277772    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 09:08:31.279092 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277775    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 09:08:31.279092 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277778    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 09:08:31.279092 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277781    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 09:08:31.279612 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277784    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 09:08:31.279612 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277787    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 09:08:31.279612 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277790    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 09:08:31.279612 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277793    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 09:08:31.279612 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277796    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 09:08:31.279612 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277799    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 09:08:31.279612 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277804    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 09:08:31.279612 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277809    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 09:08:31.279612 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277814    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 09:08:31.279612 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277817    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 09:08:31.279612 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277820    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 09:08:31.279612 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277823    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 09:08:31.279612 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277827    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 09:08:31.279612 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277829    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 09:08:31.279612 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277832    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 09:08:31.279612 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277835    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 09:08:31.279612 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277837    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 09:08:31.279612 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277840    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 09:08:31.279612 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277843    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 09:08:31.280127 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277846    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 09:08:31.280127 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277849    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 09:08:31.280127 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277851    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 09:08:31.280127 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277854    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 09:08:31.280127 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277857    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 09:08:31.280127 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277860    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 09:08:31.280127 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277862    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 09:08:31.280127 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277865    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 09:08:31.280127 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277867    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 09:08:31.280127 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277870    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 09:08:31.280127 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277873    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 09:08:31.280127 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277876    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 09:08:31.280127 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277879    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 09:08:31.280127 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277882    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 09:08:31.280127 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277885    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 09:08:31.280127 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277887    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 09:08:31.280127 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277890    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 09:08:31.280127 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277893    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 09:08:31.280127 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277896    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 09:08:31.280127 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277900    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 09:08:31.280127 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277904    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 09:08:31.280670 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277907    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 09:08:31.280670 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277910    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 09:08:31.280670 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277913    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 09:08:31.280670 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277915    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 09:08:31.280670 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277918    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 09:08:31.280670 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277921    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 09:08:31.280670 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277924    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 09:08:31.280670 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277927    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 09:08:31.280670 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277931    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 09:08:31.280670 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277935    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 09:08:31.280670 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277940    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 09:08:31.280670 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277943    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 09:08:31.280670 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277947    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 09:08:31.280670 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277950    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 09:08:31.280670 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277952    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 09:08:31.280670 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277955    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 09:08:31.280670 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277958    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 09:08:31.280670 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277961    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 09:08:31.280670 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277966    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 09:08:31.281193 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277969    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 09:08:31.281193 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277972    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 09:08:31.281193 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277975    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 09:08:31.281193 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277978    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 09:08:31.281193 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277980    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 09:08:31.281193 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277983    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 09:08:31.281193 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277986    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 09:08:31.281193 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277988    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 09:08:31.281193 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277991    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 09:08:31.281193 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277994    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 09:08:31.281193 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.277997    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 09:08:31.281193 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278000    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 09:08:31.281193 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278003    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 09:08:31.281193 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278007    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 09:08:31.281193 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278010    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 09:08:31.281193 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278013    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 09:08:31.281193 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278015    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 09:08:31.281637 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.278021    2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 09:08:31.281637 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278154    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 09:08:31.281637 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278160    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 09:08:31.281637 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278163    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 09:08:31.281637 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278166    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 09:08:31.281637 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278169    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 09:08:31.281637 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278173    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 09:08:31.281637 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278175    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 09:08:31.281637 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278178    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 09:08:31.281637 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278181    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 09:08:31.281637 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278184    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 09:08:31.281637 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278187    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 09:08:31.281637 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278189    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 09:08:31.281637 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278192    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 09:08:31.281637 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278195    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 09:08:31.282086 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278198    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 09:08:31.282086 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278201    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 09:08:31.282086 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278204    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 09:08:31.282086 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278207    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 09:08:31.282086 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278210    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 09:08:31.282086 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278213    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 09:08:31.282086 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278216    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 09:08:31.282086 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278219    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 09:08:31.282086 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278222    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 09:08:31.282086 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278225    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 09:08:31.282086 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278228    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 09:08:31.282086 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278231    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 09:08:31.282086 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278233    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 09:08:31.282086 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278236    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 09:08:31.282086 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278240    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 09:08:31.282086 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278242    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 09:08:31.282086 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278245    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 09:08:31.282086 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278248    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 09:08:31.282086 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278251    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 09:08:31.282086 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278253    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 09:08:31.282605 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278257    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 09:08:31.282605 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278261    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 09:08:31.282605 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278265    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 09:08:31.282605 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278268    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 09:08:31.282605 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278271    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 09:08:31.282605 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278274    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 09:08:31.282605 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278277    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 09:08:31.282605 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278280    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 09:08:31.282605 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278282    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 09:08:31.282605 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278285    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 09:08:31.282605 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278288    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 09:08:31.282605 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278291    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 09:08:31.282605 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278295    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 09:08:31.282605 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278298    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 09:08:31.282605 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278302    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 09:08:31.282605 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278305    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 09:08:31.282605 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278307    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 09:08:31.282605 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278310    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 09:08:31.282605 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278313    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 09:08:31.283170 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278316    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 09:08:31.283170 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278320    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 09:08:31.283170 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278324    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 09:08:31.283170 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278327    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 09:08:31.283170 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278330    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 09:08:31.283170 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278333    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 09:08:31.283170 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278336    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 09:08:31.283170 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278339    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 09:08:31.283170 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278343    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 09:08:31.283170 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278346    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 09:08:31.283170 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278349    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 09:08:31.283170 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278351    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 09:08:31.283170 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278354    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 09:08:31.283170 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278356    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 09:08:31.283170 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278359    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 09:08:31.283170 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278362    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 09:08:31.283170 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278365    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 09:08:31.283170 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278367    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 09:08:31.283170 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278370    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 09:08:31.283170 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278373    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 09:08:31.283697 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278376    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 09:08:31.283697 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278378    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 09:08:31.283697 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278381    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 09:08:31.283697 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278383    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 09:08:31.283697 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278386    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 09:08:31.283697 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278389    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 09:08:31.283697 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278392    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 09:08:31.283697 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278395    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 09:08:31.283697 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278398    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 09:08:31.283697 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278400    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 09:08:31.283697 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278403    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 09:08:31.283697 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278406    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 09:08:31.283697 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278409    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 09:08:31.283697 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278412    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 09:08:31.283697 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278414    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 09:08:31.283697 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278417    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 09:08:31.283697 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278420    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 09:08:31.283697 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278423    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 09:08:31.283697 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278426    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 09:08:31.284216 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278431    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 09:08:31.284216 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278434    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 09:08:31.284216 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278437    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 09:08:31.284216 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278440    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 09:08:31.284216 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278443    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 09:08:31.284216 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278445    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 09:08:31.284216 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:31.278448    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 09:08:31.284216 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.278454    2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 09:08:31.284216 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.278595    2553 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 13 09:08:31.284216 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.280704    2553 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 13 09:08:31.284216 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.282435    2553 server.go:1019] "Starting client certificate rotation"
Jul 13 09:08:31.284216 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.282546    2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 09:08:31.284216 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.282586    2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 09:08:31.286279 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.286259    2553 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 09:08:31.289620 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.289600    2553 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 09:08:31.298425 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.298399    2553 log.go:25] "Validated CRI v1 runtime API"
Jul 13 09:08:31.302206 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.302184    2553 log.go:25] "Validated CRI v1 image API"
Jul 13 09:08:31.303852 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.303836    2553 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 13 09:08:31.306661 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.306638    2553 fs.go:135] Filesystem UUIDs: map[482e4f49-e6ba-4ad5-8115-6a7fa691c102:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7e8779d3-3a04-48e2-a271-214ea41a5a8a:/dev/nvme0n1p4]
Jul 13 09:08:31.306712 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.306661    2553 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 13 09:08:31.312210 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.312068    2553 manager.go:216] Machine: {Timestamp:2026-07-13 09:08:31.31063608 +0000 UTC m=+0.388513350 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099920 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f417ecd5cb6b0749c22f0eda32e77 SystemUUID:ec2f417e-cd5c-b6b0-749c-22f0eda32e77 BootID:f5146c0d-f4e0-4d70-a5a5-fa1a98443fe6 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:78:ba:74:5e:eb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:78:ba:74:5e:eb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:40:7b:4b:67:4b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 13 09:08:31.312210 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.312203    2553 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 13 09:08:31.312334 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.312298    2553 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 13 09:08:31.313985 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.313967    2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 09:08:31.315738 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.315709    2553 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 13 09:08:31.315920 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.315742    2553 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-89.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 13 09:08:31.317170 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.317158    2553 topology_manager.go:138] "Creating topology manager with none policy"
Jul 13 09:08:31.317214 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.317172    2553 container_manager_linux.go:309] "Creating device plugin manager"
Jul 13 09:08:31.317214 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.317180    2553 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 09:08:31.317841 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.317829    2553 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 09:08:31.319527 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.319513    2553 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 13 09:08:31.322889 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.322875    2553 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 09:08:31.323028 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.323018    2553 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 13 09:08:31.323060 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.323055    2553 kubelet.go:486] "Attempting to sync node with API server"
Jul 13 09:08:31.323096 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.323067    2553 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 13 09:08:31.323096 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.323083    2553 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 13 09:08:31.323096 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.323095    2553 kubelet.go:398] "Adding apiserver pod source"
Jul 13 09:08:31.323203 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.323104    2553 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 13 09:08:31.323527 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.323511    2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 09:08:31.323593 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.323532    2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 09:08:31.325858 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.325840    2553 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 13 09:08:31.327863 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.327845    2553 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 13 09:08:31.327947 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.327888    2553 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 13 09:08:31.328099 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.328085    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 13 09:08:31.328161 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.328105    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 13 09:08:31.328161 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.328114    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 13 09:08:31.328161 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.328124    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 13 09:08:31.328161 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.328136    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 13 09:08:31.328161 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.328146    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 13 09:08:31.328637 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.328626    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 13 09:08:31.328689 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.328640    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 13 09:08:31.328689 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.328651    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 13 09:08:31.328689 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.328660    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 13 09:08:31.328689 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.328674    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 13 09:08:31.328689 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.328688    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 13 09:08:31.329413 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.329401    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 13 09:08:31.329465 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.329417    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 13 09:08:31.332844 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.332826    2553 server.go:1268] "Started kubelet"
Jul 13 09:08:31.332951 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.332910    2553 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 13 09:08:31.333612 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.333544    2553 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 13 09:08:31.333691 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.333639    2553 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 13 09:08:31.333855 ip-10-0-138-89 systemd[1]: Started Kubernetes Kubelet.
Jul 13 09:08:31.334856 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.334843    2553 server.go:310] "Adding debug handlers to kubelet server"
Jul 13 09:08:31.335071 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.334974    2553 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 13 09:08:31.336565 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.336542    2553 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-89.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 13 09:08:31.336837 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.336783    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-89.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 13 09:08:31.336941 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.336684    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 13 09:08:31.339332 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.339309    2553 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 13 09:08:31.341611 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.341588    2553 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 13 09:08:31.341611 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.341604    2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 13 09:08:31.341832 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.341685    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found"
Jul 13 09:08:31.342414 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.342393    2553 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 13 09:08:31.342414 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.342412    2553 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 13 09:08:31.342557 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.342422    2553 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 13 09:08:31.342557 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.342509    2553 reconstruct.go:97] "Volume reconstruction finished"
Jul 13 09:08:31.342557 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.342519    2553 reconciler.go:29] "Reconciler: start to sync state"
Jul 13 09:08:31.342694 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.342596    2553 factory.go:55] Registering systemd factory
Jul 13 09:08:31.342694 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.342638    2553 factory.go:223] Registration of the systemd container factory successfully
Jul 13 09:08:31.342822 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.338449    2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-89.ec2.internal.18c1ce423ed5e15f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-89.ec2.internal,UID:ip-10-0-138-89.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-89.ec2.internal,},FirstTimestamp:2026-07-13 09:08:31.332794719 +0000 UTC m=+0.410671967,LastTimestamp:2026-07-13 09:08:31.332794719 +0000 UTC m=+0.410671967,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-89.ec2.internal,}"
Jul 13 09:08:31.343158 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.343128    2553 factory.go:153] Registering CRI-O factory
Jul 13 09:08:31.343158 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.343151    2553 factory.go:223] Registration of the crio container factory successfully
Jul 13 09:08:31.343300 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.343210    2553 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 13 09:08:31.343300 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.343236    2553 factory.go:103] Registering Raw factory
Jul 13 09:08:31.343300 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.343251    2553 manager.go:1196] Started watching for new ooms in manager
Jul 13 09:08:31.343708 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.343685    2553 manager.go:349] Starting recovery of all containers
Jul 13 09:08:31.343944 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.343918    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 13 09:08:31.344161 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.344136    2553 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-89.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 13 09:08:31.354523 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.354502    2553 manager.go:354] Recovery completed
Jul 13 09:08:31.358846 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.358831    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 09:08:31.362101 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.362080    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 09:08:31.362172 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.362118    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 09:08:31.362172 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.362130    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientPID"
Jul 13 09:08:31.362660 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.362647    2553 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 13 09:08:31.362660 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.362659    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 09:08:31.362798 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.362660    2553 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 13 09:08:31.362798 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.362729    2553 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 09:08:31.363429 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.363414    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 09:08:31.363495 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.363442    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 09:08:31.363495 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.363456    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientPID"
Jul 13 09:08:31.364340 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.364326    2553 policy_none.go:49] "None policy: Start"
Jul 13 09:08:31.364413 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.364346    2553 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 13 09:08:31.364413 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.364361    2553 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 13 09:08:31.364612 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.364538    2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-89.ec2.internal.18c1ce42409518c1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-89.ec2.internal,UID:ip-10-0-138-89.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-89.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-89.ec2.internal,},FirstTimestamp:2026-07-13 09:08:31.362103489 +0000 UTC m=+0.439980738,LastTimestamp:2026-07-13 09:08:31.362103489 +0000 UTC m=+0.439980738,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-89.ec2.internal,}"
Jul 13 09:08:31.365542 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.365529    2553 policy_none.go:47] "Start"
Jul 13 09:08:31.376032 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.375952    2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-89.ec2.internal.18c1ce42409566a3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-89.ec2.internal,UID:ip-10-0-138-89.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-89.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-89.ec2.internal,},FirstTimestamp:2026-07-13 09:08:31.362123427 +0000 UTC m=+0.440000675,LastTimestamp:2026-07-13 09:08:31.362123427 +0000 UTC m=+0.440000675,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-89.ec2.internal,}"
Jul 13 09:08:31.388183 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.387998    2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-89.ec2.internal.18c1ce4240959011  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-89.ec2.internal,UID:ip-10-0-138-89.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-89.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-89.ec2.internal,},FirstTimestamp:2026-07-13 09:08:31.362134033 +0000 UTC m=+0.440011283,LastTimestamp:2026-07-13 09:08:31.362134033 +0000 UTC m=+0.440011283,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-89.ec2.internal,}"
Jul 13 09:08:31.398159 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.398091    2553 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-89.ec2.internal.18c1ce42409518c1\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-89.ec2.internal.18c1ce42409518c1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-89.ec2.internal,UID:ip-10-0-138-89.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-89.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-89.ec2.internal,},FirstTimestamp:2026-07-13 09:08:31.362103489 +0000 UTC m=+0.439980738,LastTimestamp:2026-07-13 09:08:31.363428227 +0000 UTC m=+0.441305475,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-89.ec2.internal,}"
Jul 13 09:08:31.401396 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.401381    2553 manager.go:337] "Starting Device Plugin manager"
Jul 13 09:08:31.401488 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.401415    2553 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 13 09:08:31.401488 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.401424    2553 server.go:87] "Starting device plugin registration server"
Jul 13 09:08:31.401727 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.401709    2553 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 13 09:08:31.401827 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.401725    2553 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 13 09:08:31.401918 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.401901    2553 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 13 09:08:31.402036 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.401999    2553 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 13 09:08:31.402036 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.402021    2553 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 13 09:08:31.402502 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.402482    2553 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 13 09:08:31.402591 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.402528    2553 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-89.ec2.internal\" not found"
Jul 13 09:08:31.409302 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.409228    2553 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-89.ec2.internal.18c1ce42409566a3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-89.ec2.internal.18c1ce42409566a3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-89.ec2.internal,UID:ip-10-0-138-89.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-89.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-89.ec2.internal,},FirstTimestamp:2026-07-13 09:08:31.362123427 +0000 UTC m=+0.440000675,LastTimestamp:2026-07-13 09:08:31.363449353 +0000 UTC m=+0.441326606,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-89.ec2.internal,}"
Jul 13 09:08:31.419517 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.419436    2553 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-89.ec2.internal.18c1ce4240959011\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-89.ec2.internal.18c1ce4240959011  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-89.ec2.internal,UID:ip-10-0-138-89.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-89.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-89.ec2.internal,},FirstTimestamp:2026-07-13 09:08:31.362134033 +0000 UTC m=+0.440011283,LastTimestamp:2026-07-13 09:08:31.363460933 +0000 UTC m=+0.441338183,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-89.ec2.internal,}"
Jul 13 09:08:31.433590 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.433521    2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-89.ec2.internal.18c1ce4243121593  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-89.ec2.internal,UID:ip-10-0-138-89.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-138-89.ec2.internal,},FirstTimestamp:2026-07-13 09:08:31.403849107 +0000 UTC m=+0.481726342,LastTimestamp:2026-07-13 09:08:31.403849107 +0000 UTC m=+0.481726342,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-89.ec2.internal,}"
Jul 13 09:08:31.473831 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.473791    2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 13 09:08:31.476279 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.475126    2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 13 09:08:31.476279 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.475159    2553 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 13 09:08:31.476279 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.475181    2553 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 13 09:08:31.476279 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.475215    2553 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 13 09:08:31.487907 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.487883    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 13 09:08:31.489066 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.489050    2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mlz5n"
Jul 13 09:08:31.498279 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.498226    2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mlz5n"
Jul 13 09:08:31.502488 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.502475    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 09:08:31.503686 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.503670    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 09:08:31.503793 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.503719    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 09:08:31.503793 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.503735    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientPID"
Jul 13 09:08:31.503793 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.503759    2553 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-89.ec2.internal"
Jul 13 09:08:31.521955 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.521931    2553 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-89.ec2.internal"
Jul 13 09:08:31.522040 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.521959    2553 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-89.ec2.internal\": node \"ip-10-0-138-89.ec2.internal\" not found"
Jul 13 09:08:31.548560 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.548534    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found"
Jul 13 09:08:31.575397 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.575340    2553 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-89.ec2.internal"]
Jul 13 09:08:31.575560 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.575442    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 09:08:31.576434 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.576418    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 09:08:31.576510 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.576447    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 09:08:31.576510 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.576458    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientPID"
Jul 13 09:08:31.578194 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.578179    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 09:08:31.578304 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.578286    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal"
Jul 13 09:08:31.578356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.578340    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 09:08:31.579005 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.578980    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 09:08:31.579005 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.578984    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 09:08:31.579158 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.579031    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 09:08:31.579158 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.579043    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientPID"
Jul 13 09:08:31.579158 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.579010    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 09:08:31.579158 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.579104    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientPID"
Jul 13 09:08:31.580656 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.580638    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.ec2.internal"
Jul 13 09:08:31.580718 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.580669    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 09:08:31.581799 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.581783    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 09:08:31.581908 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.581814    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 09:08:31.581908 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.581830    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientPID"
Jul 13 09:08:31.606745 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.606716    2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-89.ec2.internal\" not found" node="ip-10-0-138-89.ec2.internal"
Jul 13 09:08:31.611757 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.611738    2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-89.ec2.internal\" not found" node="ip-10-0-138-89.ec2.internal"
Jul 13 09:08:31.644077 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.644041    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/01506cdc1a19a11ab65ea85b5f2cdc0b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal\" (UID: \"01506cdc1a19a11ab65ea85b5f2cdc0b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal"
Jul 13 09:08:31.644077 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.644075    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01506cdc1a19a11ab65ea85b5f2cdc0b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal\" (UID: \"01506cdc1a19a11ab65ea85b5f2cdc0b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal"
Jul 13 09:08:31.644261 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.644096    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3faaf0080471f3cd3415287075e9ebbd-config\") pod \"kube-apiserver-proxy-ip-10-0-138-89.ec2.internal\" (UID: \"3faaf0080471f3cd3415287075e9ebbd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.ec2.internal"
Jul 13 09:08:31.649453 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.649432    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found"
Jul 13 09:08:31.747376 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.747285    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01506cdc1a19a11ab65ea85b5f2cdc0b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal\" (UID: \"01506cdc1a19a11ab65ea85b5f2cdc0b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal"
Jul 13 09:08:31.747376 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.747361    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01506cdc1a19a11ab65ea85b5f2cdc0b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal\" (UID: \"01506cdc1a19a11ab65ea85b5f2cdc0b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal"
Jul 13 09:08:31.747487 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.747405    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3faaf0080471f3cd3415287075e9ebbd-config\") pod \"kube-apiserver-proxy-ip-10-0-138-89.ec2.internal\" (UID: \"3faaf0080471f3cd3415287075e9ebbd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.ec2.internal"
Jul 13 09:08:31.747487 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.747426    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/01506cdc1a19a11ab65ea85b5f2cdc0b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal\" (UID: \"01506cdc1a19a11ab65ea85b5f2cdc0b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal"
Jul 13 09:08:31.747487 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.747466    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/01506cdc1a19a11ab65ea85b5f2cdc0b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal\" (UID: \"01506cdc1a19a11ab65ea85b5f2cdc0b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal"
Jul 13 09:08:31.747584 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.747501    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3faaf0080471f3cd3415287075e9ebbd-config\") pod \"kube-apiserver-proxy-ip-10-0-138-89.ec2.internal\" (UID: \"3faaf0080471f3cd3415287075e9ebbd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.ec2.internal"
Jul 13 09:08:31.749668 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.749619    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found"
Jul 13 09:08:31.850741 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.850705    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found"
Jul 13 09:08:31.909837 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.909796    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal"
Jul 13 09:08:31.915207 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:31.915183    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.ec2.internal"
Jul 13 09:08:31.951692 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:31.951656    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found"
Jul 13 09:08:32.052838 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:32.052747    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found"
Jul 13 09:08:32.153705 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:32.153663    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found"
Jul 13 09:08:32.254626 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:32.254592    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found"
Jul 13 09:08:32.281851 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:32.281821    2553 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 13 09:08:32.301591 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:32.301563    2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 09:08:32.355809 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:32.355723    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found"
Jul 13 09:08:32.397015 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:32.396979    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 09:08:32.398372 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:32.398352    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 09:08:32.398489 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:32.398394    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 09:08:32.398489 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:32.398410    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientPID"
Jul 13 09:08:32.456400 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:32.456371    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found"
Jul 13 09:08:32.472787 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:32.472756    2553 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 09:08:32.502488 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:32.502440    2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 09:03:32 +0000 UTC" deadline="2028-04-22 04:37:40.160627692 +0000 UTC"
Jul 13 09:08:32.502488 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:32.502477    2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15571h29m7.658154431s"
Jul 13 09:08:32.542707 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:32.542671    2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal"
Jul 13 09:08:32.556976 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:32.556929    2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 09:08:32.558580 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:32.558558    2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.ec2.internal"
Jul 13 09:08:32.567858 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:32.567835    2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 09:08:32.624753 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:32.624732    2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 09:08:32.635902 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:32.635851    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01506cdc1a19a11ab65ea85b5f2cdc0b.slice/crio-b38e6c33d80180cf2ba367d15dcd7319abfccdff8c68893587f4704a9a9f4065 WatchSource:0}: Error finding container b38e6c33d80180cf2ba367d15dcd7319abfccdff8c68893587f4704a9a9f4065: Status 404 returned error can't find the container with id b38e6c33d80180cf2ba367d15dcd7319abfccdff8c68893587f4704a9a9f4065
Jul 13 09:08:32.641012 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:32.640993    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 09:08:32.646300 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:32.646276    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3faaf0080471f3cd3415287075e9ebbd.slice/crio-9367e235e8d30f725b02468f87d78944491395859f2bccbb00377922c8e6e81b WatchSource:0}: Error finding container 9367e235e8d30f725b02468f87d78944491395859f2bccbb00377922c8e6e81b: Status 404 returned error can't find the container with id 9367e235e8d30f725b02468f87d78944491395859f2bccbb00377922c8e6e81b
Jul 13 09:08:32.912764 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:32.912661    2553 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 09:08:33.325408 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.325327    2553 apiserver.go:52] "Watching apiserver"
Jul 13 09:08:33.332834 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.332802    2553 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 13 09:08:33.334346 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.334320    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-hg679","openshift-cluster-node-tuning-operator/tuned-9wv9z","openshift-dns/node-resolver-btlb4","openshift-multus/multus-additional-cni-plugins-lgpgz","openshift-network-operator/iptables-alerter-z7l2d","openshift-ovn-kubernetes/ovnkube-node-t558b","kube-system/konnectivity-agent-nh9gf","kube-system/kube-apiserver-proxy-ip-10-0-138-89.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h","openshift-image-registry/node-ca-9qslx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal","openshift-multus/multus-z22ks","openshift-multus/network-metrics-daemon-rrhxd","openshift-network-diagnostics/network-check-target-h6lck"]
Jul 13 09:08:33.337082 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.337062    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nh9gf"
Jul 13 09:08:33.339585 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.339564    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:08:33.339689 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:33.339648    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rrhxd" podUID="caf4af40-8763-4401-8dd4-dfe646c17704"
Jul 13 09:08:33.340052 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.340031    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ntsqp\""
Jul 13 09:08:33.340199 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.340168    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 13 09:08:33.340266 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.340238    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 13 09:08:33.342084 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.342060    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-btlb4"
Jul 13 09:08:33.344250 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.342852    2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 13 09:08:33.344726 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.344579    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-b55tw\""
Jul 13 09:08:33.345518 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.345495    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 13 09:08:33.345688 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.345523    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 13 09:08:33.345844 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.345826    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.348320 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.348121    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z7l2d"
Jul 13 09:08:33.348655 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.348628    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 13 09:08:33.349011 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.348987    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nhf8v\""
Jul 13 09:08:33.349240 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.349223    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 13 09:08:33.349240 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.349279    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 13 09:08:33.349552 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.349534    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 13 09:08:33.349653 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.349551    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 13 09:08:33.351095 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.350721    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 13 09:08:33.351095 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.350773    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.351095 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.350869    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 13 09:08:33.351426 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.351408    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 13 09:08:33.351545 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.351532    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pkblv\""
Jul 13 09:08:33.353456 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.353435    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h"
Jul 13 09:08:33.353981 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.353951    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 13 09:08:33.354124 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.354106    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 13 09:08:33.354251 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.354231    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 13 09:08:33.354333 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.354317    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5tb9p\""
Jul 13 09:08:33.354398 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.354387    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 13 09:08:33.354456 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.354242    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 13 09:08:33.354717 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.354698    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 13 09:08:33.354794 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.354764    2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 09:08:33.356457 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.356235    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:33.356457 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:33.356304    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg679" podUID="96008549-14fd-453d-9236-a601e1010005"
Jul 13 09:08:33.356950 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.356930    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 13 09:08:33.357051 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.356961    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 13 09:08:33.357051 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.356980    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 13 09:08:33.357051 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.357029    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w6qzs\""
Jul 13 09:08:33.358741 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.358722    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.359581 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.359562    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/85e00737-0392-4971-b5bb-0eb2d8f14e5f-hosts-file\") pod \"node-resolver-btlb4\" (UID: \"85e00737-0392-4971-b5bb-0eb2d8f14e5f\") " pod="openshift-dns/node-resolver-btlb4"
Jul 13 09:08:33.359711 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.359597    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdw7g\" (UniqueName: \"kubernetes.io/projected/85e00737-0392-4971-b5bb-0eb2d8f14e5f-kube-api-access-bdw7g\") pod \"node-resolver-btlb4\" (UID: \"85e00737-0392-4971-b5bb-0eb2d8f14e5f\") " pod="openshift-dns/node-resolver-btlb4"
Jul 13 09:08:33.359711 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.359637    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/835e2516-31bc-47e3-b1e1-b212f41fd914-agent-certs\") pod \"konnectivity-agent-nh9gf\" (UID: \"835e2516-31bc-47e3-b1e1-b212f41fd914\") " pod="kube-system/konnectivity-agent-nh9gf"
Jul 13 09:08:33.359711 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.359669    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85e00737-0392-4971-b5bb-0eb2d8f14e5f-tmp-dir\") pod \"node-resolver-btlb4\" (UID: \"85e00737-0392-4971-b5bb-0eb2d8f14e5f\") " pod="openshift-dns/node-resolver-btlb4"
Jul 13 09:08:33.359893 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.359692    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/583af178-0c29-4df4-b251-ca8bf7db2a41-system-cni-dir\") pod \"multus-additional-cni-plugins-lgpgz\" (UID: \"583af178-0c29-4df4-b251-ca8bf7db2a41\") " pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.359893 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.359786    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/583af178-0c29-4df4-b251-ca8bf7db2a41-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lgpgz\" (UID: \"583af178-0c29-4df4-b251-ca8bf7db2a41\") " pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.359893 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.359817    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl5tr\" (UniqueName: \"kubernetes.io/projected/583af178-0c29-4df4-b251-ca8bf7db2a41-kube-api-access-vl5tr\") pod \"multus-additional-cni-plugins-lgpgz\" (UID: \"583af178-0c29-4df4-b251-ca8bf7db2a41\") " pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.359893 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.359844    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28mgf\" (UniqueName: \"kubernetes.io/projected/caf4af40-8763-4401-8dd4-dfe646c17704-kube-api-access-28mgf\") pod \"network-metrics-daemon-rrhxd\" (UID: \"caf4af40-8763-4401-8dd4-dfe646c17704\") " pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:08:33.359893 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.359870    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/583af178-0c29-4df4-b251-ca8bf7db2a41-cnibin\") pod \"multus-additional-cni-plugins-lgpgz\" (UID: \"583af178-0c29-4df4-b251-ca8bf7db2a41\") " pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.360144 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.359897    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/583af178-0c29-4df4-b251-ca8bf7db2a41-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lgpgz\" (UID: \"583af178-0c29-4df4-b251-ca8bf7db2a41\") " pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.360144 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.359925    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/835e2516-31bc-47e3-b1e1-b212f41fd914-konnectivity-ca\") pod \"konnectivity-agent-nh9gf\" (UID: \"835e2516-31bc-47e3-b1e1-b212f41fd914\") " pod="kube-system/konnectivity-agent-nh9gf"
Jul 13 09:08:33.360144 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.359950    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs\") pod \"network-metrics-daemon-rrhxd\" (UID: \"caf4af40-8763-4401-8dd4-dfe646c17704\") " pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:08:33.360144 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.359986    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/583af178-0c29-4df4-b251-ca8bf7db2a41-os-release\") pod \"multus-additional-cni-plugins-lgpgz\" (UID: \"583af178-0c29-4df4-b251-ca8bf7db2a41\") " pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.360144 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.360019    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/583af178-0c29-4df4-b251-ca8bf7db2a41-cni-binary-copy\") pod \"multus-additional-cni-plugins-lgpgz\" (UID: \"583af178-0c29-4df4-b251-ca8bf7db2a41\") " pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.360144 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.360047    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/583af178-0c29-4df4-b251-ca8bf7db2a41-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lgpgz\" (UID: \"583af178-0c29-4df4-b251-ca8bf7db2a41\") " pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.361359 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.361334    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7sxmv\""
Jul 13 09:08:33.361453 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.361367    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 13 09:08:33.361453 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.361441    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9qslx"
Jul 13 09:08:33.361630 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.361611    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 13 09:08:33.364131 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.364021    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:08:33.364131 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:33.364095    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6lck" podUID="5765ed08-0739-46eb-a13a-2eb857df9c1b"
Jul 13 09:08:33.364656 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.364638    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vj5q2\""
Jul 13 09:08:33.365122 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.365089    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 13 09:08:33.365122 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.365111    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 13 09:08:33.365449 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.365434    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 13 09:08:33.366606 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.366583    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.369434 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.369417    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 13 09:08:33.369676 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.369435    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-85m76\""
Jul 13 09:08:33.384898 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.384877    2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x42t6"
Jul 13 09:08:33.398254 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.398040    2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x42t6"
Jul 13 09:08:33.443530 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.443504    2553 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 13 09:08:33.460574 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.460553    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/96e7b834-c90a-4808-958a-f56d9efa0213-sys-fs\") pod \"aws-ebs-csi-driver-node-l455h\" (UID: \"96e7b834-c90a-4808-958a-f56d9efa0213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h"
Jul 13 09:08:33.460574 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.460578    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/96008549-14fd-453d-9236-a601e1010005-dbus\") pod \"global-pull-secret-syncer-hg679\" (UID: \"96008549-14fd-453d-9236-a601e1010005\") " pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:33.460776 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.460597    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f477a535-0e7f-45e0-9889-b30d8e06abc0-host\") pod \"node-ca-9qslx\" (UID: \"f477a535-0e7f-45e0-9889-b30d8e06abc0\") " pod="openshift-image-registry/node-ca-9qslx"
Jul 13 09:08:33.460776 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.460616    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-multus-conf-dir\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.460776 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.460634    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t29m\" (UniqueName: \"kubernetes.io/projected/859c1cd1-b6d7-403c-adf9-8817dd781a5b-kube-api-access-6t29m\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.460776 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.460653    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-host-cni-netd\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.460776 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.460669    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-etc-systemd\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.460776 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.460688    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdw7g\" (UniqueName: \"kubernetes.io/projected/85e00737-0392-4971-b5bb-0eb2d8f14e5f-kube-api-access-bdw7g\") pod \"node-resolver-btlb4\" (UID: \"85e00737-0392-4971-b5bb-0eb2d8f14e5f\") " pod="openshift-dns/node-resolver-btlb4"
Jul 13 09:08:33.460776 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.460719    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/96e7b834-c90a-4808-958a-f56d9efa0213-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l455h\" (UID: \"96e7b834-c90a-4808-958a-f56d9efa0213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h"
Jul 13 09:08:33.460776 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.460741    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/96e7b834-c90a-4808-958a-f56d9efa0213-device-dir\") pod \"aws-ebs-csi-driver-node-l455h\" (UID: \"96e7b834-c90a-4808-958a-f56d9efa0213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h"
Jul 13 09:08:33.460776 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.460758    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/96e7b834-c90a-4808-958a-f56d9efa0213-etc-selinux\") pod \"aws-ebs-csi-driver-node-l455h\" (UID: \"96e7b834-c90a-4808-958a-f56d9efa0213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h"
Jul 13 09:08:33.460776 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.460774    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-run-openvswitch\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.461205 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.460811    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-log-socket\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.461205 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.460841    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-etc-sysctl-d\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.461205 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.460864    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f4844405-4513-4054-b96d-8fa9676d9b98-iptables-alerter-script\") pod \"iptables-alerter-z7l2d\" (UID: \"f4844405-4513-4054-b96d-8fa9676d9b98\") " pod="openshift-network-operator/iptables-alerter-z7l2d"
Jul 13 09:08:33.461205 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.460902    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4844405-4513-4054-b96d-8fa9676d9b98-host-slash\") pod \"iptables-alerter-z7l2d\" (UID: \"f4844405-4513-4054-b96d-8fa9676d9b98\") " pod="openshift-network-operator/iptables-alerter-z7l2d"
Jul 13 09:08:33.461205 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.460948    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbkbp\" (UniqueName: \"kubernetes.io/projected/f4844405-4513-4054-b96d-8fa9676d9b98-kube-api-access-cbkbp\") pod \"iptables-alerter-z7l2d\" (UID: \"f4844405-4513-4054-b96d-8fa9676d9b98\") " pod="openshift-network-operator/iptables-alerter-z7l2d"
Jul 13 09:08:33.461205 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.460982    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db263c9c-ef1c-4e74-968b-f8822c77dffc-env-overrides\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.461205 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.460997    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmlwj\" (UniqueName: \"kubernetes.io/projected/db263c9c-ef1c-4e74-968b-f8822c77dffc-kube-api-access-cmlwj\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.461205 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461014    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-etc-modprobe-d\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.461205 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461037    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-lib-modules\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.461205 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461061    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4c88\" (UniqueName: \"kubernetes.io/projected/96e7b834-c90a-4808-958a-f56d9efa0213-kube-api-access-r4c88\") pod \"aws-ebs-csi-driver-node-l455h\" (UID: \"96e7b834-c90a-4808-958a-f56d9efa0213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h"
Jul 13 09:08:33.461205 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461084    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/859c1cd1-b6d7-403c-adf9-8817dd781a5b-cni-binary-copy\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.461205 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461102    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.461205 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461131    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/583af178-0c29-4df4-b251-ca8bf7db2a41-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lgpgz\" (UID: \"583af178-0c29-4df4-b251-ca8bf7db2a41\") " pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.461205 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461157    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-cnibin\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.461205 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461174    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-multus-socket-dir-parent\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.461921 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461233    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-host-var-lib-cni-multus\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.461921 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461276    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-var-lib-kubelet\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.461921 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461306    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-os-release\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.461921 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461332    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-etc-kubernetes\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.461921 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461357    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-host-kubelet\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.461921 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461384    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db263c9c-ef1c-4e74-968b-f8822c77dffc-ovn-node-metrics-cert\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.461921 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461412    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-etc-kubernetes\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.461921 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461445    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl5tr\" (UniqueName: \"kubernetes.io/projected/583af178-0c29-4df4-b251-ca8bf7db2a41-kube-api-access-vl5tr\") pod \"multus-additional-cni-plugins-lgpgz\" (UID: \"583af178-0c29-4df4-b251-ca8bf7db2a41\") " pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.461921 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461471    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/96e7b834-c90a-4808-958a-f56d9efa0213-socket-dir\") pod \"aws-ebs-csi-driver-node-l455h\" (UID: \"96e7b834-c90a-4808-958a-f56d9efa0213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h"
Jul 13 09:08:33.461921 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461498    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/96008549-14fd-453d-9236-a601e1010005-kubelet-config\") pod \"global-pull-secret-syncer-hg679\" (UID: \"96008549-14fd-453d-9236-a601e1010005\") " pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:33.461921 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461529    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-host-cni-bin\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.461921 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461559    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-etc-tuned\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.461921 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461578    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/583af178-0c29-4df4-b251-ca8bf7db2a41-cnibin\") pod \"multus-additional-cni-plugins-lgpgz\" (UID: \"583af178-0c29-4df4-b251-ca8bf7db2a41\") " pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.461921 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461598    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/835e2516-31bc-47e3-b1e1-b212f41fd914-konnectivity-ca\") pod \"konnectivity-agent-nh9gf\" (UID: \"835e2516-31bc-47e3-b1e1-b212f41fd914\") " pod="kube-system/konnectivity-agent-nh9gf"
Jul 13 09:08:33.461921 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461623    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wbqx\" (UniqueName: \"kubernetes.io/projected/5765ed08-0739-46eb-a13a-2eb857df9c1b-kube-api-access-9wbqx\") pod \"network-check-target-h6lck\" (UID: \"5765ed08-0739-46eb-a13a-2eb857df9c1b\") " pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:08:33.461921 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461648    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-systemd-units\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.462676 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461658    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/583af178-0c29-4df4-b251-ca8bf7db2a41-cnibin\") pod \"multus-additional-cni-plugins-lgpgz\" (UID: \"583af178-0c29-4df4-b251-ca8bf7db2a41\") " pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.462676 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461671    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-tmp\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.462676 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461693    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/583af178-0c29-4df4-b251-ca8bf7db2a41-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lgpgz\" (UID: \"583af178-0c29-4df4-b251-ca8bf7db2a41\") " pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.462676 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461727    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4lj5\" (UniqueName: \"kubernetes.io/projected/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-kube-api-access-t4lj5\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.462676 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461761    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/583af178-0c29-4df4-b251-ca8bf7db2a41-os-release\") pod \"multus-additional-cni-plugins-lgpgz\" (UID: \"583af178-0c29-4df4-b251-ca8bf7db2a41\") " pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.462676 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461818    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/583af178-0c29-4df4-b251-ca8bf7db2a41-cni-binary-copy\") pod \"multus-additional-cni-plugins-lgpgz\" (UID: \"583af178-0c29-4df4-b251-ca8bf7db2a41\") " pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.462676 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461893    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/583af178-0c29-4df4-b251-ca8bf7db2a41-os-release\") pod \"multus-additional-cni-plugins-lgpgz\" (UID: \"583af178-0c29-4df4-b251-ca8bf7db2a41\") " pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.462676 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461894    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbkxv\" (UniqueName: \"kubernetes.io/projected/f477a535-0e7f-45e0-9889-b30d8e06abc0-kube-api-access-nbkxv\") pod \"node-ca-9qslx\" (UID: \"f477a535-0e7f-45e0-9889-b30d8e06abc0\") " pod="openshift-image-registry/node-ca-9qslx"
Jul 13 09:08:33.462676 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461940    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-multus-cni-dir\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.462676 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.461971    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-sys\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.462676 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462000    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/85e00737-0392-4971-b5bb-0eb2d8f14e5f-hosts-file\") pod \"node-resolver-btlb4\" (UID: \"85e00737-0392-4971-b5bb-0eb2d8f14e5f\") " pod="openshift-dns/node-resolver-btlb4"
Jul 13 09:08:33.462676 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462044    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/835e2516-31bc-47e3-b1e1-b212f41fd914-agent-certs\") pod \"konnectivity-agent-nh9gf\" (UID: \"835e2516-31bc-47e3-b1e1-b212f41fd914\") " pod="kube-system/konnectivity-agent-nh9gf"
Jul 13 09:08:33.462676 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462082    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/96e7b834-c90a-4808-958a-f56d9efa0213-registration-dir\") pod \"aws-ebs-csi-driver-node-l455h\" (UID: \"96e7b834-c90a-4808-958a-f56d9efa0213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h"
Jul 13 09:08:33.462676 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462108    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-host-run-multus-certs\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.462676 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462117    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/85e00737-0392-4971-b5bb-0eb2d8f14e5f-hosts-file\") pod \"node-resolver-btlb4\" (UID: \"85e00737-0392-4971-b5bb-0eb2d8f14e5f\") " pod="openshift-dns/node-resolver-btlb4"
Jul 13 09:08:33.462676 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462138    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-etc-openvswitch\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.462676 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462162    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/835e2516-31bc-47e3-b1e1-b212f41fd914-konnectivity-ca\") pod \"konnectivity-agent-nh9gf\" (UID: \"835e2516-31bc-47e3-b1e1-b212f41fd914\") " pod="kube-system/konnectivity-agent-nh9gf"
Jul 13 09:08:33.463598 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462310    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/583af178-0c29-4df4-b251-ca8bf7db2a41-cni-binary-copy\") pod \"multus-additional-cni-plugins-lgpgz\" (UID: \"583af178-0c29-4df4-b251-ca8bf7db2a41\") " pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.463598 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462340    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-run\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.463598 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462360    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-host\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.463598 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462384    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/583af178-0c29-4df4-b251-ca8bf7db2a41-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lgpgz\" (UID: \"583af178-0c29-4df4-b251-ca8bf7db2a41\") " pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.463598 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462418    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f477a535-0e7f-45e0-9889-b30d8e06abc0-serviceca\") pod \"node-ca-9qslx\" (UID: \"f477a535-0e7f-45e0-9889-b30d8e06abc0\") " pod="openshift-image-registry/node-ca-9qslx"
Jul 13 09:08:33.463598 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462448    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-host-run-netns\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.463598 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462490    2553 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 13 09:08:33.463598 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462529    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-host-var-lib-cni-bin\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.463598 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462582    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-host-var-lib-kubelet\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.463598 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462610    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/583af178-0c29-4df4-b251-ca8bf7db2a41-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lgpgz\" (UID: \"583af178-0c29-4df4-b251-ca8bf7db2a41\") " pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.463598 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462607    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/859c1cd1-b6d7-403c-adf9-8817dd781a5b-multus-daemon-config\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.463598 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462662    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-host-run-netns\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.463598 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462690    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28mgf\" (UniqueName: \"kubernetes.io/projected/caf4af40-8763-4401-8dd4-dfe646c17704-kube-api-access-28mgf\") pod \"network-metrics-daemon-rrhxd\" (UID: \"caf4af40-8763-4401-8dd4-dfe646c17704\") " pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:08:33.463598 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462746    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-host-slash\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.463598 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462771    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-var-lib-openvswitch\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.463598 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462794    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-run-ovn\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.463598 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462840    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db263c9c-ef1c-4e74-968b-f8822c77dffc-ovnkube-script-lib\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.464211 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462867    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-etc-sysconfig\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.464211 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462888    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-etc-sysctl-conf\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.464211 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462906    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs\") pod \"network-metrics-daemon-rrhxd\" (UID: \"caf4af40-8763-4401-8dd4-dfe646c17704\") " pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:08:33.464211 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462923    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96008549-14fd-453d-9236-a601e1010005-original-pull-secret\") pod \"global-pull-secret-syncer-hg679\" (UID: \"96008549-14fd-453d-9236-a601e1010005\") " pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:33.464211 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462942    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-system-cni-dir\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.464211 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.462966    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-host-run-k8s-cni-cncf-io\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.464211 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.463011    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-run-systemd\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.464211 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:33.463043    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 09:08:33.464211 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.463045    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-host-run-ovn-kubernetes\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.464211 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:33.463118    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs podName:caf4af40-8763-4401-8dd4-dfe646c17704 nodeName:}" failed. No retries permitted until 2026-07-13 09:08:33.963094168 +0000 UTC m=+3.040971408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs") pod "network-metrics-daemon-rrhxd" (UID: "caf4af40-8763-4401-8dd4-dfe646c17704") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 09:08:33.464211 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.463141    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85e00737-0392-4971-b5bb-0eb2d8f14e5f-tmp-dir\") pod \"node-resolver-btlb4\" (UID: \"85e00737-0392-4971-b5bb-0eb2d8f14e5f\") " pod="openshift-dns/node-resolver-btlb4"
Jul 13 09:08:33.464211 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.463170    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/583af178-0c29-4df4-b251-ca8bf7db2a41-system-cni-dir\") pod \"multus-additional-cni-plugins-lgpgz\" (UID: \"583af178-0c29-4df4-b251-ca8bf7db2a41\") " pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.464211 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.463199    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db263c9c-ef1c-4e74-968b-f8822c77dffc-ovnkube-config\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.464211 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.463216    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/583af178-0c29-4df4-b251-ca8bf7db2a41-system-cni-dir\") pod \"multus-additional-cni-plugins-lgpgz\" (UID: \"583af178-0c29-4df4-b251-ca8bf7db2a41\") " pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.464211 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.463228    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/583af178-0c29-4df4-b251-ca8bf7db2a41-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lgpgz\" (UID: \"583af178-0c29-4df4-b251-ca8bf7db2a41\") " pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.464211 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.463254    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-hostroot\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.464703 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.463288    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-node-log\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.464703 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.463420    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85e00737-0392-4971-b5bb-0eb2d8f14e5f-tmp-dir\") pod \"node-resolver-btlb4\" (UID: \"85e00737-0392-4971-b5bb-0eb2d8f14e5f\") " pod="openshift-dns/node-resolver-btlb4"
Jul 13 09:08:33.464703 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.463779    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/583af178-0c29-4df4-b251-ca8bf7db2a41-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lgpgz\" (UID: \"583af178-0c29-4df4-b251-ca8bf7db2a41\") " pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.466117 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.466097    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/835e2516-31bc-47e3-b1e1-b212f41fd914-agent-certs\") pod \"konnectivity-agent-nh9gf\" (UID: \"835e2516-31bc-47e3-b1e1-b212f41fd914\") " pod="kube-system/konnectivity-agent-nh9gf"
Jul 13 09:08:33.470230 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.470202    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdw7g\" (UniqueName: \"kubernetes.io/projected/85e00737-0392-4971-b5bb-0eb2d8f14e5f-kube-api-access-bdw7g\") pod \"node-resolver-btlb4\" (UID: \"85e00737-0392-4971-b5bb-0eb2d8f14e5f\") " pod="openshift-dns/node-resolver-btlb4"
Jul 13 09:08:33.471334 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.471277    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl5tr\" (UniqueName: \"kubernetes.io/projected/583af178-0c29-4df4-b251-ca8bf7db2a41-kube-api-access-vl5tr\") pod \"multus-additional-cni-plugins-lgpgz\" (UID: \"583af178-0c29-4df4-b251-ca8bf7db2a41\") " pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.474553 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.474531    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28mgf\" (UniqueName: \"kubernetes.io/projected/caf4af40-8763-4401-8dd4-dfe646c17704-kube-api-access-28mgf\") pod \"network-metrics-daemon-rrhxd\" (UID: \"caf4af40-8763-4401-8dd4-dfe646c17704\") " pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:08:33.481800 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.481730    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.ec2.internal" event={"ID":"3faaf0080471f3cd3415287075e9ebbd","Type":"ContainerStarted","Data":"9367e235e8d30f725b02468f87d78944491395859f2bccbb00377922c8e6e81b"}
Jul 13 09:08:33.482983 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.482959    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal" event={"ID":"01506cdc1a19a11ab65ea85b5f2cdc0b","Type":"ContainerStarted","Data":"b38e6c33d80180cf2ba367d15dcd7319abfccdff8c68893587f4704a9a9f4065"}
Jul 13 09:08:33.563565 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.563527    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-log-socket\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.563772 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.563573    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-etc-sysctl-d\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.563772 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.563599    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f4844405-4513-4054-b96d-8fa9676d9b98-iptables-alerter-script\") pod \"iptables-alerter-z7l2d\" (UID: \"f4844405-4513-4054-b96d-8fa9676d9b98\") " pod="openshift-network-operator/iptables-alerter-z7l2d"
Jul 13 09:08:33.563772 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.563627    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4844405-4513-4054-b96d-8fa9676d9b98-host-slash\") pod \"iptables-alerter-z7l2d\" (UID: \"f4844405-4513-4054-b96d-8fa9676d9b98\") " pod="openshift-network-operator/iptables-alerter-z7l2d"
Jul 13 09:08:33.563772 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.563661    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-log-socket\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.563772 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.563684    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4844405-4513-4054-b96d-8fa9676d9b98-host-slash\") pod \"iptables-alerter-z7l2d\" (UID: \"f4844405-4513-4054-b96d-8fa9676d9b98\") " pod="openshift-network-operator/iptables-alerter-z7l2d"
Jul 13 09:08:33.563772 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.563733    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbkbp\" (UniqueName: \"kubernetes.io/projected/f4844405-4513-4054-b96d-8fa9676d9b98-kube-api-access-cbkbp\") pod \"iptables-alerter-z7l2d\" (UID: \"f4844405-4513-4054-b96d-8fa9676d9b98\") " pod="openshift-network-operator/iptables-alerter-z7l2d"
Jul 13 09:08:33.564079 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.563779    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-etc-sysctl-d\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.564079 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.563811    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db263c9c-ef1c-4e74-968b-f8822c77dffc-env-overrides\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.564079 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.563845    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmlwj\" (UniqueName: \"kubernetes.io/projected/db263c9c-ef1c-4e74-968b-f8822c77dffc-kube-api-access-cmlwj\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.564079 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.563872    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-etc-modprobe-d\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.564079 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.563979    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-etc-modprobe-d\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.564318 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564080    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-lib-modules\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.564318 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564135    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4c88\" (UniqueName: \"kubernetes.io/projected/96e7b834-c90a-4808-958a-f56d9efa0213-kube-api-access-r4c88\") pod \"aws-ebs-csi-driver-node-l455h\" (UID: \"96e7b834-c90a-4808-958a-f56d9efa0213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h"
Jul 13 09:08:33.564318 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564184    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/859c1cd1-b6d7-403c-adf9-8817dd781a5b-cni-binary-copy\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.564318 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564212    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.564318 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564233    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-lib-modules\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.564318 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564245    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-cnibin\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.564318 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564271    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-multus-socket-dir-parent\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.564318 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564299    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-host-var-lib-cni-multus\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.564722 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564322    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db263c9c-ef1c-4e74-968b-f8822c77dffc-env-overrides\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.564722 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564325    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-var-lib-kubelet\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.564722 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564379    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-os-release\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.564722 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564391    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-var-lib-kubelet\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.564722 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564405    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-etc-kubernetes\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.564722 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564424    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-host-kubelet\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.564722 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564429    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-cnibin\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.564722 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564447    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db263c9c-ef1c-4e74-968b-f8822c77dffc-ovn-node-metrics-cert\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.564722 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564468    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-etc-kubernetes\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.564722 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564488    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/96e7b834-c90a-4808-958a-f56d9efa0213-socket-dir\") pod \"aws-ebs-csi-driver-node-l455h\" (UID: \"96e7b834-c90a-4808-958a-f56d9efa0213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h"
Jul 13 09:08:33.564722 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564487    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.564722 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564505    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/96008549-14fd-453d-9236-a601e1010005-kubelet-config\") pod \"global-pull-secret-syncer-hg679\" (UID: \"96008549-14fd-453d-9236-a601e1010005\") " pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:33.564722 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564520    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-multus-socket-dir-parent\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.564722 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564530    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-host-cni-bin\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.564722 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564535    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-host-kubelet\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.564722 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564547    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-etc-tuned\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.564722 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564574    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-host-var-lib-cni-multus\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.564722 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564595    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-os-release\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.565626 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564605    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wbqx\" (UniqueName: \"kubernetes.io/projected/5765ed08-0739-46eb-a13a-2eb857df9c1b-kube-api-access-9wbqx\") pod \"network-check-target-h6lck\" (UID: \"5765ed08-0739-46eb-a13a-2eb857df9c1b\") " pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:08:33.565626 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564632    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-systemd-units\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.565626 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564640    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-etc-kubernetes\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.565626 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564650    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-tmp\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.565626 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564658    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/859c1cd1-b6d7-403c-adf9-8817dd781a5b-cni-binary-copy\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.565626 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564668    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4lj5\" (UniqueName: \"kubernetes.io/projected/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-kube-api-access-t4lj5\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.565626 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564701    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbkxv\" (UniqueName: \"kubernetes.io/projected/f477a535-0e7f-45e0-9889-b30d8e06abc0-kube-api-access-nbkxv\") pod \"node-ca-9qslx\" (UID: \"f477a535-0e7f-45e0-9889-b30d8e06abc0\") " pod="openshift-image-registry/node-ca-9qslx"
Jul 13 09:08:33.565626 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564755    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/96e7b834-c90a-4808-958a-f56d9efa0213-socket-dir\") pod \"aws-ebs-csi-driver-node-l455h\" (UID: \"96e7b834-c90a-4808-958a-f56d9efa0213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h"
Jul 13 09:08:33.565626 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564722    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-systemd-units\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.565626 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564852    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-host-cni-bin\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.565626 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564861    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f4844405-4513-4054-b96d-8fa9676d9b98-iptables-alerter-script\") pod \"iptables-alerter-z7l2d\" (UID: \"f4844405-4513-4054-b96d-8fa9676d9b98\") " pod="openshift-network-operator/iptables-alerter-z7l2d"
Jul 13 09:08:33.565626 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564865    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/96008549-14fd-453d-9236-a601e1010005-kubelet-config\") pod \"global-pull-secret-syncer-hg679\" (UID: \"96008549-14fd-453d-9236-a601e1010005\") " pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:33.565626 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564896    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-multus-cni-dir\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.565626 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564930    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-sys\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.565626 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564951    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-etc-kubernetes\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.565626 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.564958    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/96e7b834-c90a-4808-958a-f56d9efa0213-registration-dir\") pod \"aws-ebs-csi-driver-node-l455h\" (UID: \"96e7b834-c90a-4808-958a-f56d9efa0213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h"
Jul 13 09:08:33.565626 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565008    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-host-run-multus-certs\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.565626 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565013    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-sys\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.566546 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565033    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-etc-openvswitch\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.566546 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565058    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-run\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.566546 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565091    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-host-run-multus-certs\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.566546 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565100    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-host\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.566546 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565148    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f477a535-0e7f-45e0-9889-b30d8e06abc0-serviceca\") pod \"node-ca-9qslx\" (UID: \"f477a535-0e7f-45e0-9889-b30d8e06abc0\") " pod="openshift-image-registry/node-ca-9qslx"
Jul 13 09:08:33.566546 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565159    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-etc-openvswitch\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.566546 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565166    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-multus-cni-dir\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.566546 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565161    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-run\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.566546 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565178    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-host-run-netns\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.566546 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565205    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-host\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.566546 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565218    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-host-var-lib-cni-bin\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.566546 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565213    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/96e7b834-c90a-4808-958a-f56d9efa0213-registration-dir\") pod \"aws-ebs-csi-driver-node-l455h\" (UID: \"96e7b834-c90a-4808-958a-f56d9efa0213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h"
Jul 13 09:08:33.566546 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565242    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-host-run-netns\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.566546 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565249    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-host-var-lib-kubelet\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.566546 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565279    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/859c1cd1-b6d7-403c-adf9-8817dd781a5b-multus-daemon-config\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.566546 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565313    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-host-var-lib-cni-bin\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.566546 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565327    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-host-run-netns\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.566546 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565356    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-host-slash\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.567314 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565360    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-host-var-lib-kubelet\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.567314 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565384    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-var-lib-openvswitch\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.567314 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565412    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-run-ovn\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.567314 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565445    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-host-slash\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.567314 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565439    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db263c9c-ef1c-4e74-968b-f8822c77dffc-ovnkube-script-lib\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.567314 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565413    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-host-run-netns\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.567314 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565485    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-etc-sysconfig\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.567314 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565516    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-etc-sysctl-conf\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.567314 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565527    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-var-lib-openvswitch\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.567314 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565516    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-run-ovn\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.567314 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565567    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96008549-14fd-453d-9236-a601e1010005-original-pull-secret\") pod \"global-pull-secret-syncer-hg679\" (UID: \"96008549-14fd-453d-9236-a601e1010005\") " pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:33.567314 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565599    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-system-cni-dir\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.567314 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565625    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f477a535-0e7f-45e0-9889-b30d8e06abc0-serviceca\") pod \"node-ca-9qslx\" (UID: \"f477a535-0e7f-45e0-9889-b30d8e06abc0\") " pod="openshift-image-registry/node-ca-9qslx"
Jul 13 09:08:33.567314 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565680    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-system-cni-dir\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.567314 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565684    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-host-run-k8s-cni-cncf-io\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.567314 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565628    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-host-run-k8s-cni-cncf-io\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.567314 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565677    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-etc-sysctl-conf\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.567314 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565728    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-run-systemd\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.568182 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565756    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-host-run-ovn-kubernetes\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.568182 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565798    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-etc-sysconfig\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.568182 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565815    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db263c9c-ef1c-4e74-968b-f8822c77dffc-ovnkube-config\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.568182 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565849    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-hostroot\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.568182 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565854    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-run-systemd\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.568182 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565860    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-host-run-ovn-kubernetes\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.568182 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:33.565816    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 09:08:33.568182 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565875    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-node-log\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.568182 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565906    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/96e7b834-c90a-4808-958a-f56d9efa0213-sys-fs\") pod \"aws-ebs-csi-driver-node-l455h\" (UID: \"96e7b834-c90a-4808-958a-f56d9efa0213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h"
Jul 13 09:08:33.568182 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565927    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/859c1cd1-b6d7-403c-adf9-8817dd781a5b-multus-daemon-config\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.568182 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565934    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/96008549-14fd-453d-9236-a601e1010005-dbus\") pod \"global-pull-secret-syncer-hg679\" (UID: \"96008549-14fd-453d-9236-a601e1010005\") " pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:33.568182 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:33.565960    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96008549-14fd-453d-9236-a601e1010005-original-pull-secret podName:96008549-14fd-453d-9236-a601e1010005 nodeName:}" failed. No retries permitted until 2026-07-13 09:08:34.065939517 +0000 UTC m=+3.143816756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96008549-14fd-453d-9236-a601e1010005-original-pull-secret") pod "global-pull-secret-syncer-hg679" (UID: "96008549-14fd-453d-9236-a601e1010005") : object "kube-system"/"original-pull-secret" not registered
Jul 13 09:08:33.568182 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.565983    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-hostroot\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.568182 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.566029    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f477a535-0e7f-45e0-9889-b30d8e06abc0-host\") pod \"node-ca-9qslx\" (UID: \"f477a535-0e7f-45e0-9889-b30d8e06abc0\") " pod="openshift-image-registry/node-ca-9qslx"
Jul 13 09:08:33.568182 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.566029    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/96008549-14fd-453d-9236-a601e1010005-dbus\") pod \"global-pull-secret-syncer-hg679\" (UID: \"96008549-14fd-453d-9236-a601e1010005\") " pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:33.568182 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.566062    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-multus-conf-dir\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.568182 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.566076    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-node-log\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.568182 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.566095    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t29m\" (UniqueName: \"kubernetes.io/projected/859c1cd1-b6d7-403c-adf9-8817dd781a5b-kube-api-access-6t29m\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.568913 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.566123    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-host-cni-netd\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.568913 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.566131    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/96e7b834-c90a-4808-958a-f56d9efa0213-sys-fs\") pod \"aws-ebs-csi-driver-node-l455h\" (UID: \"96e7b834-c90a-4808-958a-f56d9efa0213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h"
Jul 13 09:08:33.568913 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.566176    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f477a535-0e7f-45e0-9889-b30d8e06abc0-host\") pod \"node-ca-9qslx\" (UID: \"f477a535-0e7f-45e0-9889-b30d8e06abc0\") " pod="openshift-image-registry/node-ca-9qslx"
Jul 13 09:08:33.568913 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.566176    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-host-cni-netd\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.568913 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.566204    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-etc-systemd\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.568913 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.566205    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db263c9c-ef1c-4e74-968b-f8822c77dffc-ovnkube-script-lib\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.568913 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.566225    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/859c1cd1-b6d7-403c-adf9-8817dd781a5b-multus-conf-dir\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.568913 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.566253    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/96e7b834-c90a-4808-958a-f56d9efa0213-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l455h\" (UID: \"96e7b834-c90a-4808-958a-f56d9efa0213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h"
Jul 13 09:08:33.568913 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.566289    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-etc-systemd\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.568913 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.566288    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/96e7b834-c90a-4808-958a-f56d9efa0213-device-dir\") pod \"aws-ebs-csi-driver-node-l455h\" (UID: \"96e7b834-c90a-4808-958a-f56d9efa0213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h"
Jul 13 09:08:33.568913 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.566322    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/96e7b834-c90a-4808-958a-f56d9efa0213-etc-selinux\") pod \"aws-ebs-csi-driver-node-l455h\" (UID: \"96e7b834-c90a-4808-958a-f56d9efa0213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h"
Jul 13 09:08:33.568913 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.566336    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db263c9c-ef1c-4e74-968b-f8822c77dffc-ovnkube-config\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.568913 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.566350    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-run-openvswitch\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.568913 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.566338    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/96e7b834-c90a-4808-958a-f56d9efa0213-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l455h\" (UID: \"96e7b834-c90a-4808-958a-f56d9efa0213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h"
Jul 13 09:08:33.568913 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.566336    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/96e7b834-c90a-4808-958a-f56d9efa0213-device-dir\") pod \"aws-ebs-csi-driver-node-l455h\" (UID: \"96e7b834-c90a-4808-958a-f56d9efa0213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h"
Jul 13 09:08:33.568913 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.566434    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/96e7b834-c90a-4808-958a-f56d9efa0213-etc-selinux\") pod \"aws-ebs-csi-driver-node-l455h\" (UID: \"96e7b834-c90a-4808-958a-f56d9efa0213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h"
Jul 13 09:08:33.568913 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.566442    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db263c9c-ef1c-4e74-968b-f8822c77dffc-run-openvswitch\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.569705 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.567795    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-tmp\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.569705 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.567824    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db263c9c-ef1c-4e74-968b-f8822c77dffc-ovn-node-metrics-cert\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.569705 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.568388    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-etc-tuned\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.576441 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.576348    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4c88\" (UniqueName: \"kubernetes.io/projected/96e7b834-c90a-4808-958a-f56d9efa0213-kube-api-access-r4c88\") pod \"aws-ebs-csi-driver-node-l455h\" (UID: \"96e7b834-c90a-4808-958a-f56d9efa0213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h"
Jul 13 09:08:33.576562 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:33.576504    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 09:08:33.576562 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:33.576524    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 09:08:33.576562 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:33.576545    2553 projected.go:196] Error preparing data for projected volume kube-api-access-9wbqx for pod openshift-network-diagnostics/network-check-target-h6lck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 09:08:33.576738 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:33.576616    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5765ed08-0739-46eb-a13a-2eb857df9c1b-kube-api-access-9wbqx podName:5765ed08-0739-46eb-a13a-2eb857df9c1b nodeName:}" failed. No retries permitted until 2026-07-13 09:08:34.076588458 +0000 UTC m=+3.154465717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9wbqx" (UniqueName: "kubernetes.io/projected/5765ed08-0739-46eb-a13a-2eb857df9c1b-kube-api-access-9wbqx") pod "network-check-target-h6lck" (UID: "5765ed08-0739-46eb-a13a-2eb857df9c1b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 09:08:33.579665 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.579638    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4lj5\" (UniqueName: \"kubernetes.io/projected/2b9ca74a-fe82-4fde-8dc1-6d639f222d44-kube-api-access-t4lj5\") pod \"tuned-9wv9z\" (UID: \"2b9ca74a-fe82-4fde-8dc1-6d639f222d44\") " pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.579916 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.579894    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t29m\" (UniqueName: \"kubernetes.io/projected/859c1cd1-b6d7-403c-adf9-8817dd781a5b-kube-api-access-6t29m\") pod \"multus-z22ks\" (UID: \"859c1cd1-b6d7-403c-adf9-8817dd781a5b\") " pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.580051 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.580028    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmlwj\" (UniqueName: \"kubernetes.io/projected/db263c9c-ef1c-4e74-968b-f8822c77dffc-kube-api-access-cmlwj\") pod \"ovnkube-node-t558b\" (UID: \"db263c9c-ef1c-4e74-968b-f8822c77dffc\") " pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.580421 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.580395    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbkbp\" (UniqueName: \"kubernetes.io/projected/f4844405-4513-4054-b96d-8fa9676d9b98-kube-api-access-cbkbp\") pod \"iptables-alerter-z7l2d\" (UID: \"f4844405-4513-4054-b96d-8fa9676d9b98\") " pod="openshift-network-operator/iptables-alerter-z7l2d"
Jul 13 09:08:33.580593 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.580570    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbkxv\" (UniqueName: \"kubernetes.io/projected/f477a535-0e7f-45e0-9889-b30d8e06abc0-kube-api-access-nbkxv\") pod \"node-ca-9qslx\" (UID: \"f477a535-0e7f-45e0-9889-b30d8e06abc0\") " pod="openshift-image-registry/node-ca-9qslx"
Jul 13 09:08:33.651048 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.651006    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nh9gf"
Jul 13 09:08:33.660919 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.660893    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-btlb4"
Jul 13 09:08:33.669879 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.669853    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lgpgz"
Jul 13 09:08:33.676823 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.676802    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z7l2d"
Jul 13 09:08:33.684766 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.684744    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:08:33.692873 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.692855    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h"
Jul 13 09:08:33.700851 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.700821    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9wv9z"
Jul 13 09:08:33.707808 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.707792    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9qslx"
Jul 13 09:08:33.713751 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.713732    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z22ks"
Jul 13 09:08:33.848796 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:33.848637    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod859c1cd1_b6d7_403c_adf9_8817dd781a5b.slice/crio-9733c443f7525bcd7402bfe45bb2b74db271ed4025283d2c27938f6eb4367d53 WatchSource:0}: Error finding container 9733c443f7525bcd7402bfe45bb2b74db271ed4025283d2c27938f6eb4367d53: Status 404 returned error can't find the container with id 9733c443f7525bcd7402bfe45bb2b74db271ed4025283d2c27938f6eb4367d53
Jul 13 09:08:33.855817 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:33.855784    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf477a535_0e7f_45e0_9889_b30d8e06abc0.slice/crio-0b248d18bd83eacf3eed41967f4cc80b7b68a3e88ef27d23d7dd063dbca5b074 WatchSource:0}: Error finding container 0b248d18bd83eacf3eed41967f4cc80b7b68a3e88ef27d23d7dd063dbca5b074: Status 404 returned error can't find the container with id 0b248d18bd83eacf3eed41967f4cc80b7b68a3e88ef27d23d7dd063dbca5b074
Jul 13 09:08:33.856626 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:33.856596    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b9ca74a_fe82_4fde_8dc1_6d639f222d44.slice/crio-ff57feb74b38f28de3f379009edb5de835c3e4868416a178157c96112ba02207 WatchSource:0}: Error finding container ff57feb74b38f28de3f379009edb5de835c3e4868416a178157c96112ba02207: Status 404 returned error can't find the container with id ff57feb74b38f28de3f379009edb5de835c3e4868416a178157c96112ba02207
Jul 13 09:08:33.880406 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:33.880383    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb263c9c_ef1c_4e74_968b_f8822c77dffc.slice/crio-f7b0e4c2aa77b3c5bb7280efe8a78bfb6a999bafcf0547d7ae18a7066693f124 WatchSource:0}: Error finding container f7b0e4c2aa77b3c5bb7280efe8a78bfb6a999bafcf0547d7ae18a7066693f124: Status 404 returned error can't find the container with id f7b0e4c2aa77b3c5bb7280efe8a78bfb6a999bafcf0547d7ae18a7066693f124
Jul 13 09:08:33.881268 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:08:33.881233    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85e00737_0392_4971_b5bb_0eb2d8f14e5f.slice/crio-4c58ec42565d5f08a178564682b6aba887c814f3a0cee83f65e6b80a1d34bb17 WatchSource:0}: Error finding container 4c58ec42565d5f08a178564682b6aba887c814f3a0cee83f65e6b80a1d34bb17: Status 404 returned error can't find the container with id 4c58ec42565d5f08a178564682b6aba887c814f3a0cee83f65e6b80a1d34bb17
Jul 13 09:08:33.970548 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:33.970515    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs\") pod \"network-metrics-daemon-rrhxd\" (UID: \"caf4af40-8763-4401-8dd4-dfe646c17704\") " pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:08:33.970749 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:33.970722    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 09:08:33.970824 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:33.970807    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs podName:caf4af40-8763-4401-8dd4-dfe646c17704 nodeName:}" failed. No retries permitted until 2026-07-13 09:08:34.970786927 +0000 UTC m=+4.048664168 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs") pod "network-metrics-daemon-rrhxd" (UID: "caf4af40-8763-4401-8dd4-dfe646c17704") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 09:08:34.071845 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:34.071797    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96008549-14fd-453d-9236-a601e1010005-original-pull-secret\") pod \"global-pull-secret-syncer-hg679\" (UID: \"96008549-14fd-453d-9236-a601e1010005\") " pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:34.071988 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:34.071967    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 09:08:34.072045 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:34.072035    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96008549-14fd-453d-9236-a601e1010005-original-pull-secret podName:96008549-14fd-453d-9236-a601e1010005 nodeName:}" failed. No retries permitted until 2026-07-13 09:08:35.072019947 +0000 UTC m=+4.149897186 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96008549-14fd-453d-9236-a601e1010005-original-pull-secret") pod "global-pull-secret-syncer-hg679" (UID: "96008549-14fd-453d-9236-a601e1010005") : object "kube-system"/"original-pull-secret" not registered
Jul 13 09:08:34.173106 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:34.172975    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wbqx\" (UniqueName: \"kubernetes.io/projected/5765ed08-0739-46eb-a13a-2eb857df9c1b-kube-api-access-9wbqx\") pod \"network-check-target-h6lck\" (UID: \"5765ed08-0739-46eb-a13a-2eb857df9c1b\") " pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:08:34.173203 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:34.173131    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 09:08:34.173203 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:34.173153    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 09:08:34.173203 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:34.173163    2553 projected.go:196] Error preparing data for projected volume kube-api-access-9wbqx for pod openshift-network-diagnostics/network-check-target-h6lck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 09:08:34.173304 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:34.173212    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5765ed08-0739-46eb-a13a-2eb857df9c1b-kube-api-access-9wbqx podName:5765ed08-0739-46eb-a13a-2eb857df9c1b nodeName:}" failed. No retries permitted until 2026-07-13 09:08:35.173195319 +0000 UTC m=+4.251072554 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9wbqx" (UniqueName: "kubernetes.io/projected/5765ed08-0739-46eb-a13a-2eb857df9c1b-kube-api-access-9wbqx") pod "network-check-target-h6lck" (UID: "5765ed08-0739-46eb-a13a-2eb857df9c1b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 09:08:34.402605 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:34.402473    2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 09:03:33 +0000 UTC" deadline="2027-12-28 19:24:34.987570906 +0000 UTC"
Jul 13 09:08:34.402605 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:34.402510    2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12802h16m0.58506543s"
Jul 13 09:08:34.489001 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:34.488879    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-btlb4" event={"ID":"85e00737-0392-4971-b5bb-0eb2d8f14e5f","Type":"ContainerStarted","Data":"4c58ec42565d5f08a178564682b6aba887c814f3a0cee83f65e6b80a1d34bb17"}
Jul 13 09:08:34.491929 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:34.491843    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9qslx" event={"ID":"f477a535-0e7f-45e0-9889-b30d8e06abc0","Type":"ContainerStarted","Data":"0b248d18bd83eacf3eed41967f4cc80b7b68a3e88ef27d23d7dd063dbca5b074"}
Jul 13 09:08:34.495460 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:34.495383    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z22ks" event={"ID":"859c1cd1-b6d7-403c-adf9-8817dd781a5b","Type":"ContainerStarted","Data":"9733c443f7525bcd7402bfe45bb2b74db271ed4025283d2c27938f6eb4367d53"}
Jul 13 09:08:34.499780 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:34.499622    2553 generic.go:356] "Generic (PLEG): container finished" podID="01506cdc1a19a11ab65ea85b5f2cdc0b" containerID="9af92d086ae006328dcc974e64bc3b21b6b06b66265977b89a7982ff2af0edab" exitCode=0
Jul 13 09:08:34.499780 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:34.499710    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal" event={"ID":"01506cdc1a19a11ab65ea85b5f2cdc0b","Type":"ContainerDied","Data":"9af92d086ae006328dcc974e64bc3b21b6b06b66265977b89a7982ff2af0edab"}
Jul 13 09:08:34.507336 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:34.507258    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgpgz" event={"ID":"583af178-0c29-4df4-b251-ca8bf7db2a41","Type":"ContainerStarted","Data":"8eeb7e960735a46097e437b3968092f91329bb35074698d2831d9f9c068e210f"}
Jul 13 09:08:34.510823 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:34.510798    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h" event={"ID":"96e7b834-c90a-4808-958a-f56d9efa0213","Type":"ContainerStarted","Data":"8e6a97025660043e72ee48e881c2686b300cbfd46a7e74fb375b7b410ac73d59"}
Jul 13 09:08:34.517450 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:34.517420    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z7l2d" event={"ID":"f4844405-4513-4054-b96d-8fa9676d9b98","Type":"ContainerStarted","Data":"86c6efe9519e06d472178c6f04dd0e86de6637cc0a607bae17e5251b49c26cd4"}
Jul 13 09:08:34.521730 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:34.521684    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t558b" event={"ID":"db263c9c-ef1c-4e74-968b-f8822c77dffc","Type":"ContainerStarted","Data":"f7b0e4c2aa77b3c5bb7280efe8a78bfb6a999bafcf0547d7ae18a7066693f124"}
Jul 13 09:08:34.527656 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:34.527238    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9wv9z" event={"ID":"2b9ca74a-fe82-4fde-8dc1-6d639f222d44","Type":"ContainerStarted","Data":"ff57feb74b38f28de3f379009edb5de835c3e4868416a178157c96112ba02207"}
Jul 13 09:08:34.530152 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:34.530127    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nh9gf" event={"ID":"835e2516-31bc-47e3-b1e1-b212f41fd914","Type":"ContainerStarted","Data":"7e76acc210768496558f67bcac1f3961e12ae4c538cbc731be746179f2282bb7"}
Jul 13 09:08:34.981003 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:34.980304    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs\") pod \"network-metrics-daemon-rrhxd\" (UID: \"caf4af40-8763-4401-8dd4-dfe646c17704\") " pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:08:34.981003 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:34.980507    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 09:08:34.981003 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:34.980572    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs podName:caf4af40-8763-4401-8dd4-dfe646c17704 nodeName:}" failed. No retries permitted until 2026-07-13 09:08:36.980552091 +0000 UTC m=+6.058429330 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs") pod "network-metrics-daemon-rrhxd" (UID: "caf4af40-8763-4401-8dd4-dfe646c17704") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 09:08:35.080841 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:35.080799    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96008549-14fd-453d-9236-a601e1010005-original-pull-secret\") pod \"global-pull-secret-syncer-hg679\" (UID: \"96008549-14fd-453d-9236-a601e1010005\") " pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:35.081064 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:35.081043    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 09:08:35.081174 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:35.081130    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96008549-14fd-453d-9236-a601e1010005-original-pull-secret podName:96008549-14fd-453d-9236-a601e1010005 nodeName:}" failed. No retries permitted until 2026-07-13 09:08:37.081108964 +0000 UTC m=+6.158986199 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96008549-14fd-453d-9236-a601e1010005-original-pull-secret") pod "global-pull-secret-syncer-hg679" (UID: "96008549-14fd-453d-9236-a601e1010005") : object "kube-system"/"original-pull-secret" not registered
Jul 13 09:08:35.182532 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:35.182085    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wbqx\" (UniqueName: \"kubernetes.io/projected/5765ed08-0739-46eb-a13a-2eb857df9c1b-kube-api-access-9wbqx\") pod \"network-check-target-h6lck\" (UID: \"5765ed08-0739-46eb-a13a-2eb857df9c1b\") " pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:08:35.182532 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:35.182324    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 09:08:35.182532 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:35.182351    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 09:08:35.182532 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:35.182365    2553 projected.go:196] Error preparing data for projected volume kube-api-access-9wbqx for pod openshift-network-diagnostics/network-check-target-h6lck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 09:08:35.182532 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:35.182423    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5765ed08-0739-46eb-a13a-2eb857df9c1b-kube-api-access-9wbqx podName:5765ed08-0739-46eb-a13a-2eb857df9c1b nodeName:}" failed. No retries permitted until 2026-07-13 09:08:37.182404011 +0000 UTC m=+6.260281259 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9wbqx" (UniqueName: "kubernetes.io/projected/5765ed08-0739-46eb-a13a-2eb857df9c1b-kube-api-access-9wbqx") pod "network-check-target-h6lck" (UID: "5765ed08-0739-46eb-a13a-2eb857df9c1b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 09:08:35.402826 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:35.402680    2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 09:03:33 +0000 UTC" deadline="2028-02-25 10:25:01.346313551 +0000 UTC"
Jul 13 09:08:35.402826 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:35.402759    2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14209h16m25.943558357s"
Jul 13 09:08:35.479343 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:35.478468    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:35.479343 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:35.478600    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg679" podUID="96008549-14fd-453d-9236-a601e1010005"
Jul 13 09:08:35.479343 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:35.479038    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:08:35.479343 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:35.479134    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6lck" podUID="5765ed08-0739-46eb-a13a-2eb857df9c1b"
Jul 13 09:08:35.479343 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:35.479202    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:08:35.479343 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:35.479288    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rrhxd" podUID="caf4af40-8763-4401-8dd4-dfe646c17704"
Jul 13 09:08:35.540487 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:35.540451    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal" event={"ID":"01506cdc1a19a11ab65ea85b5f2cdc0b","Type":"ContainerStarted","Data":"6d4531ccc37b71346cbc730832fb880b7edb1a8360c247de0ad50efa5f307c90"}
Jul 13 09:08:36.998079 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:36.997989    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs\") pod \"network-metrics-daemon-rrhxd\" (UID: \"caf4af40-8763-4401-8dd4-dfe646c17704\") " pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:08:36.998515 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:36.998136    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 09:08:36.998515 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:36.998213    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs podName:caf4af40-8763-4401-8dd4-dfe646c17704 nodeName:}" failed. No retries permitted until 2026-07-13 09:08:40.998192097 +0000 UTC m=+10.076069339 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs") pod "network-metrics-daemon-rrhxd" (UID: "caf4af40-8763-4401-8dd4-dfe646c17704") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 09:08:37.099071 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:37.099032    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96008549-14fd-453d-9236-a601e1010005-original-pull-secret\") pod \"global-pull-secret-syncer-hg679\" (UID: \"96008549-14fd-453d-9236-a601e1010005\") " pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:37.099241 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:37.099170    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 09:08:37.099241 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:37.099239    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96008549-14fd-453d-9236-a601e1010005-original-pull-secret podName:96008549-14fd-453d-9236-a601e1010005 nodeName:}" failed. No retries permitted until 2026-07-13 09:08:41.099218796 +0000 UTC m=+10.177096037 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96008549-14fd-453d-9236-a601e1010005-original-pull-secret") pod "global-pull-secret-syncer-hg679" (UID: "96008549-14fd-453d-9236-a601e1010005") : object "kube-system"/"original-pull-secret" not registered
Jul 13 09:08:37.200385 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:37.200280    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wbqx\" (UniqueName: \"kubernetes.io/projected/5765ed08-0739-46eb-a13a-2eb857df9c1b-kube-api-access-9wbqx\") pod \"network-check-target-h6lck\" (UID: \"5765ed08-0739-46eb-a13a-2eb857df9c1b\") " pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:08:37.200578 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:37.200409    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 09:08:37.200578 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:37.200435    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 09:08:37.200578 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:37.200449    2553 projected.go:196] Error preparing data for projected volume kube-api-access-9wbqx for pod openshift-network-diagnostics/network-check-target-h6lck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 09:08:37.200578 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:37.200515    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5765ed08-0739-46eb-a13a-2eb857df9c1b-kube-api-access-9wbqx podName:5765ed08-0739-46eb-a13a-2eb857df9c1b nodeName:}" failed. No retries permitted until 2026-07-13 09:08:41.200493703 +0000 UTC m=+10.278370941 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9wbqx" (UniqueName: "kubernetes.io/projected/5765ed08-0739-46eb-a13a-2eb857df9c1b-kube-api-access-9wbqx") pod "network-check-target-h6lck" (UID: "5765ed08-0739-46eb-a13a-2eb857df9c1b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 09:08:37.475781 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:37.475702    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:37.475781 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:37.475744    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:08:37.476023 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:37.475847    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg679" podUID="96008549-14fd-453d-9236-a601e1010005"
Jul 13 09:08:37.476023 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:37.475894    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:08:37.476023 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:37.476007    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rrhxd" podUID="caf4af40-8763-4401-8dd4-dfe646c17704"
Jul 13 09:08:37.476177 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:37.476088    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6lck" podUID="5765ed08-0739-46eb-a13a-2eb857df9c1b"
Jul 13 09:08:39.476342 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:39.475985    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:39.476342 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:39.476162    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg679" podUID="96008549-14fd-453d-9236-a601e1010005"
Jul 13 09:08:39.476342 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:39.476173    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:08:39.476342 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:39.476214    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:08:39.476342 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:39.476254    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6lck" podUID="5765ed08-0739-46eb-a13a-2eb857df9c1b"
Jul 13 09:08:39.476995 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:39.476343    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rrhxd" podUID="caf4af40-8763-4401-8dd4-dfe646c17704"
Jul 13 09:08:41.034129 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:41.034095    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs\") pod \"network-metrics-daemon-rrhxd\" (UID: \"caf4af40-8763-4401-8dd4-dfe646c17704\") " pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:08:41.034577 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:41.034276    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 09:08:41.034577 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:41.034360    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs podName:caf4af40-8763-4401-8dd4-dfe646c17704 nodeName:}" failed. No retries permitted until 2026-07-13 09:08:49.034341136 +0000 UTC m=+18.112218373 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs") pod "network-metrics-daemon-rrhxd" (UID: "caf4af40-8763-4401-8dd4-dfe646c17704") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 09:08:41.134824 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:41.134716    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96008549-14fd-453d-9236-a601e1010005-original-pull-secret\") pod \"global-pull-secret-syncer-hg679\" (UID: \"96008549-14fd-453d-9236-a601e1010005\") " pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:41.135039 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:41.134897    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 09:08:41.135039 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:41.134961    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96008549-14fd-453d-9236-a601e1010005-original-pull-secret podName:96008549-14fd-453d-9236-a601e1010005 nodeName:}" failed. No retries permitted until 2026-07-13 09:08:49.134943103 +0000 UTC m=+18.212820355 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96008549-14fd-453d-9236-a601e1010005-original-pull-secret") pod "global-pull-secret-syncer-hg679" (UID: "96008549-14fd-453d-9236-a601e1010005") : object "kube-system"/"original-pull-secret" not registered
Jul 13 09:08:41.236029 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:41.235963    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wbqx\" (UniqueName: \"kubernetes.io/projected/5765ed08-0739-46eb-a13a-2eb857df9c1b-kube-api-access-9wbqx\") pod \"network-check-target-h6lck\" (UID: \"5765ed08-0739-46eb-a13a-2eb857df9c1b\") " pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:08:41.236422 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:41.236177    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 09:08:41.236422 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:41.236200    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 09:08:41.236422 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:41.236213    2553 projected.go:196] Error preparing data for projected volume kube-api-access-9wbqx for pod openshift-network-diagnostics/network-check-target-h6lck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 09:08:41.236422 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:41.236277    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5765ed08-0739-46eb-a13a-2eb857df9c1b-kube-api-access-9wbqx podName:5765ed08-0739-46eb-a13a-2eb857df9c1b nodeName:}" failed. No retries permitted until 2026-07-13 09:08:49.236259429 +0000 UTC m=+18.314136668 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9wbqx" (UniqueName: "kubernetes.io/projected/5765ed08-0739-46eb-a13a-2eb857df9c1b-kube-api-access-9wbqx") pod "network-check-target-h6lck" (UID: "5765ed08-0739-46eb-a13a-2eb857df9c1b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 09:08:41.476934 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:41.476848    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:41.477088 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:41.476969    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg679" podUID="96008549-14fd-453d-9236-a601e1010005"
Jul 13 09:08:41.477088 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:41.477009    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:08:41.477088 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:41.477081    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6lck" podUID="5765ed08-0739-46eb-a13a-2eb857df9c1b"
Jul 13 09:08:41.477268 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:41.477098    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:08:41.477268 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:41.477180    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rrhxd" podUID="caf4af40-8763-4401-8dd4-dfe646c17704"
Jul 13 09:08:43.476788 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:43.475915    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:43.476788 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:43.476053    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg679" podUID="96008549-14fd-453d-9236-a601e1010005"
Jul 13 09:08:43.476788 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:43.476420    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:08:43.476788 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:43.476508    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6lck" podUID="5765ed08-0739-46eb-a13a-2eb857df9c1b"
Jul 13 09:08:43.476788 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:43.476569    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:08:43.476788 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:43.476650    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rrhxd" podUID="caf4af40-8763-4401-8dd4-dfe646c17704"
Jul 13 09:08:43.568598 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:43.568541    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9wv9z" event={"ID":"2b9ca74a-fe82-4fde-8dc1-6d639f222d44","Type":"ContainerStarted","Data":"3fc26bf6abf3a2d290f04db8b9d0cb34e482925c14993bdafe88eda567dd5c9b"}
Jul 13 09:08:43.577186 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:43.577076    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.ec2.internal" event={"ID":"3faaf0080471f3cd3415287075e9ebbd","Type":"ContainerStarted","Data":"45da77ef4cb8ec1c9fad42288e3770dfd185e172f7420b04674c7a1ac6459e43"}
Jul 13 09:08:43.589204 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:43.589093    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal" podStartSLOduration=10.58907179 podStartE2EDuration="10.58907179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 09:08:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:08:35.561480889 +0000 UTC m=+4.639358151" watchObservedRunningTime="2026-07-13 09:08:43.58907179 +0000 UTC m=+12.666949047"
Jul 13 09:08:43.603810 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:43.603218    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.ec2.internal" podStartSLOduration=10.603194096 podStartE2EDuration="10.603194096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 09:08:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:08:43.603035385 +0000 UTC m=+12.680912641" watchObservedRunningTime="2026-07-13 09:08:43.603194096 +0000 UTC m=+12.681071354"
Jul 13 09:08:43.604828 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:43.604074    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9wv9z" podStartSLOduration=2.06182787 podStartE2EDuration="11.604055107s" totalImagesPullingTime="9.542227237s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 09:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:08:43.587066827 +0000 UTC m=+12.664944123" watchObservedRunningTime="2026-07-13 09:08:43.604055107 +0000 UTC m=+12.681932364"
Jul 13 09:08:44.585785 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:44.584757    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nh9gf" event={"ID":"835e2516-31bc-47e3-b1e1-b212f41fd914","Type":"ContainerStarted","Data":"e7294f774709c1052789e5de1f764bb176fd6b10ebec6a9752a7a38d95eb0d92"}
Jul 13 09:08:44.588750 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:44.588720    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-btlb4" event={"ID":"85e00737-0392-4971-b5bb-0eb2d8f14e5f","Type":"ContainerStarted","Data":"26b25e7e4aec5eebcd21c612b06ec85b90653e6e015352846297f5643c79b2dd"}
Jul 13 09:08:44.592196 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:44.592171    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9qslx" event={"ID":"f477a535-0e7f-45e0-9889-b30d8e06abc0","Type":"ContainerStarted","Data":"f1e3a03504c08111aef2ee6a781b323f36dcaa3caf73246e738a7a8c32abf789"}
Jul 13 09:08:44.594316 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:44.594290    2553 generic.go:356] "Generic (PLEG): container finished" podID="583af178-0c29-4df4-b251-ca8bf7db2a41" containerID="6704c9c958f9f60ae58ace516099935d59d8cd605de965d5601a6292205d9bcc" exitCode=0
Jul 13 09:08:44.594439 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:44.594372    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgpgz" event={"ID":"583af178-0c29-4df4-b251-ca8bf7db2a41","Type":"ContainerDied","Data":"6704c9c958f9f60ae58ace516099935d59d8cd605de965d5601a6292205d9bcc"}
Jul 13 09:08:44.598157 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:44.597746    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h" event={"ID":"96e7b834-c90a-4808-958a-f56d9efa0213","Type":"ContainerStarted","Data":"f2ca9bc9306de20c857d316bac575086e5ba2ab6358771717975e9a6cf7d01e8"}
Jul 13 09:08:44.626929 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:44.626876    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nh9gf" podStartSLOduration=3.1289579610000002 podStartE2EDuration="12.626857884s" totalImagesPullingTime="9.497899923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:08:44.600710679 +0000 UTC m=+13.678587959" watchObservedRunningTime="2026-07-13 09:08:44.626857884 +0000 UTC m=+13.704735139"
Jul 13 09:08:44.639645 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:44.639603    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9qslx" podStartSLOduration=3.126886778 podStartE2EDuration="12.639591241s" totalImagesPullingTime="9.512704463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 09:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:08:44.639475757 +0000 UTC m=+13.717353038" watchObservedRunningTime="2026-07-13 09:08:44.639591241 +0000 UTC m=+13.717468495"
Jul 13 09:08:44.657788 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:44.657754    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-btlb4" podStartSLOduration=3.153306406 podStartE2EDuration="12.657742297s" totalImagesPullingTime="9.504435891s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 09:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:08:44.657341404 +0000 UTC m=+13.735218660" watchObservedRunningTime="2026-07-13 09:08:44.657742297 +0000 UTC m=+13.735619554"
Jul 13 09:08:45.476237 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:45.476156    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:45.476387 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:45.476159    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:08:45.476387 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:45.476275    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:08:45.476387 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:45.476277    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg679" podUID="96008549-14fd-453d-9236-a601e1010005"
Jul 13 09:08:45.476387 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:45.476366    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6lck" podUID="5765ed08-0739-46eb-a13a-2eb857df9c1b"
Jul 13 09:08:45.476576 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:45.476453    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rrhxd" podUID="caf4af40-8763-4401-8dd4-dfe646c17704"
Jul 13 09:08:45.600612 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:45.600557    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z7l2d" event={"ID":"f4844405-4513-4054-b96d-8fa9676d9b98","Type":"ContainerStarted","Data":"ba0a837373f72bf1f631bc5b68ab5a6dd10044d90182bf32efb66b2b2e909846"}
Jul 13 09:08:45.615990 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:45.615943    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z7l2d" podStartSLOduration=4.104848413 podStartE2EDuration="13.615923141s" totalImagesPullingTime="9.511074728s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 09:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:08:45.615801201 +0000 UTC m=+14.693678483" watchObservedRunningTime="2026-07-13 09:08:45.615923141 +0000 UTC m=+14.693800396"
Jul 13 09:08:47.420372 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:47.420340    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nh9gf"
Jul 13 09:08:47.421000 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:47.420983    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nh9gf"
Jul 13 09:08:47.475720 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:47.475696    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:08:47.475892 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:47.475733    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:08:47.475892 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:47.475784    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:47.475892 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:47.475797    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6lck" podUID="5765ed08-0739-46eb-a13a-2eb857df9c1b"
Jul 13 09:08:47.476023 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:47.475891    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg679" podUID="96008549-14fd-453d-9236-a601e1010005"
Jul 13 09:08:47.476023 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:47.475994    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rrhxd" podUID="caf4af40-8763-4401-8dd4-dfe646c17704"
Jul 13 09:08:47.608468 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:47.608434    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nh9gf"
Jul 13 09:08:47.609027 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:47.609002    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nh9gf"
Jul 13 09:08:49.099866 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:49.099833    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs\") pod \"network-metrics-daemon-rrhxd\" (UID: \"caf4af40-8763-4401-8dd4-dfe646c17704\") " pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:08:49.100479 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:49.099984    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 09:08:49.100479 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:49.100056    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs podName:caf4af40-8763-4401-8dd4-dfe646c17704 nodeName:}" failed. No retries permitted until 2026-07-13 09:09:05.100036124 +0000 UTC m=+34.177913357 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs") pod "network-metrics-daemon-rrhxd" (UID: "caf4af40-8763-4401-8dd4-dfe646c17704") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 09:08:49.200450 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:49.200412    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96008549-14fd-453d-9236-a601e1010005-original-pull-secret\") pod \"global-pull-secret-syncer-hg679\" (UID: \"96008549-14fd-453d-9236-a601e1010005\") " pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:49.200595 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:49.200543    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 09:08:49.200595 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:49.200594    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96008549-14fd-453d-9236-a601e1010005-original-pull-secret podName:96008549-14fd-453d-9236-a601e1010005 nodeName:}" failed. No retries permitted until 2026-07-13 09:09:05.200581862 +0000 UTC m=+34.278459094 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96008549-14fd-453d-9236-a601e1010005-original-pull-secret") pod "global-pull-secret-syncer-hg679" (UID: "96008549-14fd-453d-9236-a601e1010005") : object "kube-system"/"original-pull-secret" not registered
Jul 13 09:08:49.301382 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:49.301357    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wbqx\" (UniqueName: \"kubernetes.io/projected/5765ed08-0739-46eb-a13a-2eb857df9c1b-kube-api-access-9wbqx\") pod \"network-check-target-h6lck\" (UID: \"5765ed08-0739-46eb-a13a-2eb857df9c1b\") " pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:08:49.301547 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:49.301519    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 09:08:49.301547 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:49.301542    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 09:08:49.301676 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:49.301555    2553 projected.go:196] Error preparing data for projected volume kube-api-access-9wbqx for pod openshift-network-diagnostics/network-check-target-h6lck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 09:08:49.301676 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:49.301618    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5765ed08-0739-46eb-a13a-2eb857df9c1b-kube-api-access-9wbqx podName:5765ed08-0739-46eb-a13a-2eb857df9c1b nodeName:}" failed. No retries permitted until 2026-07-13 09:09:05.301599398 +0000 UTC m=+34.379476642 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9wbqx" (UniqueName: "kubernetes.io/projected/5765ed08-0739-46eb-a13a-2eb857df9c1b-kube-api-access-9wbqx") pod "network-check-target-h6lck" (UID: "5765ed08-0739-46eb-a13a-2eb857df9c1b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 09:08:49.476375 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:49.476289    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:49.476517 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:49.476289    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:08:49.476517 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:49.476413    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg679" podUID="96008549-14fd-453d-9236-a601e1010005"
Jul 13 09:08:49.476632 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:49.476522    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6lck" podUID="5765ed08-0739-46eb-a13a-2eb857df9c1b"
Jul 13 09:08:49.476632 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:49.476289    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:08:49.476741 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:49.476656    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rrhxd" podUID="caf4af40-8763-4401-8dd4-dfe646c17704"
Jul 13 09:08:51.477053 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:51.476809    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:51.477053 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:51.476920    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:08:51.477053 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:51.476947    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg679" podUID="96008549-14fd-453d-9236-a601e1010005"
Jul 13 09:08:51.477053 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:51.477024    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:08:51.477848 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:51.477114    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6lck" podUID="5765ed08-0739-46eb-a13a-2eb857df9c1b"
Jul 13 09:08:51.477848 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:51.477018    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rrhxd" podUID="caf4af40-8763-4401-8dd4-dfe646c17704"
Jul 13 09:08:53.476335 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:53.476300    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:53.476826 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:53.476300    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:08:53.476826 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:53.476425    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg679" podUID="96008549-14fd-453d-9236-a601e1010005"
Jul 13 09:08:53.476826 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:53.476435    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:08:53.476826 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:53.476538    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6lck" podUID="5765ed08-0739-46eb-a13a-2eb857df9c1b"
Jul 13 09:08:53.476826 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:53.476657    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rrhxd" podUID="caf4af40-8763-4401-8dd4-dfe646c17704"
Jul 13 09:08:55.476233 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:55.476201    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:55.476713 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:55.476237    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:08:55.476713 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:55.476200    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:08:55.476713 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:55.476334    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg679" podUID="96008549-14fd-453d-9236-a601e1010005"
Jul 13 09:08:55.476713 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:55.476456    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rrhxd" podUID="caf4af40-8763-4401-8dd4-dfe646c17704"
Jul 13 09:08:55.476713 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:55.476527    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6lck" podUID="5765ed08-0739-46eb-a13a-2eb857df9c1b"
Jul 13 09:08:55.878562 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:55.878402    2553 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 13 09:08:56.413975 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:56.413837    2553 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T09:08:55.878526374Z","UUID":"1b68d2ae-a8d2-4817-aeea-7e48ffec4313","Handler":null,"Name":"","Endpoint":""}
Jul 13 09:08:56.415412 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:56.415382    2553 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 13 09:08:56.415521 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:56.415423    2553 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 13 09:08:56.626312 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:56.626288    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t558b_db263c9c-ef1c-4e74-968b-f8822c77dffc/ovn-acl-logging/0.log"
Jul 13 09:08:56.626754 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:56.626640    2553 generic.go:356] "Generic (PLEG): container finished" podID="db263c9c-ef1c-4e74-968b-f8822c77dffc" containerID="140a53a2105573481d972ac92db7990141fd3e4ca4a9de441a968928f706c5ab" exitCode=1
Jul 13 09:08:56.626754 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:56.626746    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t558b" event={"ID":"db263c9c-ef1c-4e74-968b-f8822c77dffc","Type":"ContainerStarted","Data":"2133a49866772c7c86600f745f58cfd1026251673f4665a365572d3a995db5c4"}
Jul 13 09:08:56.626858 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:56.626841    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t558b" event={"ID":"db263c9c-ef1c-4e74-968b-f8822c77dffc","Type":"ContainerStarted","Data":"88a88ba1ad037ce6f5802a964901f6c247de82f704c33b58671da2377de7018f"}
Jul 13 09:08:56.626904 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:56.626896    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t558b" event={"ID":"db263c9c-ef1c-4e74-968b-f8822c77dffc","Type":"ContainerStarted","Data":"5dbf1b6647e606f6b4af6c7973ddddde19f15cbab9b039a16a046cb9368a5e99"}
Jul 13 09:08:56.626947 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:56.626932    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t558b" event={"ID":"db263c9c-ef1c-4e74-968b-f8822c77dffc","Type":"ContainerStarted","Data":"e6b60c5c868d69096f50d74b6044b882f948d19479d45e9bd5b1a1778c4a9d36"}
Jul 13 09:08:56.626994 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:56.626962    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t558b" event={"ID":"db263c9c-ef1c-4e74-968b-f8822c77dffc","Type":"ContainerDied","Data":"140a53a2105573481d972ac92db7990141fd3e4ca4a9de441a968928f706c5ab"}
Jul 13 09:08:56.627035 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:56.626999    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t558b" event={"ID":"db263c9c-ef1c-4e74-968b-f8822c77dffc","Type":"ContainerStarted","Data":"a0f2c5cc67215f1654654b78d76fc41d7f70d100492b5ff1f98b706961eec8d4"}
Jul 13 09:08:56.628170 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:56.628138    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z22ks" event={"ID":"859c1cd1-b6d7-403c-adf9-8817dd781a5b","Type":"ContainerStarted","Data":"28f156a1c253b31ae8a08ba1edc8e0f173044068d37e670225780f4ad0db9d69"}
Jul 13 09:08:56.629999 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:56.629977    2553 generic.go:356] "Generic (PLEG): container finished" podID="583af178-0c29-4df4-b251-ca8bf7db2a41" containerID="cc4b8094518ae13df9e3904b7a357a274cc6015af7a01c4c2c105bd715b21f7b" exitCode=0
Jul 13 09:08:56.630122 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:56.630054    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgpgz" event={"ID":"583af178-0c29-4df4-b251-ca8bf7db2a41","Type":"ContainerDied","Data":"cc4b8094518ae13df9e3904b7a357a274cc6015af7a01c4c2c105bd715b21f7b"}
Jul 13 09:08:56.631951 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:56.631920    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h" event={"ID":"96e7b834-c90a-4808-958a-f56d9efa0213","Type":"ContainerStarted","Data":"a0c51586816199545904eff89a8fe8bc3884fb773dc55be04744c26422c5d43e"}
Jul 13 09:08:56.648441 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:56.648393    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z22ks" podStartSLOduration=4.252354474 podStartE2EDuration="24.648377629s" totalImagesPullingTime="20.396023155s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 09:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:08:56.648247302 +0000 UTC m=+25.726124556" watchObservedRunningTime="2026-07-13 09:08:56.648377629 +0000 UTC m=+25.726254885"
Jul 13 09:08:57.475639 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:57.475562    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:57.475853 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:57.475571    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:08:57.475853 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:57.475704    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg679" podUID="96008549-14fd-453d-9236-a601e1010005"
Jul 13 09:08:57.475853 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:57.475729    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:08:57.475853 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:57.475825    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rrhxd" podUID="caf4af40-8763-4401-8dd4-dfe646c17704"
Jul 13 09:08:57.476062 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:57.475909    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6lck" podUID="5765ed08-0739-46eb-a13a-2eb857df9c1b"
Jul 13 09:08:57.635729 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:57.635680    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h" event={"ID":"96e7b834-c90a-4808-958a-f56d9efa0213","Type":"ContainerStarted","Data":"b1b0099352a72290f0ae7739b8149015f6b30d6932bf4c78031c051f7a981513"}
Jul 13 09:08:57.654086 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:57.654022    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l455h" podStartSLOduration=4.405270583 podStartE2EDuration="25.65400981s" totalImagesPullingTime="21.248739227s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 09:08:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:08:57.653723424 +0000 UTC m=+26.731600695" watchObservedRunningTime="2026-07-13 09:08:57.65400981 +0000 UTC m=+26.731887088"
Jul 13 09:08:58.638937 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:58.638857    2553 generic.go:356] "Generic (PLEG): container finished" podID="583af178-0c29-4df4-b251-ca8bf7db2a41" containerID="fbb13205c693d2887fa4c41977642fa09cd7aac6bdd1ab53c2a5a883c5ad4c0b" exitCode=0
Jul 13 09:08:58.639335 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:58.638932    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgpgz" event={"ID":"583af178-0c29-4df4-b251-ca8bf7db2a41","Type":"ContainerDied","Data":"fbb13205c693d2887fa4c41977642fa09cd7aac6bdd1ab53c2a5a883c5ad4c0b"}
Jul 13 09:08:58.641911 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:58.641894    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t558b_db263c9c-ef1c-4e74-968b-f8822c77dffc/ovn-acl-logging/0.log"
Jul 13 09:08:58.642211 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:58.642191    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t558b" event={"ID":"db263c9c-ef1c-4e74-968b-f8822c77dffc","Type":"ContainerStarted","Data":"4b3c7fd89782df290646dfb1d39e942552c5fca2474023c974110250edccf09b"}
Jul 13 09:08:59.475711 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:59.475628    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:08:59.475841 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:59.475638    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:08:59.475841 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:59.475749    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg679" podUID="96008549-14fd-453d-9236-a601e1010005"
Jul 13 09:08:59.475841 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:08:59.475768    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:08:59.475933 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:59.475851    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6lck" podUID="5765ed08-0739-46eb-a13a-2eb857df9c1b"
Jul 13 09:08:59.475933 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:08:59.475927    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rrhxd" podUID="caf4af40-8763-4401-8dd4-dfe646c17704"
Jul 13 09:09:00.649466 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:00.649301    2553 generic.go:356] "Generic (PLEG): container finished" podID="583af178-0c29-4df4-b251-ca8bf7db2a41" containerID="769d6d2ffc9563bc2e8efbdce873fb46808c7c1064b89ab54a79f2e53d6cf626" exitCode=0
Jul 13 09:09:00.650111 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:00.649374    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgpgz" event={"ID":"583af178-0c29-4df4-b251-ca8bf7db2a41","Type":"ContainerDied","Data":"769d6d2ffc9563bc2e8efbdce873fb46808c7c1064b89ab54a79f2e53d6cf626"}
Jul 13 09:09:00.653397 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:00.653372    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t558b_db263c9c-ef1c-4e74-968b-f8822c77dffc/ovn-acl-logging/0.log"
Jul 13 09:09:00.653827 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:00.653809    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t558b" event={"ID":"db263c9c-ef1c-4e74-968b-f8822c77dffc","Type":"ContainerStarted","Data":"3d15226c29fcc17b24b29b31e396cdc0453e4541d1db88e6ba4cc3bb813e0964"}
Jul 13 09:09:00.654052 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:00.654039    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:09:00.654122 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:00.654109    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:09:00.654216 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:00.654202    2553 scope.go:117] "RemoveContainer" containerID="140a53a2105573481d972ac92db7990141fd3e4ca4a9de441a968928f706c5ab"
Jul 13 09:09:00.668596 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:00.668580    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:09:01.476761 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:01.476730    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:09:01.476920 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:01.476818    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg679" podUID="96008549-14fd-453d-9236-a601e1010005"
Jul 13 09:09:01.476920 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:01.476833    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:09:01.476920 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:01.476861    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:09:01.477110 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:01.476926    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rrhxd" podUID="caf4af40-8763-4401-8dd4-dfe646c17704"
Jul 13 09:09:01.477110 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:01.476979    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6lck" podUID="5765ed08-0739-46eb-a13a-2eb857df9c1b"
Jul 13 09:09:01.659229 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:01.659204    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t558b_db263c9c-ef1c-4e74-968b-f8822c77dffc/ovn-acl-logging/0.log"
Jul 13 09:09:01.659609 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:01.659501    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t558b" event={"ID":"db263c9c-ef1c-4e74-968b-f8822c77dffc","Type":"ContainerStarted","Data":"fff03fd5c529585ce66a92fffba48d91b179d15966e736f315962539b91c66e7"}
Jul 13 09:09:01.659756 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:01.659731    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:09:01.676681 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:01.676659    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:09:01.687549 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:01.687509    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t558b" podStartSLOduration=7.803530901 podStartE2EDuration="29.68749819s" totalImagesPullingTime="21.883967289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 09:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:09:01.687230521 +0000 UTC m=+30.765107775" watchObservedRunningTime="2026-07-13 09:09:01.68749819 +0000 UTC m=+30.765375445"
Jul 13 09:09:02.428999 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:02.428971    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hg679"]
Jul 13 09:09:02.429164 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:02.429087    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:09:02.429223 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:02.429190    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg679" podUID="96008549-14fd-453d-9236-a601e1010005"
Jul 13 09:09:02.431331 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:02.431304    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rrhxd"]
Jul 13 09:09:02.431464 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:02.431417    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:09:02.431527 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:02.431513    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rrhxd" podUID="caf4af40-8763-4401-8dd4-dfe646c17704"
Jul 13 09:09:02.443704 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:02.443662    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h6lck"]
Jul 13 09:09:02.443819 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:02.443763    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:09:02.443883 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:02.443869    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6lck" podUID="5765ed08-0739-46eb-a13a-2eb857df9c1b"
Jul 13 09:09:04.476446 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:04.476413    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:09:04.476959 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:04.476456    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:09:04.476959 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:04.476464    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:09:04.476959 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:04.476562    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rrhxd" podUID="caf4af40-8763-4401-8dd4-dfe646c17704"
Jul 13 09:09:04.476959 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:04.476708    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg679" podUID="96008549-14fd-453d-9236-a601e1010005"
Jul 13 09:09:04.476959 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:04.476796    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6lck" podUID="5765ed08-0739-46eb-a13a-2eb857df9c1b"
Jul 13 09:09:05.121558 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:05.121527    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs\") pod \"network-metrics-daemon-rrhxd\" (UID: \"caf4af40-8763-4401-8dd4-dfe646c17704\") " pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:09:05.121784 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:05.121747    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 09:09:05.121852 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:05.121817    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs podName:caf4af40-8763-4401-8dd4-dfe646c17704 nodeName:}" failed. No retries permitted until 2026-07-13 09:09:37.121798105 +0000 UTC m=+66.199675338 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs") pod "network-metrics-daemon-rrhxd" (UID: "caf4af40-8763-4401-8dd4-dfe646c17704") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 09:09:05.222143 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:05.222095    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96008549-14fd-453d-9236-a601e1010005-original-pull-secret\") pod \"global-pull-secret-syncer-hg679\" (UID: \"96008549-14fd-453d-9236-a601e1010005\") " pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:09:05.222290 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:05.222248    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 09:09:05.222347 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:05.222325    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96008549-14fd-453d-9236-a601e1010005-original-pull-secret podName:96008549-14fd-453d-9236-a601e1010005 nodeName:}" failed. No retries permitted until 2026-07-13 09:09:37.222304753 +0000 UTC m=+66.300181994 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96008549-14fd-453d-9236-a601e1010005-original-pull-secret") pod "global-pull-secret-syncer-hg679" (UID: "96008549-14fd-453d-9236-a601e1010005") : object "kube-system"/"original-pull-secret" not registered
Jul 13 09:09:05.323040 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:05.323005    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wbqx\" (UniqueName: \"kubernetes.io/projected/5765ed08-0739-46eb-a13a-2eb857df9c1b-kube-api-access-9wbqx\") pod \"network-check-target-h6lck\" (UID: \"5765ed08-0739-46eb-a13a-2eb857df9c1b\") " pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:09:05.323189 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:05.323134    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 09:09:05.323189 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:05.323148    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 09:09:05.323189 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:05.323157    2553 projected.go:196] Error preparing data for projected volume kube-api-access-9wbqx for pod openshift-network-diagnostics/network-check-target-h6lck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 09:09:05.323308 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:05.323204    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5765ed08-0739-46eb-a13a-2eb857df9c1b-kube-api-access-9wbqx podName:5765ed08-0739-46eb-a13a-2eb857df9c1b nodeName:}" failed. No retries permitted until 2026-07-13 09:09:37.32319059 +0000 UTC m=+66.401067824 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9wbqx" (UniqueName: "kubernetes.io/projected/5765ed08-0739-46eb-a13a-2eb857df9c1b-kube-api-access-9wbqx") pod "network-check-target-h6lck" (UID: "5765ed08-0739-46eb-a13a-2eb857df9c1b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 09:09:06.476176 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:06.475969    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:09:06.476641 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:06.475982    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:09:06.476641 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:06.476206    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rrhxd" podUID="caf4af40-8763-4401-8dd4-dfe646c17704"
Jul 13 09:09:06.476641 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:06.476304    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg679" podUID="96008549-14fd-453d-9236-a601e1010005"
Jul 13 09:09:06.476641 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:06.476020    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:09:06.476641 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:06.476385    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6lck" podUID="5765ed08-0739-46eb-a13a-2eb857df9c1b"
Jul 13 09:09:06.673025 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:06.672997    2553 generic.go:356] "Generic (PLEG): container finished" podID="583af178-0c29-4df4-b251-ca8bf7db2a41" containerID="ba6192cc742935308e93cd4ec9f0dc374d9b8429e97c7a9bd63753ab457ce259" exitCode=0
Jul 13 09:09:06.673146 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:06.673042    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgpgz" event={"ID":"583af178-0c29-4df4-b251-ca8bf7db2a41","Type":"ContainerDied","Data":"ba6192cc742935308e93cd4ec9f0dc374d9b8429e97c7a9bd63753ab457ce259"}
Jul 13 09:09:07.678004 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:07.677973    2553 generic.go:356] "Generic (PLEG): container finished" podID="583af178-0c29-4df4-b251-ca8bf7db2a41" containerID="c2b477127f32c5c64d8916c2123763f444002dc3af5822a683f90490e42de9e0" exitCode=0
Jul 13 09:09:07.678532 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:07.678027    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgpgz" event={"ID":"583af178-0c29-4df4-b251-ca8bf7db2a41","Type":"ContainerDied","Data":"c2b477127f32c5c64d8916c2123763f444002dc3af5822a683f90490e42de9e0"}
Jul 13 09:09:08.475471 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.475390    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:09:08.475471 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.475412    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:09:08.475675 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.475391    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:09:08.475675 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:08.475496    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg679" podUID="96008549-14fd-453d-9236-a601e1010005"
Jul 13 09:09:08.475675 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:08.475550    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6lck" podUID="5765ed08-0739-46eb-a13a-2eb857df9c1b"
Jul 13 09:09:08.475675 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:08.475624    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rrhxd" podUID="caf4af40-8763-4401-8dd4-dfe646c17704"
Jul 13 09:09:08.678231 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.678203    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeReady"
Jul 13 09:09:08.678837 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.678328    2553 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 13 09:09:08.682784 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.682758    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgpgz" event={"ID":"583af178-0c29-4df4-b251-ca8bf7db2a41","Type":"ContainerStarted","Data":"9807c87bcc9d65038d3381c974874e3aaf71b8e87f4e9f68c4c292027024c75f"}
Jul 13 09:09:08.708336 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.708287    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lgpgz" podStartSLOduration=8.119531016 podStartE2EDuration="36.708273336s" totalImagesPullingTime="28.58874232s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 09:08:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:09:08.706900856 +0000 UTC m=+37.784778112" watchObservedRunningTime="2026-07-13 09:09:08.708273336 +0000 UTC m=+37.786150592"
Jul 13 09:09:08.711837 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.711817    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-hfv8k"]
Jul 13 09:09:08.734400 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.734344    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6479ff8fc8-x4bkn"]
Jul 13 09:09:08.734496 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.734459    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-hfv8k"
Jul 13 09:09:08.738802 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.738781    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 13 09:09:08.738905 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.738781    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 13 09:09:08.739125 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.739111    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zh9fs\""
Jul 13 09:09:08.757961 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.757942    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-hfv8k"]
Jul 13 09:09:08.758072 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.757968    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8wp8c"]
Jul 13 09:09:08.758072 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.758059    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:08.761032 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.761010    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 13 09:09:08.761465 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.761452    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 13 09:09:08.761943 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.761914    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qppg4\""
Jul 13 09:09:08.763379 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.763356    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 13 09:09:08.780046 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.779873    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 13 09:09:08.780151 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.780050    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vrnb8"]
Jul 13 09:09:08.780327 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.780308    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8wp8c"
Jul 13 09:09:08.782964 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.782949    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 13 09:09:08.783246 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.783229    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 13 09:09:08.783517 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.783501    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 13 09:09:08.783580 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.783544    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-b2l9h\""
Jul 13 09:09:08.803261 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.803244    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6479ff8fc8-x4bkn"]
Jul 13 09:09:08.803345 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.803271    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vrnb8"]
Jul 13 09:09:08.803345 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.803287    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8wp8c"]
Jul 13 09:09:08.803413 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.803349    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:09:08.805957 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.805943    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jbvrj\""
Jul 13 09:09:08.806049 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.805945    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 13 09:09:08.806942 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.806930    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 13 09:09:08.851863 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.851838    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-hfv8k\" (UID: \"6485b81d-8dac-4cab-8f1a-653e0116ba01\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hfv8k"
Jul 13 09:09:08.851973 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.851956    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6485b81d-8dac-4cab-8f1a-653e0116ba01-nginx-conf\") pod \"networking-console-plugin-6cf856758c-hfv8k\" (UID: \"6485b81d-8dac-4cab-8f1a-653e0116ba01\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hfv8k"
Jul 13 09:09:08.953068 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.953043    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6485b81d-8dac-4cab-8f1a-653e0116ba01-nginx-conf\") pod \"networking-console-plugin-6cf856758c-hfv8k\" (UID: \"6485b81d-8dac-4cab-8f1a-653e0116ba01\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hfv8k"
Jul 13 09:09:08.953160 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.953078    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-trusted-ca\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:08.953160 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.953108    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-hfv8k\" (UID: \"6485b81d-8dac-4cab-8f1a-653e0116ba01\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hfv8k"
Jul 13 09:09:08.953160 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.953136    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-ca-trust-extracted\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:08.953263 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.953159    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-certificates\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:08.953263 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.953204    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-installation-pull-secrets\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:08.953263 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:08.953207    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 09:09:08.953263 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.953245    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e28a544-d35a-4036-bab4-87432d8949f9-cert\") pod \"ingress-canary-8wp8c\" (UID: \"5e28a544-d35a-4036-bab4-87432d8949f9\") " pod="openshift-ingress-canary/ingress-canary-8wp8c"
Jul 13 09:09:08.953386 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:08.953277    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert podName:6485b81d-8dac-4cab-8f1a-653e0116ba01 nodeName:}" failed. No retries permitted until 2026-07-13 09:09:09.453257541 +0000 UTC m=+38.531134774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-hfv8k" (UID: "6485b81d-8dac-4cab-8f1a-653e0116ba01") : secret "networking-console-plugin-cert" not found
Jul 13 09:09:08.953386 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.953308    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls\") pod \"dns-default-vrnb8\" (UID: \"382f0622-3acb-41c7-a231-3b688b8c212e\") " pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:09:08.953386 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.953340    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-bound-sa-token\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:08.953480 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.953392    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-image-registry-private-configuration\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:08.953480 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.953429    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mx8r\" (UniqueName: \"kubernetes.io/projected/5e28a544-d35a-4036-bab4-87432d8949f9-kube-api-access-5mx8r\") pod \"ingress-canary-8wp8c\" (UID: \"5e28a544-d35a-4036-bab4-87432d8949f9\") " pod="openshift-ingress-canary/ingress-canary-8wp8c"
Jul 13 09:09:08.953480 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.953456    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/382f0622-3acb-41c7-a231-3b688b8c212e-tmp-dir\") pod \"dns-default-vrnb8\" (UID: \"382f0622-3acb-41c7-a231-3b688b8c212e\") " pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:09:08.953480 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.953478    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:08.953604 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.953496    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkbcm\" (UniqueName: \"kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-kube-api-access-wkbcm\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:08.953604 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.953519    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/382f0622-3acb-41c7-a231-3b688b8c212e-config-volume\") pod \"dns-default-vrnb8\" (UID: \"382f0622-3acb-41c7-a231-3b688b8c212e\") " pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:09:08.953604 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.953551    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5gk6\" (UniqueName: \"kubernetes.io/projected/382f0622-3acb-41c7-a231-3b688b8c212e-kube-api-access-v5gk6\") pod \"dns-default-vrnb8\" (UID: \"382f0622-3acb-41c7-a231-3b688b8c212e\") " pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:09:08.953718 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:08.953704    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6485b81d-8dac-4cab-8f1a-653e0116ba01-nginx-conf\") pod \"networking-console-plugin-6cf856758c-hfv8k\" (UID: \"6485b81d-8dac-4cab-8f1a-653e0116ba01\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hfv8k"
Jul 13 09:09:09.054118 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.054057    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/382f0622-3acb-41c7-a231-3b688b8c212e-tmp-dir\") pod \"dns-default-vrnb8\" (UID: \"382f0622-3acb-41c7-a231-3b688b8c212e\") " pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:09:09.054118 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.054085    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:09.054118 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.054102    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkbcm\" (UniqueName: \"kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-kube-api-access-wkbcm\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:09.054118 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.054119    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/382f0622-3acb-41c7-a231-3b688b8c212e-config-volume\") pod \"dns-default-vrnb8\" (UID: \"382f0622-3acb-41c7-a231-3b688b8c212e\") " pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:09:09.054374 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:09.054199    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 09:09:09.054374 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:09.054213    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6479ff8fc8-x4bkn: secret "image-registry-tls" not found
Jul 13 09:09:09.054374 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.054260    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5gk6\" (UniqueName: \"kubernetes.io/projected/382f0622-3acb-41c7-a231-3b688b8c212e-kube-api-access-v5gk6\") pod \"dns-default-vrnb8\" (UID: \"382f0622-3acb-41c7-a231-3b688b8c212e\") " pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:09:09.054374 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:09.054277    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls podName:eaa1f1f3-ea75-4c49-8ada-3cbe5125009d nodeName:}" failed. No retries permitted until 2026-07-13 09:09:09.554256242 +0000 UTC m=+38.632133476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls") pod "image-registry-6479ff8fc8-x4bkn" (UID: "eaa1f1f3-ea75-4c49-8ada-3cbe5125009d") : secret "image-registry-tls" not found
Jul 13 09:09:09.054374 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.054322    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-trusted-ca\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:09.054374 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.054363    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-ca-trust-extracted\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:09.054664 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.054388    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-certificates\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:09.054664 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.054428    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/382f0622-3acb-41c7-a231-3b688b8c212e-tmp-dir\") pod \"dns-default-vrnb8\" (UID: \"382f0622-3acb-41c7-a231-3b688b8c212e\") " pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:09:09.054664 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.054434    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-installation-pull-secrets\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:09.054664 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.054516    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e28a544-d35a-4036-bab4-87432d8949f9-cert\") pod \"ingress-canary-8wp8c\" (UID: \"5e28a544-d35a-4036-bab4-87432d8949f9\") " pod="openshift-ingress-canary/ingress-canary-8wp8c"
Jul 13 09:09:09.054664 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.054547    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls\") pod \"dns-default-vrnb8\" (UID: \"382f0622-3acb-41c7-a231-3b688b8c212e\") " pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:09:09.054664 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.054579    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-bound-sa-token\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:09.054664 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.054618    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-image-registry-private-configuration\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:09.054664 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.054665    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/382f0622-3acb-41c7-a231-3b688b8c212e-config-volume\") pod \"dns-default-vrnb8\" (UID: \"382f0622-3acb-41c7-a231-3b688b8c212e\") " pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:09:09.055015 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.054666    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mx8r\" (UniqueName: \"kubernetes.io/projected/5e28a544-d35a-4036-bab4-87432d8949f9-kube-api-access-5mx8r\") pod \"ingress-canary-8wp8c\" (UID: \"5e28a544-d35a-4036-bab4-87432d8949f9\") " pod="openshift-ingress-canary/ingress-canary-8wp8c"
Jul 13 09:09:09.055015 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:09.054763    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 09:09:09.055015 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.054763    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-ca-trust-extracted\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:09.055015 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:09.054817    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls podName:382f0622-3acb-41c7-a231-3b688b8c212e nodeName:}" failed. No retries permitted until 2026-07-13 09:09:09.554802974 +0000 UTC m=+38.632680213 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls") pod "dns-default-vrnb8" (UID: "382f0622-3acb-41c7-a231-3b688b8c212e") : secret "dns-default-metrics-tls" not found
Jul 13 09:09:09.055015 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.055011    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-certificates\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:09.055427 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.055405    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-trusted-ca\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:09.058399 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.058375    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-image-registry-private-configuration\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:09.058481 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.058384    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e28a544-d35a-4036-bab4-87432d8949f9-cert\") pod \"ingress-canary-8wp8c\" (UID: \"5e28a544-d35a-4036-bab4-87432d8949f9\") " pod="openshift-ingress-canary/ingress-canary-8wp8c"
Jul 13 09:09:09.058481 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.058402    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-installation-pull-secrets\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:09.065303 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.065285    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkbcm\" (UniqueName: \"kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-kube-api-access-wkbcm\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:09.065386 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.065288    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5gk6\" (UniqueName: \"kubernetes.io/projected/382f0622-3acb-41c7-a231-3b688b8c212e-kube-api-access-v5gk6\") pod \"dns-default-vrnb8\" (UID: \"382f0622-3acb-41c7-a231-3b688b8c212e\") " pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:09:09.065948 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.065930    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mx8r\" (UniqueName: \"kubernetes.io/projected/5e28a544-d35a-4036-bab4-87432d8949f9-kube-api-access-5mx8r\") pod \"ingress-canary-8wp8c\" (UID: \"5e28a544-d35a-4036-bab4-87432d8949f9\") " pod="openshift-ingress-canary/ingress-canary-8wp8c"
Jul 13 09:09:09.066177 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.066161    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-bound-sa-token\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:09.088124 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.088105    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8wp8c"
Jul 13 09:09:09.272707 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.272534    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8wp8c"]
Jul 13 09:09:09.276598 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:09:09.276570    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e28a544_d35a_4036_bab4_87432d8949f9.slice/crio-4360b983bc3a1c8909c4ea8e9522090d626489b65fa0a42d4ddbae559cf7dd2f WatchSource:0}: Error finding container 4360b983bc3a1c8909c4ea8e9522090d626489b65fa0a42d4ddbae559cf7dd2f: Status 404 returned error can't find the container with id 4360b983bc3a1c8909c4ea8e9522090d626489b65fa0a42d4ddbae559cf7dd2f
Jul 13 09:09:09.457748 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.457659    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-hfv8k\" (UID: \"6485b81d-8dac-4cab-8f1a-653e0116ba01\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hfv8k"
Jul 13 09:09:09.457874 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:09.457781    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 09:09:09.457874 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:09.457838    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert podName:6485b81d-8dac-4cab-8f1a-653e0116ba01 nodeName:}" failed. No retries permitted until 2026-07-13 09:09:10.457824178 +0000 UTC m=+39.535701410 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-hfv8k" (UID: "6485b81d-8dac-4cab-8f1a-653e0116ba01") : secret "networking-console-plugin-cert" not found
Jul 13 09:09:09.558489 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.558464    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls\") pod \"dns-default-vrnb8\" (UID: \"382f0622-3acb-41c7-a231-3b688b8c212e\") " pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:09:09.558623 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.558516    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:09.558623 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:09.558596    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 09:09:09.558716 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:09.558661    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls podName:382f0622-3acb-41c7-a231-3b688b8c212e nodeName:}" failed. No retries permitted until 2026-07-13 09:09:10.55864608 +0000 UTC m=+39.636523314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls") pod "dns-default-vrnb8" (UID: "382f0622-3acb-41c7-a231-3b688b8c212e") : secret "dns-default-metrics-tls" not found
Jul 13 09:09:09.558716 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:09.558611    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 09:09:09.558789 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:09.558717    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6479ff8fc8-x4bkn: secret "image-registry-tls" not found
Jul 13 09:09:09.558789 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:09.558774    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls podName:eaa1f1f3-ea75-4c49-8ada-3cbe5125009d nodeName:}" failed. No retries permitted until 2026-07-13 09:09:10.558761324 +0000 UTC m=+39.636638557 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls") pod "image-registry-6479ff8fc8-x4bkn" (UID: "eaa1f1f3-ea75-4c49-8ada-3cbe5125009d") : secret "image-registry-tls" not found
Jul 13 09:09:09.685556 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:09.685526    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8wp8c" event={"ID":"5e28a544-d35a-4036-bab4-87432d8949f9","Type":"ContainerStarted","Data":"4360b983bc3a1c8909c4ea8e9522090d626489b65fa0a42d4ddbae559cf7dd2f"}
Jul 13 09:09:10.462793 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:10.462762    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-hfv8k\" (UID: \"6485b81d-8dac-4cab-8f1a-653e0116ba01\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hfv8k"
Jul 13 09:09:10.462962 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:10.462893    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 09:09:10.462962 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:10.462959    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert podName:6485b81d-8dac-4cab-8f1a-653e0116ba01 nodeName:}" failed. No retries permitted until 2026-07-13 09:09:12.462941892 +0000 UTC m=+41.540819126 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-hfv8k" (UID: "6485b81d-8dac-4cab-8f1a-653e0116ba01") : secret "networking-console-plugin-cert" not found
Jul 13 09:09:10.476052 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:10.476023    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:09:10.476175 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:10.476023    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:09:10.476235 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:10.476028    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:09:10.478916 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:10.478895    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 09:09:10.478998 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:10.478965    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 09:09:10.479885 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:10.479863    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 09:09:10.479980 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:10.479900    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 09:09:10.479980 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:10.479922    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zlq2v\""
Jul 13 09:09:10.479980 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:10.479900    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mkvxw\""
Jul 13 09:09:10.563772 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:10.563748    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:10.563906 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:10.563856    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls\") pod \"dns-default-vrnb8\" (UID: \"382f0622-3acb-41c7-a231-3b688b8c212e\") " pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:09:10.563906 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:10.563897    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 09:09:10.564018 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:10.563915    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6479ff8fc8-x4bkn: secret "image-registry-tls" not found
Jul 13 09:09:10.564018 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:10.563959    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 09:09:10.564018 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:10.563963    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls podName:eaa1f1f3-ea75-4c49-8ada-3cbe5125009d nodeName:}" failed. No retries permitted until 2026-07-13 09:09:12.563948844 +0000 UTC m=+41.641826077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls") pod "image-registry-6479ff8fc8-x4bkn" (UID: "eaa1f1f3-ea75-4c49-8ada-3cbe5125009d") : secret "image-registry-tls" not found
Jul 13 09:09:10.564147 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:10.564026    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls podName:382f0622-3acb-41c7-a231-3b688b8c212e nodeName:}" failed. No retries permitted until 2026-07-13 09:09:12.56400753 +0000 UTC m=+41.641884764 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls") pod "dns-default-vrnb8" (UID: "382f0622-3acb-41c7-a231-3b688b8c212e") : secret "dns-default-metrics-tls" not found
Jul 13 09:09:12.477058 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:12.477025    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-hfv8k\" (UID: \"6485b81d-8dac-4cab-8f1a-653e0116ba01\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hfv8k"
Jul 13 09:09:12.477516 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:12.477160    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 09:09:12.477516 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:12.477233    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert podName:6485b81d-8dac-4cab-8f1a-653e0116ba01 nodeName:}" failed. No retries permitted until 2026-07-13 09:09:16.477213132 +0000 UTC m=+45.555090389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-hfv8k" (UID: "6485b81d-8dac-4cab-8f1a-653e0116ba01") : secret "networking-console-plugin-cert" not found
Jul 13 09:09:12.578246 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:12.578215    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:12.578412 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:12.578302    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls\") pod \"dns-default-vrnb8\" (UID: \"382f0622-3acb-41c7-a231-3b688b8c212e\") " pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:09:12.578412 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:12.578390    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 09:09:12.578412 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:12.578412    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6479ff8fc8-x4bkn: secret "image-registry-tls" not found
Jul 13 09:09:12.578582 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:12.578435    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 09:09:12.578582 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:12.578469    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls podName:eaa1f1f3-ea75-4c49-8ada-3cbe5125009d nodeName:}" failed. No retries permitted until 2026-07-13 09:09:16.578449623 +0000 UTC m=+45.656326876 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls") pod "image-registry-6479ff8fc8-x4bkn" (UID: "eaa1f1f3-ea75-4c49-8ada-3cbe5125009d") : secret "image-registry-tls" not found
Jul 13 09:09:12.578582 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:12.578492    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls podName:382f0622-3acb-41c7-a231-3b688b8c212e nodeName:}" failed. No retries permitted until 2026-07-13 09:09:16.578475417 +0000 UTC m=+45.656352667 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls") pod "dns-default-vrnb8" (UID: "382f0622-3acb-41c7-a231-3b688b8c212e") : secret "dns-default-metrics-tls" not found
Jul 13 09:09:12.693462 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:12.693426    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8wp8c" event={"ID":"5e28a544-d35a-4036-bab4-87432d8949f9","Type":"ContainerStarted","Data":"f7b5697499cd5a95be059555573ca5893e8b8e9e338ca80a4ccd33735065c427"}
Jul 13 09:09:12.709272 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:12.709231    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8wp8c" podStartSLOduration=1.757912401 podStartE2EDuration="4.709217268s" totalImagesPullingTime="2.951304867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:09:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:09:12.708640727 +0000 UTC m=+41.786517982" watchObservedRunningTime="2026-07-13 09:09:12.709217268 +0000 UTC m=+41.787094575"
Jul 13 09:09:16.507145 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:16.506967    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-hfv8k\" (UID: \"6485b81d-8dac-4cab-8f1a-653e0116ba01\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hfv8k"
Jul 13 09:09:16.507494 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:16.507120    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 09:09:16.507494 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:16.507218    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert podName:6485b81d-8dac-4cab-8f1a-653e0116ba01 nodeName:}" failed. No retries permitted until 2026-07-13 09:09:24.507202129 +0000 UTC m=+53.585079362 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-hfv8k" (UID: "6485b81d-8dac-4cab-8f1a-653e0116ba01") : secret "networking-console-plugin-cert" not found
Jul 13 09:09:16.608211 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:16.608182    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls\") pod \"dns-default-vrnb8\" (UID: \"382f0622-3acb-41c7-a231-3b688b8c212e\") " pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:09:16.608323 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:16.608234    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:16.608367 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:16.608324    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 09:09:16.608367 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:16.608334    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6479ff8fc8-x4bkn: secret "image-registry-tls" not found
Jul 13 09:09:16.608367 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:16.608343    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 09:09:16.608469 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:16.608379    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls podName:eaa1f1f3-ea75-4c49-8ada-3cbe5125009d nodeName:}" failed. No retries permitted until 2026-07-13 09:09:24.608366218 +0000 UTC m=+53.686243450 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls") pod "image-registry-6479ff8fc8-x4bkn" (UID: "eaa1f1f3-ea75-4c49-8ada-3cbe5125009d") : secret "image-registry-tls" not found
Jul 13 09:09:16.608469 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:16.608390    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls podName:382f0622-3acb-41c7-a231-3b688b8c212e nodeName:}" failed. No retries permitted until 2026-07-13 09:09:24.608384919 +0000 UTC m=+53.686262152 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls") pod "dns-default-vrnb8" (UID: "382f0622-3acb-41c7-a231-3b688b8c212e") : secret "dns-default-metrics-tls" not found
Jul 13 09:09:24.566751 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:24.566714    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-hfv8k\" (UID: \"6485b81d-8dac-4cab-8f1a-653e0116ba01\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hfv8k"
Jul 13 09:09:24.567167 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:24.566854    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 09:09:24.567167 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:24.566926    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert podName:6485b81d-8dac-4cab-8f1a-653e0116ba01 nodeName:}" failed. No retries permitted until 2026-07-13 09:09:40.566908272 +0000 UTC m=+69.644785514 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-hfv8k" (UID: "6485b81d-8dac-4cab-8f1a-653e0116ba01") : secret "networking-console-plugin-cert" not found
Jul 13 09:09:24.668010 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:24.667974    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls\") pod \"dns-default-vrnb8\" (UID: \"382f0622-3acb-41c7-a231-3b688b8c212e\") " pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:09:24.668158 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:24.668028    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:24.668158 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:24.668124    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 09:09:24.668158 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:24.668142    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 09:09:24.668158 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:24.668152    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6479ff8fc8-x4bkn: secret "image-registry-tls" not found
Jul 13 09:09:24.668283 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:24.668184    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls podName:382f0622-3acb-41c7-a231-3b688b8c212e nodeName:}" failed. No retries permitted until 2026-07-13 09:09:40.668170077 +0000 UTC m=+69.746047309 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls") pod "dns-default-vrnb8" (UID: "382f0622-3acb-41c7-a231-3b688b8c212e") : secret "dns-default-metrics-tls" not found
Jul 13 09:09:24.668283 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:24.668201    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls podName:eaa1f1f3-ea75-4c49-8ada-3cbe5125009d nodeName:}" failed. No retries permitted until 2026-07-13 09:09:40.668190263 +0000 UTC m=+69.746067496 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls") pod "image-registry-6479ff8fc8-x4bkn" (UID: "eaa1f1f3-ea75-4c49-8ada-3cbe5125009d") : secret "image-registry-tls" not found
Jul 13 09:09:33.674531 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:33.674503    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t558b"
Jul 13 09:09:37.154991 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:37.154955    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs\") pod \"network-metrics-daemon-rrhxd\" (UID: \"caf4af40-8763-4401-8dd4-dfe646c17704\") " pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:09:37.157697 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:37.157670    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 09:09:37.165939 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:37.165923    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 13 09:09:37.165989 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:37.165975    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs podName:caf4af40-8763-4401-8dd4-dfe646c17704 nodeName:}" failed. No retries permitted until 2026-07-13 09:10:41.165957261 +0000 UTC m=+130.243834494 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs") pod "network-metrics-daemon-rrhxd" (UID: "caf4af40-8763-4401-8dd4-dfe646c17704") : secret "metrics-daemon-secret" not found
Jul 13 09:09:37.255589 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:37.255558    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96008549-14fd-453d-9236-a601e1010005-original-pull-secret\") pod \"global-pull-secret-syncer-hg679\" (UID: \"96008549-14fd-453d-9236-a601e1010005\") " pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:09:37.258431 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:37.258413    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 09:09:37.269346 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:37.269318    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96008549-14fd-453d-9236-a601e1010005-original-pull-secret\") pod \"global-pull-secret-syncer-hg679\" (UID: \"96008549-14fd-453d-9236-a601e1010005\") " pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:09:37.356497 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:37.356462    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wbqx\" (UniqueName: \"kubernetes.io/projected/5765ed08-0739-46eb-a13a-2eb857df9c1b-kube-api-access-9wbqx\") pod \"network-check-target-h6lck\" (UID: \"5765ed08-0739-46eb-a13a-2eb857df9c1b\") " pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:09:37.359855 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:37.359837    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 09:09:37.370318 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:37.370301    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 09:09:37.380042 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:37.380015    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wbqx\" (UniqueName: \"kubernetes.io/projected/5765ed08-0739-46eb-a13a-2eb857df9c1b-kube-api-access-9wbqx\") pod \"network-check-target-h6lck\" (UID: \"5765ed08-0739-46eb-a13a-2eb857df9c1b\") " pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:09:37.497201 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:37.497126    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mkvxw\""
Jul 13 09:09:37.499366 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:37.499352    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg679"
Jul 13 09:09:37.504820 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:37.504800    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:09:37.627962 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:37.627934    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hg679"]
Jul 13 09:09:37.631530 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:09:37.631504    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96008549_14fd_453d_9236_a601e1010005.slice/crio-e5e10c27ecb2b2bcc991b47c939d5a19819e5c8a20e4a626eae193393d2ad5a6 WatchSource:0}: Error finding container e5e10c27ecb2b2bcc991b47c939d5a19819e5c8a20e4a626eae193393d2ad5a6: Status 404 returned error can't find the container with id e5e10c27ecb2b2bcc991b47c939d5a19819e5c8a20e4a626eae193393d2ad5a6
Jul 13 09:09:37.642343 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:37.642324    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h6lck"]
Jul 13 09:09:37.645176 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:09:37.645153    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5765ed08_0739_46eb_a13a_2eb857df9c1b.slice/crio-be4b06b16dbdff385a7079998851f30104b26fff20025bbf5ec3ee7f2c35f4b6 WatchSource:0}: Error finding container be4b06b16dbdff385a7079998851f30104b26fff20025bbf5ec3ee7f2c35f4b6: Status 404 returned error can't find the container with id be4b06b16dbdff385a7079998851f30104b26fff20025bbf5ec3ee7f2c35f4b6
Jul 13 09:09:37.750653 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:37.750595    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h6lck" event={"ID":"5765ed08-0739-46eb-a13a-2eb857df9c1b","Type":"ContainerStarted","Data":"be4b06b16dbdff385a7079998851f30104b26fff20025bbf5ec3ee7f2c35f4b6"}
Jul 13 09:09:37.751671 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:37.751644    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hg679" event={"ID":"96008549-14fd-453d-9236-a601e1010005","Type":"ContainerStarted","Data":"e5e10c27ecb2b2bcc991b47c939d5a19819e5c8a20e4a626eae193393d2ad5a6"}
Jul 13 09:09:40.581819 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:40.581776    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-hfv8k\" (UID: \"6485b81d-8dac-4cab-8f1a-653e0116ba01\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hfv8k"
Jul 13 09:09:40.582252 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:40.581942    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 09:09:40.582252 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:40.582037    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert podName:6485b81d-8dac-4cab-8f1a-653e0116ba01 nodeName:}" failed. No retries permitted until 2026-07-13 09:10:12.582019156 +0000 UTC m=+101.659896394 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-hfv8k" (UID: "6485b81d-8dac-4cab-8f1a-653e0116ba01") : secret "networking-console-plugin-cert" not found
Jul 13 09:09:40.682512 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:40.682479    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls\") pod \"dns-default-vrnb8\" (UID: \"382f0622-3acb-41c7-a231-3b688b8c212e\") " pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:09:40.682674 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:40.682548    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:09:40.682674 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:40.682644    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 09:09:40.682828 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:40.682725    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 09:09:40.682828 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:40.682746    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6479ff8fc8-x4bkn: secret "image-registry-tls" not found
Jul 13 09:09:40.682828 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:40.682749    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls podName:382f0622-3acb-41c7-a231-3b688b8c212e nodeName:}" failed. No retries permitted until 2026-07-13 09:10:12.682727199 +0000 UTC m=+101.760604445 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls") pod "dns-default-vrnb8" (UID: "382f0622-3acb-41c7-a231-3b688b8c212e") : secret "dns-default-metrics-tls" not found
Jul 13 09:09:40.682828 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:09:40.682797    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls podName:eaa1f1f3-ea75-4c49-8ada-3cbe5125009d nodeName:}" failed. No retries permitted until 2026-07-13 09:10:12.682779045 +0000 UTC m=+101.760656300 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls") pod "image-registry-6479ff8fc8-x4bkn" (UID: "eaa1f1f3-ea75-4c49-8ada-3cbe5125009d") : secret "image-registry-tls" not found
Jul 13 09:09:42.767459 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:42.767423    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h6lck" event={"ID":"5765ed08-0739-46eb-a13a-2eb857df9c1b","Type":"ContainerStarted","Data":"0c210548c0f0a37341fa020bafc6009aaba7fe195c91aa09d33f65b07c1ebed9"}
Jul 13 09:09:42.767926 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:42.767541    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:09:42.768983 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:42.768957    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hg679" event={"ID":"96008549-14fd-453d-9236-a601e1010005","Type":"ContainerStarted","Data":"5c1c95db76f38d1247bbcf41edb0a47bc8ec10f9a8b371110ab31d6436ae497d"}
Jul 13 09:09:42.783797 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:42.783711    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-h6lck" podStartSLOduration=65.906327244 podStartE2EDuration="1m10.783680249s" totalImagesPullingTime="4.877353005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:09:42.78319921 +0000 UTC m=+71.861076465" watchObservedRunningTime="2026-07-13 09:09:42.783680249 +0000 UTC m=+71.861557482"
Jul 13 09:09:42.797220 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:09:42.797182    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hg679" podStartSLOduration=65.904670636 podStartE2EDuration="1m10.797167802s" totalImagesPullingTime="4.892497166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 09:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:09:42.796433963 +0000 UTC m=+71.874311218" watchObservedRunningTime="2026-07-13 09:09:42.797167802 +0000 UTC m=+71.875045090"
Jul 13 09:10:12.602610 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:10:12.602559    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-hfv8k\" (UID: \"6485b81d-8dac-4cab-8f1a-653e0116ba01\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hfv8k"
Jul 13 09:10:12.603067 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:10:12.602702    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 09:10:12.603067 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:10:12.602764    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert podName:6485b81d-8dac-4cab-8f1a-653e0116ba01 nodeName:}" failed. No retries permitted until 2026-07-13 09:11:16.602749907 +0000 UTC m=+165.680627144 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-hfv8k" (UID: "6485b81d-8dac-4cab-8f1a-653e0116ba01") : secret "networking-console-plugin-cert" not found
Jul 13 09:10:12.703757 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:10:12.703720    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls\") pod \"dns-default-vrnb8\" (UID: \"382f0622-3acb-41c7-a231-3b688b8c212e\") " pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:10:12.703921 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:10:12.703776    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:10:12.703921 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:10:12.703869    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 09:10:12.703921 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:10:12.703884    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6479ff8fc8-x4bkn: secret "image-registry-tls" not found
Jul 13 09:10:12.703921 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:10:12.703867    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 09:10:12.704061 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:10:12.703938    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls podName:382f0622-3acb-41c7-a231-3b688b8c212e nodeName:}" failed. No retries permitted until 2026-07-13 09:11:16.703923167 +0000 UTC m=+165.781800403 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls") pod "dns-default-vrnb8" (UID: "382f0622-3acb-41c7-a231-3b688b8c212e") : secret "dns-default-metrics-tls" not found
Jul 13 09:10:12.704061 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:10:12.703951    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls podName:eaa1f1f3-ea75-4c49-8ada-3cbe5125009d nodeName:}" failed. No retries permitted until 2026-07-13 09:11:16.703944806 +0000 UTC m=+165.781822038 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls") pod "image-registry-6479ff8fc8-x4bkn" (UID: "eaa1f1f3-ea75-4c49-8ada-3cbe5125009d") : secret "image-registry-tls" not found
Jul 13 09:10:13.774025 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:10:13.773994    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-h6lck"
Jul 13 09:10:41.197759 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:10:41.197706    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs\") pod \"network-metrics-daemon-rrhxd\" (UID: \"caf4af40-8763-4401-8dd4-dfe646c17704\") " pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:10:41.198198 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:10:41.197804    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 13 09:10:41.198198 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:10:41.197871    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs podName:caf4af40-8763-4401-8dd4-dfe646c17704 nodeName:}" failed. No retries permitted until 2026-07-13 09:12:43.197854807 +0000 UTC m=+252.275732040 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs") pod "network-metrics-daemon-rrhxd" (UID: "caf4af40-8763-4401-8dd4-dfe646c17704") : secret "metrics-daemon-secret" not found
Jul 13 09:11:11.743351 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:11:11.743311    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-hfv8k" podUID="6485b81d-8dac-4cab-8f1a-653e0116ba01"
Jul 13 09:11:11.767494 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:11:11.767465    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn" podUID="eaa1f1f3-ea75-4c49-8ada-3cbe5125009d"
Jul 13 09:11:11.811043 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:11:11.811004    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vrnb8" podUID="382f0622-3acb-41c7-a231-3b688b8c212e"
Jul 13 09:11:11.974829 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:11:11.974801    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-hfv8k"
Jul 13 09:11:11.974829 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:11:11.974839    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:11:13.487072 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:11:13.487034    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rrhxd" podUID="caf4af40-8763-4401-8dd4-dfe646c17704"
Jul 13 09:11:16.637667 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:11:16.637619    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-hfv8k\" (UID: \"6485b81d-8dac-4cab-8f1a-653e0116ba01\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hfv8k"
Jul 13 09:11:16.638110 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:11:16.637795    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 09:11:16.638110 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:11:16.637871    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert podName:6485b81d-8dac-4cab-8f1a-653e0116ba01 nodeName:}" failed. No retries permitted until 2026-07-13 09:13:18.63785446 +0000 UTC m=+287.715731696 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-hfv8k" (UID: "6485b81d-8dac-4cab-8f1a-653e0116ba01") : secret "networking-console-plugin-cert" not found
Jul 13 09:11:16.738196 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:11:16.738149    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls\") pod \"dns-default-vrnb8\" (UID: \"382f0622-3acb-41c7-a231-3b688b8c212e\") " pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:11:16.738290 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:11:16.738218    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:11:16.738331 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:11:16.738304    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 09:11:16.738331 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:11:16.738315    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6479ff8fc8-x4bkn: secret "image-registry-tls" not found
Jul 13 09:11:16.738407 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:11:16.738355    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls podName:eaa1f1f3-ea75-4c49-8ada-3cbe5125009d nodeName:}" failed. No retries permitted until 2026-07-13 09:13:18.738343216 +0000 UTC m=+287.816220449 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls") pod "image-registry-6479ff8fc8-x4bkn" (UID: "eaa1f1f3-ea75-4c49-8ada-3cbe5125009d") : secret "image-registry-tls" not found
Jul 13 09:11:16.738407 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:11:16.738303    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 09:11:16.738475 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:11:16.738438    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls podName:382f0622-3acb-41c7-a231-3b688b8c212e nodeName:}" failed. No retries permitted until 2026-07-13 09:13:18.738424891 +0000 UTC m=+287.816302124 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls") pod "dns-default-vrnb8" (UID: "382f0622-3acb-41c7-a231-3b688b8c212e") : secret "dns-default-metrics-tls" not found
Jul 13 09:11:24.476419 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:11:24.476320    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:11:25.475627 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:11:25.475598    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:12:38.555066 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.555024    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nkjv5"]
Jul 13 09:12:38.556779 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.556763    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ddnmg"]
Jul 13 09:12:38.556942 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.556905    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nkjv5"
Jul 13 09:12:38.558265 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.558248    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ddnmg"
Jul 13 09:12:38.563774 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.563758    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 13 09:12:38.563889 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.563867    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 13 09:12:38.564181 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.564165    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-d82jl\""
Jul 13 09:12:38.564908 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.564889    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 13 09:12:38.565016 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.564892    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 13 09:12:38.565282 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.565263    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 13 09:12:38.565381 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.565291    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 13 09:12:38.565381 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.565305    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-zwdt4\""
Jul 13 09:12:38.565549 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.565535    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 13 09:12:38.565937 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.565921    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 13 09:12:38.575922 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.575905    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nkjv5"]
Jul 13 09:12:38.588175 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.588155    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ddnmg"]
Jul 13 09:12:38.597826 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.597807    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kmtq\" (UniqueName: \"kubernetes.io/projected/7f918b89-58ae-4153-a7ba-f73ae80030db-kube-api-access-6kmtq\") pod \"kube-storage-version-migrator-operator-799cb7f958-ddnmg\" (UID: \"7f918b89-58ae-4153-a7ba-f73ae80030db\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ddnmg"
Jul 13 09:12:38.597915 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.597847    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33fa8a0a-8233-4229-8419-61d00b687381-config\") pod \"service-ca-operator-7695fc6c8c-nkjv5\" (UID: \"33fa8a0a-8233-4229-8419-61d00b687381\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nkjv5"
Jul 13 09:12:38.597915 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.597865    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f918b89-58ae-4153-a7ba-f73ae80030db-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-ddnmg\" (UID: \"7f918b89-58ae-4153-a7ba-f73ae80030db\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ddnmg"
Jul 13 09:12:38.597985 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.597911    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvbfh\" (UniqueName: \"kubernetes.io/projected/33fa8a0a-8233-4229-8419-61d00b687381-kube-api-access-pvbfh\") pod \"service-ca-operator-7695fc6c8c-nkjv5\" (UID: \"33fa8a0a-8233-4229-8419-61d00b687381\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nkjv5"
Jul 13 09:12:38.597985 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.597951    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f918b89-58ae-4153-a7ba-f73ae80030db-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-ddnmg\" (UID: \"7f918b89-58ae-4153-a7ba-f73ae80030db\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ddnmg"
Jul 13 09:12:38.598053 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.598020    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33fa8a0a-8233-4229-8419-61d00b687381-serving-cert\") pod \"service-ca-operator-7695fc6c8c-nkjv5\" (UID: \"33fa8a0a-8233-4229-8419-61d00b687381\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nkjv5"
Jul 13 09:12:38.637041 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.637025    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-d6lgc"]
Jul 13 09:12:38.638708 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.638680    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-d6lgc"
Jul 13 09:12:38.641317 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.641299    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-77hfm\""
Jul 13 09:12:38.641648 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.641630    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 13 09:12:38.645594 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.645573    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 13 09:12:38.645759 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.645741    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-k6qjb"]
Jul 13 09:12:38.647238 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.647218    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5wkhg"]
Jul 13 09:12:38.647328 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.647315    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-k6qjb"
Jul 13 09:12:38.648953 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.648937    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5wkhg"
Jul 13 09:12:38.652865 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.652834    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 13 09:12:38.652997 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.652925    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 13 09:12:38.653161 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.653144    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zbr4h\""
Jul 13 09:12:38.653633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.653451    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 13 09:12:38.653633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.653548    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 13 09:12:38.655405 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.655388    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 13 09:12:38.656784 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.656765    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-npwdw\""
Jul 13 09:12:38.656878 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.656769    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 13 09:12:38.659059 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.659036    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 13 09:12:38.660791 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.660767    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-d6lgc"]
Jul 13 09:12:38.662646 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.662629    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 13 09:12:38.665971 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.665955    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 13 09:12:38.671268 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.671248    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5wkhg"]
Jul 13 09:12:38.671949 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.671925    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-k6qjb"]
Jul 13 09:12:38.698958 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.698934    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c63b1cf8-18be-4229-88d4-de471969a548-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-k6qjb\" (UID: \"c63b1cf8-18be-4229-88d4-de471969a548\") " pod="openshift-insights/insights-operator-68d9dd94cf-k6qjb"
Jul 13 09:12:38.699060 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.698961    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c63b1cf8-18be-4229-88d4-de471969a548-snapshots\") pod \"insights-operator-68d9dd94cf-k6qjb\" (UID: \"c63b1cf8-18be-4229-88d4-de471969a548\") " pod="openshift-insights/insights-operator-68d9dd94cf-k6qjb"
Jul 13 09:12:38.699060 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.698978    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khsqq\" (UniqueName: \"kubernetes.io/projected/c63b1cf8-18be-4229-88d4-de471969a548-kube-api-access-khsqq\") pod \"insights-operator-68d9dd94cf-k6qjb\" (UID: \"c63b1cf8-18be-4229-88d4-de471969a548\") " pod="openshift-insights/insights-operator-68d9dd94cf-k6qjb"
Jul 13 09:12:38.699060 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.698998    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp48w\" (UniqueName: \"kubernetes.io/projected/aea82529-432f-4d72-af45-cdb9d24228a9-kube-api-access-vp48w\") pod \"volume-data-source-validator-78495597f6-d6lgc\" (UID: \"aea82529-432f-4d72-af45-cdb9d24228a9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-d6lgc"
Jul 13 09:12:38.699060 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.699013    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td4vr\" (UniqueName: \"kubernetes.io/projected/12891776-d5ad-4b5e-9c3c-4285c514c6af-kube-api-access-td4vr\") pod \"cluster-monitoring-operator-5f7f494dd4-5wkhg\" (UID: \"12891776-d5ad-4b5e-9c3c-4285c514c6af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5wkhg"
Jul 13 09:12:38.699265 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.699106    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33fa8a0a-8233-4229-8419-61d00b687381-config\") pod \"service-ca-operator-7695fc6c8c-nkjv5\" (UID: \"33fa8a0a-8233-4229-8419-61d00b687381\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nkjv5"
Jul 13 09:12:38.699265 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.699213    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f918b89-58ae-4153-a7ba-f73ae80030db-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-ddnmg\" (UID: \"7f918b89-58ae-4153-a7ba-f73ae80030db\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ddnmg"
Jul 13 09:12:38.699265 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.699243    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/12891776-d5ad-4b5e-9c3c-4285c514c6af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-5wkhg\" (UID: \"12891776-d5ad-4b5e-9c3c-4285c514c6af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5wkhg"
Jul 13 09:12:38.699413 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.699279    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c63b1cf8-18be-4229-88d4-de471969a548-serving-cert\") pod \"insights-operator-68d9dd94cf-k6qjb\" (UID: \"c63b1cf8-18be-4229-88d4-de471969a548\") " pod="openshift-insights/insights-operator-68d9dd94cf-k6qjb"
Jul 13 09:12:38.699413 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.699328    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kmtq\" (UniqueName: \"kubernetes.io/projected/7f918b89-58ae-4153-a7ba-f73ae80030db-kube-api-access-6kmtq\") pod \"kube-storage-version-migrator-operator-799cb7f958-ddnmg\" (UID: \"7f918b89-58ae-4153-a7ba-f73ae80030db\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ddnmg"
Jul 13 09:12:38.699413 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.699349    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/12891776-d5ad-4b5e-9c3c-4285c514c6af-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-5wkhg\" (UID: \"12891776-d5ad-4b5e-9c3c-4285c514c6af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5wkhg"
Jul 13 09:12:38.699413 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.699367    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvbfh\" (UniqueName: \"kubernetes.io/projected/33fa8a0a-8233-4229-8419-61d00b687381-kube-api-access-pvbfh\") pod \"service-ca-operator-7695fc6c8c-nkjv5\" (UID: \"33fa8a0a-8233-4229-8419-61d00b687381\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nkjv5"
Jul 13 09:12:38.699413 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.699403    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f918b89-58ae-4153-a7ba-f73ae80030db-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-ddnmg\" (UID: \"7f918b89-58ae-4153-a7ba-f73ae80030db\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ddnmg"
Jul 13 09:12:38.699658 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.699491    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c63b1cf8-18be-4229-88d4-de471969a548-tmp\") pod \"insights-operator-68d9dd94cf-k6qjb\" (UID: \"c63b1cf8-18be-4229-88d4-de471969a548\") " pod="openshift-insights/insights-operator-68d9dd94cf-k6qjb"
Jul 13 09:12:38.699658 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.699519    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33fa8a0a-8233-4229-8419-61d00b687381-serving-cert\") pod \"service-ca-operator-7695fc6c8c-nkjv5\" (UID: \"33fa8a0a-8233-4229-8419-61d00b687381\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nkjv5"
Jul 13 09:12:38.699658 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.699544    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c63b1cf8-18be-4229-88d4-de471969a548-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-k6qjb\" (UID: \"c63b1cf8-18be-4229-88d4-de471969a548\") " pod="openshift-insights/insights-operator-68d9dd94cf-k6qjb"
Jul 13 09:12:38.699809 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.699676    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33fa8a0a-8233-4229-8419-61d00b687381-config\") pod \"service-ca-operator-7695fc6c8c-nkjv5\" (UID: \"33fa8a0a-8233-4229-8419-61d00b687381\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nkjv5"
Jul 13 09:12:38.699943 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.699928    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f918b89-58ae-4153-a7ba-f73ae80030db-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-ddnmg\" (UID: \"7f918b89-58ae-4153-a7ba-f73ae80030db\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ddnmg"
Jul 13 09:12:38.701430 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.701412    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f918b89-58ae-4153-a7ba-f73ae80030db-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-ddnmg\" (UID: \"7f918b89-58ae-4153-a7ba-f73ae80030db\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ddnmg"
Jul 13 09:12:38.701498 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.701482    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33fa8a0a-8233-4229-8419-61d00b687381-serving-cert\") pod \"service-ca-operator-7695fc6c8c-nkjv5\" (UID: \"33fa8a0a-8233-4229-8419-61d00b687381\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nkjv5"
Jul 13 09:12:38.716635 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.716611    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvbfh\" (UniqueName: \"kubernetes.io/projected/33fa8a0a-8233-4229-8419-61d00b687381-kube-api-access-pvbfh\") pod \"service-ca-operator-7695fc6c8c-nkjv5\" (UID: \"33fa8a0a-8233-4229-8419-61d00b687381\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nkjv5"
Jul 13 09:12:38.716998 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.716979    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kmtq\" (UniqueName: \"kubernetes.io/projected/7f918b89-58ae-4153-a7ba-f73ae80030db-kube-api-access-6kmtq\") pod \"kube-storage-version-migrator-operator-799cb7f958-ddnmg\" (UID: \"7f918b89-58ae-4153-a7ba-f73ae80030db\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ddnmg"
Jul 13 09:12:38.744439 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.744417    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45npf"]
Jul 13 09:12:38.746996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.746979    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45npf"
Jul 13 09:12:38.747491 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.747475    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-tmbbk"]
Jul 13 09:12:38.749034 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.749021    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-tmbbk"
Jul 13 09:12:38.751479 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.751460    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 13 09:12:38.751655 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.751642    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 13 09:12:38.752889 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.752867    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lxl59\""
Jul 13 09:12:38.753066 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.753050    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 13 09:12:38.753119 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.753086    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 13 09:12:38.753119 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.753108    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 13 09:12:38.753208 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.753129    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-972dp\""
Jul 13 09:12:38.753276 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.753254    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 13 09:12:38.754330 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.754311    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 13 09:12:38.759113 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.759091    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 13 09:12:38.765718 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.765677    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-tmbbk"]
Jul 13 09:12:38.767473 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.767454    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45npf"]
Jul 13 09:12:38.800017 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.799993    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c63b1cf8-18be-4229-88d4-de471969a548-tmp\") pod \"insights-operator-68d9dd94cf-k6qjb\" (UID: \"c63b1cf8-18be-4229-88d4-de471969a548\") " pod="openshift-insights/insights-operator-68d9dd94cf-k6qjb"
Jul 13 09:12:38.800124 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.800020    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c63b1cf8-18be-4229-88d4-de471969a548-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-k6qjb\" (UID: \"c63b1cf8-18be-4229-88d4-de471969a548\") " pod="openshift-insights/insights-operator-68d9dd94cf-k6qjb"
Jul 13 09:12:38.800124 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.800042    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c63b1cf8-18be-4229-88d4-de471969a548-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-k6qjb\" (UID: \"c63b1cf8-18be-4229-88d4-de471969a548\") " pod="openshift-insights/insights-operator-68d9dd94cf-k6qjb"
Jul 13 09:12:38.800124 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.800058    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c63b1cf8-18be-4229-88d4-de471969a548-snapshots\") pod \"insights-operator-68d9dd94cf-k6qjb\" (UID: \"c63b1cf8-18be-4229-88d4-de471969a548\") " pod="openshift-insights/insights-operator-68d9dd94cf-k6qjb"
Jul 13 09:12:38.800124 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.800074    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khsqq\" (UniqueName: \"kubernetes.io/projected/c63b1cf8-18be-4229-88d4-de471969a548-kube-api-access-khsqq\") pod \"insights-operator-68d9dd94cf-k6qjb\" (UID: \"c63b1cf8-18be-4229-88d4-de471969a548\") " pod="openshift-insights/insights-operator-68d9dd94cf-k6qjb"
Jul 13 09:12:38.800124 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.800094    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp48w\" (UniqueName: \"kubernetes.io/projected/aea82529-432f-4d72-af45-cdb9d24228a9-kube-api-access-vp48w\") pod \"volume-data-source-validator-78495597f6-d6lgc\" (UID: \"aea82529-432f-4d72-af45-cdb9d24228a9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-d6lgc"
Jul 13 09:12:38.800124 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.800114    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td4vr\" (UniqueName: \"kubernetes.io/projected/12891776-d5ad-4b5e-9c3c-4285c514c6af-kube-api-access-td4vr\") pod \"cluster-monitoring-operator-5f7f494dd4-5wkhg\" (UID: \"12891776-d5ad-4b5e-9c3c-4285c514c6af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5wkhg"
Jul 13 09:12:38.800439 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.800146    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d1243d30-2275-43cc-b5a9-a8de5a66beed-config\") pod \"console-operator-7866497494-tmbbk\" (UID: \"d1243d30-2275-43cc-b5a9-a8de5a66beed\") " pod="openshift-console-operator/console-operator-7866497494-tmbbk"
Jul 13 09:12:38.800439 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.800170    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1243d30-2275-43cc-b5a9-a8de5a66beed-serving-cert\") pod \"console-operator-7866497494-tmbbk\" (UID: \"d1243d30-2275-43cc-b5a9-a8de5a66beed\") " pod="openshift-console-operator/console-operator-7866497494-tmbbk"
Jul 13 09:12:38.800439 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.800209    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/12891776-d5ad-4b5e-9c3c-4285c514c6af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-5wkhg\" (UID: \"12891776-d5ad-4b5e-9c3c-4285c514c6af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5wkhg"
Jul 13 09:12:38.800439 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.800259    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c63b1cf8-18be-4229-88d4-de471969a548-serving-cert\") pod \"insights-operator-68d9dd94cf-k6qjb\" (UID: \"c63b1cf8-18be-4229-88d4-de471969a548\") " pod="openshift-insights/insights-operator-68d9dd94cf-k6qjb"
Jul 13 09:12:38.800439 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.800285    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1261e6f-ca9e-4297-9bdb-77a357c052dd-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-45npf\" (UID: \"a1261e6f-ca9e-4297-9bdb-77a357c052dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45npf"
Jul 13 09:12:38.800439 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:38.800335    2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 09:12:38.800439 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.800341    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1243d30-2275-43cc-b5a9-a8de5a66beed-trusted-ca\") pod \"console-operator-7866497494-tmbbk\" (UID: \"d1243d30-2275-43cc-b5a9-a8de5a66beed\") " pod="openshift-console-operator/console-operator-7866497494-tmbbk"
Jul 13 09:12:38.800439 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.800367    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqvh9\" (UniqueName: \"kubernetes.io/projected/a1261e6f-ca9e-4297-9bdb-77a357c052dd-kube-api-access-tqvh9\") pod \"cluster-samples-operator-65db858894-45npf\" (UID: \"a1261e6f-ca9e-4297-9bdb-77a357c052dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45npf"
Jul 13 09:12:38.800439 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.800375    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c63b1cf8-18be-4229-88d4-de471969a548-tmp\") pod \"insights-operator-68d9dd94cf-k6qjb\" (UID: \"c63b1cf8-18be-4229-88d4-de471969a548\") " pod="openshift-insights/insights-operator-68d9dd94cf-k6qjb"
Jul 13 09:12:38.800439 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.800398    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/12891776-d5ad-4b5e-9c3c-4285c514c6af-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-5wkhg\" (UID: \"12891776-d5ad-4b5e-9c3c-4285c514c6af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5wkhg"
Jul 13 09:12:38.800439 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:38.800420    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12891776-d5ad-4b5e-9c3c-4285c514c6af-cluster-monitoring-operator-tls podName:12891776-d5ad-4b5e-9c3c-4285c514c6af nodeName:}" failed. No retries permitted until 2026-07-13 09:12:39.300399816 +0000 UTC m=+248.378277060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/12891776-d5ad-4b5e-9c3c-4285c514c6af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-5wkhg" (UID: "12891776-d5ad-4b5e-9c3c-4285c514c6af") : secret "cluster-monitoring-operator-tls" not found
Jul 13 09:12:38.800936 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.800484    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkwpw\" (UniqueName: \"kubernetes.io/projected/d1243d30-2275-43cc-b5a9-a8de5a66beed-kube-api-access-zkwpw\") pod \"console-operator-7866497494-tmbbk\" (UID: \"d1243d30-2275-43cc-b5a9-a8de5a66beed\") " pod="openshift-console-operator/console-operator-7866497494-tmbbk"
Jul 13 09:12:38.800936 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.800651    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c63b1cf8-18be-4229-88d4-de471969a548-snapshots\") pod \"insights-operator-68d9dd94cf-k6qjb\" (UID: \"c63b1cf8-18be-4229-88d4-de471969a548\") " pod="openshift-insights/insights-operator-68d9dd94cf-k6qjb"
Jul 13 09:12:38.800936 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.800731    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c63b1cf8-18be-4229-88d4-de471969a548-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-k6qjb\" (UID: \"c63b1cf8-18be-4229-88d4-de471969a548\") " pod="openshift-insights/insights-operator-68d9dd94cf-k6qjb"
Jul 13 09:12:38.801153 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.801133    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/12891776-d5ad-4b5e-9c3c-4285c514c6af-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-5wkhg\" (UID: \"12891776-d5ad-4b5e-9c3c-4285c514c6af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5wkhg"
Jul 13 09:12:38.801448 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.801430    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c63b1cf8-18be-4229-88d4-de471969a548-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-k6qjb\" (UID: \"c63b1cf8-18be-4229-88d4-de471969a548\") " pod="openshift-insights/insights-operator-68d9dd94cf-k6qjb"
Jul 13 09:12:38.802564 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.802546    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c63b1cf8-18be-4229-88d4-de471969a548-serving-cert\") pod \"insights-operator-68d9dd94cf-k6qjb\" (UID: \"c63b1cf8-18be-4229-88d4-de471969a548\") " pod="openshift-insights/insights-operator-68d9dd94cf-k6qjb"
Jul 13 09:12:38.810256 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.810198    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khsqq\" (UniqueName: \"kubernetes.io/projected/c63b1cf8-18be-4229-88d4-de471969a548-kube-api-access-khsqq\") pod \"insights-operator-68d9dd94cf-k6qjb\" (UID: \"c63b1cf8-18be-4229-88d4-de471969a548\") " pod="openshift-insights/insights-operator-68d9dd94cf-k6qjb"
Jul 13 09:12:38.810256 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.810246    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp48w\" (UniqueName: \"kubernetes.io/projected/aea82529-432f-4d72-af45-cdb9d24228a9-kube-api-access-vp48w\") pod \"volume-data-source-validator-78495597f6-d6lgc\" (UID: \"aea82529-432f-4d72-af45-cdb9d24228a9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-d6lgc"
Jul 13 09:12:38.810773 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.810756    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-td4vr\" (UniqueName: \"kubernetes.io/projected/12891776-d5ad-4b5e-9c3c-4285c514c6af-kube-api-access-td4vr\") pod \"cluster-monitoring-operator-5f7f494dd4-5wkhg\" (UID: \"12891776-d5ad-4b5e-9c3c-4285c514c6af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5wkhg"
Jul 13 09:12:38.866700 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.866657    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nkjv5"
Jul 13 09:12:38.871111 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.871097    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ddnmg"
Jul 13 09:12:38.901076 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.901041    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d1243d30-2275-43cc-b5a9-a8de5a66beed-config\") pod \"console-operator-7866497494-tmbbk\" (UID: \"d1243d30-2275-43cc-b5a9-a8de5a66beed\") " pod="openshift-console-operator/console-operator-7866497494-tmbbk"
Jul 13 09:12:38.901076 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.901075    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1243d30-2275-43cc-b5a9-a8de5a66beed-serving-cert\") pod \"console-operator-7866497494-tmbbk\" (UID: \"d1243d30-2275-43cc-b5a9-a8de5a66beed\") " pod="openshift-console-operator/console-operator-7866497494-tmbbk"
Jul 13 09:12:38.901249 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.901145    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1261e6f-ca9e-4297-9bdb-77a357c052dd-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-45npf\" (UID: \"a1261e6f-ca9e-4297-9bdb-77a357c052dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45npf"
Jul 13 09:12:38.901249 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.901184    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1243d30-2275-43cc-b5a9-a8de5a66beed-trusted-ca\") pod \"console-operator-7866497494-tmbbk\" (UID: \"d1243d30-2275-43cc-b5a9-a8de5a66beed\") " pod="openshift-console-operator/console-operator-7866497494-tmbbk"
Jul 13 09:12:38.901249 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.901207    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqvh9\" (UniqueName: \"kubernetes.io/projected/a1261e6f-ca9e-4297-9bdb-77a357c052dd-kube-api-access-tqvh9\") pod \"cluster-samples-operator-65db858894-45npf\" (UID: \"a1261e6f-ca9e-4297-9bdb-77a357c052dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45npf"
Jul 13 09:12:38.901249 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.901240    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkwpw\" (UniqueName: \"kubernetes.io/projected/d1243d30-2275-43cc-b5a9-a8de5a66beed-kube-api-access-zkwpw\") pod \"console-operator-7866497494-tmbbk\" (UID: \"d1243d30-2275-43cc-b5a9-a8de5a66beed\") " pod="openshift-console-operator/console-operator-7866497494-tmbbk"
Jul 13 09:12:38.901839 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.901815    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d1243d30-2275-43cc-b5a9-a8de5a66beed-config\") pod \"console-operator-7866497494-tmbbk\" (UID: \"d1243d30-2275-43cc-b5a9-a8de5a66beed\") " pod="openshift-console-operator/console-operator-7866497494-tmbbk"
Jul 13 09:12:38.902141 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:38.902116    2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 09:12:38.902229 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:38.902216    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1261e6f-ca9e-4297-9bdb-77a357c052dd-samples-operator-tls podName:a1261e6f-ca9e-4297-9bdb-77a357c052dd nodeName:}" failed. No retries permitted until 2026-07-13 09:12:39.402193927 +0000 UTC m=+248.480071160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a1261e6f-ca9e-4297-9bdb-77a357c052dd-samples-operator-tls") pod "cluster-samples-operator-65db858894-45npf" (UID: "a1261e6f-ca9e-4297-9bdb-77a357c052dd") : secret "samples-operator-tls" not found
Jul 13 09:12:38.903042 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.903005    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1243d30-2275-43cc-b5a9-a8de5a66beed-trusted-ca\") pod \"console-operator-7866497494-tmbbk\" (UID: \"d1243d30-2275-43cc-b5a9-a8de5a66beed\") " pod="openshift-console-operator/console-operator-7866497494-tmbbk"
Jul 13 09:12:38.904056 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.904036    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1243d30-2275-43cc-b5a9-a8de5a66beed-serving-cert\") pod \"console-operator-7866497494-tmbbk\" (UID: \"d1243d30-2275-43cc-b5a9-a8de5a66beed\") " pod="openshift-console-operator/console-operator-7866497494-tmbbk"
Jul 13 09:12:38.911907 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.911882    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqvh9\" (UniqueName: \"kubernetes.io/projected/a1261e6f-ca9e-4297-9bdb-77a357c052dd-kube-api-access-tqvh9\") pod \"cluster-samples-operator-65db858894-45npf\" (UID: \"a1261e6f-ca9e-4297-9bdb-77a357c052dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45npf"
Jul 13 09:12:38.912852 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.912825    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkwpw\" (UniqueName: \"kubernetes.io/projected/d1243d30-2275-43cc-b5a9-a8de5a66beed-kube-api-access-zkwpw\") pod \"console-operator-7866497494-tmbbk\" (UID: \"d1243d30-2275-43cc-b5a9-a8de5a66beed\") " pod="openshift-console-operator/console-operator-7866497494-tmbbk"
Jul 13 09:12:38.946828 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.946795    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-d6lgc"
Jul 13 09:12:38.957983 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:38.957962    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-k6qjb"
Jul 13 09:12:39.005865 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:39.005823    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ddnmg"]
Jul 13 09:12:39.008334 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:12:39.008294    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f918b89_58ae_4153_a7ba_f73ae80030db.slice/crio-0dabe0accec9940ad296dd0bed1e41c6825d16fbbb676e0d5940684e9b9be6c4 WatchSource:0}: Error finding container 0dabe0accec9940ad296dd0bed1e41c6825d16fbbb676e0d5940684e9b9be6c4: Status 404 returned error can't find the container with id 0dabe0accec9940ad296dd0bed1e41c6825d16fbbb676e0d5940684e9b9be6c4
Jul 13 09:12:39.016401 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:39.016370    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nkjv5"]
Jul 13 09:12:39.027803 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:12:39.026571    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33fa8a0a_8233_4229_8419_61d00b687381.slice/crio-2d1b9262dad4a62bc849490e8ff1c54fcae21d535ec0bf76e363c0649a573998 WatchSource:0}: Error finding container 2d1b9262dad4a62bc849490e8ff1c54fcae21d535ec0bf76e363c0649a573998: Status 404 returned error can't find the container with id 2d1b9262dad4a62bc849490e8ff1c54fcae21d535ec0bf76e363c0649a573998
Jul 13 09:12:39.062384 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:39.062322    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-tmbbk"
Jul 13 09:12:39.085559 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:39.085534    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-d6lgc"]
Jul 13 09:12:39.087982 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:12:39.087953    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaea82529_432f_4d72_af45_cdb9d24228a9.slice/crio-cb77c3f8a67c4035e390140304544139e80d85a0036084155466e1fe45e9a1e6 WatchSource:0}: Error finding container cb77c3f8a67c4035e390140304544139e80d85a0036084155466e1fe45e9a1e6: Status 404 returned error can't find the container with id cb77c3f8a67c4035e390140304544139e80d85a0036084155466e1fe45e9a1e6
Jul 13 09:12:39.101488 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:39.101464    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-k6qjb"]
Jul 13 09:12:39.106983 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:12:39.106956    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc63b1cf8_18be_4229_88d4_de471969a548.slice/crio-958c8f7d211ffcea4aa12b62dc5b7ba8f420e52fe2b7c026d8215b912e7f84df WatchSource:0}: Error finding container 958c8f7d211ffcea4aa12b62dc5b7ba8f420e52fe2b7c026d8215b912e7f84df: Status 404 returned error can't find the container with id 958c8f7d211ffcea4aa12b62dc5b7ba8f420e52fe2b7c026d8215b912e7f84df
Jul 13 09:12:39.178991 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:39.178964    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-k6qjb" event={"ID":"c63b1cf8-18be-4229-88d4-de471969a548","Type":"ContainerStarted","Data":"958c8f7d211ffcea4aa12b62dc5b7ba8f420e52fe2b7c026d8215b912e7f84df"}
Jul 13 09:12:39.180064 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:39.180041    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nkjv5" event={"ID":"33fa8a0a-8233-4229-8419-61d00b687381","Type":"ContainerStarted","Data":"2d1b9262dad4a62bc849490e8ff1c54fcae21d535ec0bf76e363c0649a573998"}
Jul 13 09:12:39.180977 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:39.180948    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-d6lgc" event={"ID":"aea82529-432f-4d72-af45-cdb9d24228a9","Type":"ContainerStarted","Data":"cb77c3f8a67c4035e390140304544139e80d85a0036084155466e1fe45e9a1e6"}
Jul 13 09:12:39.181828 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:39.181810    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ddnmg" event={"ID":"7f918b89-58ae-4153-a7ba-f73ae80030db","Type":"ContainerStarted","Data":"0dabe0accec9940ad296dd0bed1e41c6825d16fbbb676e0d5940684e9b9be6c4"}
Jul 13 09:12:39.187550 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:39.187530    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-tmbbk"]
Jul 13 09:12:39.190201 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:12:39.190181    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1243d30_2275_43cc_b5a9_a8de5a66beed.slice/crio-e6ce659ceaba8b51dc5492dc122a2c4dbd62799da68e4b4c43a3338d581952f2 WatchSource:0}: Error finding container e6ce659ceaba8b51dc5492dc122a2c4dbd62799da68e4b4c43a3338d581952f2: Status 404 returned error can't find the container with id e6ce659ceaba8b51dc5492dc122a2c4dbd62799da68e4b4c43a3338d581952f2
Jul 13 09:12:39.304699 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:39.304659    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/12891776-d5ad-4b5e-9c3c-4285c514c6af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-5wkhg\" (UID: \"12891776-d5ad-4b5e-9c3c-4285c514c6af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5wkhg"
Jul 13 09:12:39.304829 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:39.304810    2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 09:12:39.304886 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:39.304875    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12891776-d5ad-4b5e-9c3c-4285c514c6af-cluster-monitoring-operator-tls podName:12891776-d5ad-4b5e-9c3c-4285c514c6af nodeName:}" failed. No retries permitted until 2026-07-13 09:12:40.304857121 +0000 UTC m=+249.382734355 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/12891776-d5ad-4b5e-9c3c-4285c514c6af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-5wkhg" (UID: "12891776-d5ad-4b5e-9c3c-4285c514c6af") : secret "cluster-monitoring-operator-tls" not found
Jul 13 09:12:39.405248 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:39.405221    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1261e6f-ca9e-4297-9bdb-77a357c052dd-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-45npf\" (UID: \"a1261e6f-ca9e-4297-9bdb-77a357c052dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45npf"
Jul 13 09:12:39.405377 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:39.405360    2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 09:12:39.405460 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:39.405423    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1261e6f-ca9e-4297-9bdb-77a357c052dd-samples-operator-tls podName:a1261e6f-ca9e-4297-9bdb-77a357c052dd nodeName:}" failed. No retries permitted until 2026-07-13 09:12:40.405407883 +0000 UTC m=+249.483285120 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a1261e6f-ca9e-4297-9bdb-77a357c052dd-samples-operator-tls") pod "cluster-samples-operator-65db858894-45npf" (UID: "a1261e6f-ca9e-4297-9bdb-77a357c052dd") : secret "samples-operator-tls" not found
Jul 13 09:12:40.193368 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:40.193322    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-tmbbk" event={"ID":"d1243d30-2275-43cc-b5a9-a8de5a66beed","Type":"ContainerStarted","Data":"e6ce659ceaba8b51dc5492dc122a2c4dbd62799da68e4b4c43a3338d581952f2"}
Jul 13 09:12:40.313640 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:40.313520    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/12891776-d5ad-4b5e-9c3c-4285c514c6af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-5wkhg\" (UID: \"12891776-d5ad-4b5e-9c3c-4285c514c6af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5wkhg"
Jul 13 09:12:40.313842 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:40.313722    2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 09:12:40.313842 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:40.313793    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12891776-d5ad-4b5e-9c3c-4285c514c6af-cluster-monitoring-operator-tls podName:12891776-d5ad-4b5e-9c3c-4285c514c6af nodeName:}" failed. No retries permitted until 2026-07-13 09:12:42.313773039 +0000 UTC m=+251.391650276 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/12891776-d5ad-4b5e-9c3c-4285c514c6af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-5wkhg" (UID: "12891776-d5ad-4b5e-9c3c-4285c514c6af") : secret "cluster-monitoring-operator-tls" not found
Jul 13 09:12:40.414292 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:40.414161    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1261e6f-ca9e-4297-9bdb-77a357c052dd-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-45npf\" (UID: \"a1261e6f-ca9e-4297-9bdb-77a357c052dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45npf"
Jul 13 09:12:40.414292 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:40.414281    2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 09:12:40.414512 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:40.414349    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1261e6f-ca9e-4297-9bdb-77a357c052dd-samples-operator-tls podName:a1261e6f-ca9e-4297-9bdb-77a357c052dd nodeName:}" failed. No retries permitted until 2026-07-13 09:12:42.414331548 +0000 UTC m=+251.492208794 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a1261e6f-ca9e-4297-9bdb-77a357c052dd-samples-operator-tls") pod "cluster-samples-operator-65db858894-45npf" (UID: "a1261e6f-ca9e-4297-9bdb-77a357c052dd") : secret "samples-operator-tls" not found
Jul 13 09:12:41.197939 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:41.197873    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-d6lgc" event={"ID":"aea82529-432f-4d72-af45-cdb9d24228a9","Type":"ContainerStarted","Data":"2341c951c0348cc54a67919fd368db253e76e12a649ffd2630f2a6ec5967a9ae"}
Jul 13 09:12:41.217956 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:41.217899    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-d6lgc" podStartSLOduration=1.763419502 podStartE2EDuration="3.217878246s" totalImagesPullingTime="1.454458744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:12:41.216720774 +0000 UTC m=+250.294598049" watchObservedRunningTime="2026-07-13 09:12:41.217878246 +0000 UTC m=+250.295755503"
Jul 13 09:12:42.330876 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:42.330830    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/12891776-d5ad-4b5e-9c3c-4285c514c6af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-5wkhg\" (UID: \"12891776-d5ad-4b5e-9c3c-4285c514c6af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5wkhg"
Jul 13 09:12:42.331305 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:42.330984    2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 09:12:42.331305 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:42.331055    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12891776-d5ad-4b5e-9c3c-4285c514c6af-cluster-monitoring-operator-tls podName:12891776-d5ad-4b5e-9c3c-4285c514c6af nodeName:}" failed. No retries permitted until 2026-07-13 09:12:46.331038008 +0000 UTC m=+255.408915247 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/12891776-d5ad-4b5e-9c3c-4285c514c6af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-5wkhg" (UID: "12891776-d5ad-4b5e-9c3c-4285c514c6af") : secret "cluster-monitoring-operator-tls" not found
Jul 13 09:12:42.432001 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:42.431961    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1261e6f-ca9e-4297-9bdb-77a357c052dd-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-45npf\" (UID: \"a1261e6f-ca9e-4297-9bdb-77a357c052dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45npf"
Jul 13 09:12:42.432205 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:42.432142    2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 09:12:42.432270 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:42.432221    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1261e6f-ca9e-4297-9bdb-77a357c052dd-samples-operator-tls podName:a1261e6f-ca9e-4297-9bdb-77a357c052dd nodeName:}" failed. No retries permitted until 2026-07-13 09:12:46.432199729 +0000 UTC m=+255.510076962 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a1261e6f-ca9e-4297-9bdb-77a357c052dd-samples-operator-tls") pod "cluster-samples-operator-65db858894-45npf" (UID: "a1261e6f-ca9e-4297-9bdb-77a357c052dd") : secret "samples-operator-tls" not found
Jul 13 09:12:43.205574 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:43.205541    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ddnmg" event={"ID":"7f918b89-58ae-4153-a7ba-f73ae80030db","Type":"ContainerStarted","Data":"7a8c06a664be91699d8d639e153ecf04b6de3ae2a66d45f5f955e627f440630a"}
Jul 13 09:12:43.207196 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:43.207172    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tmbbk_d1243d30-2275-43cc-b5a9-a8de5a66beed/console-operator/0.log"
Jul 13 09:12:43.207305 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:43.207214    2553 generic.go:356] "Generic (PLEG): container finished" podID="d1243d30-2275-43cc-b5a9-a8de5a66beed" containerID="8e4d4aa28e2d88c76d141f0052fc65d2b28a9a216ac627744fbe19f0549ba2a8" exitCode=255
Jul 13 09:12:43.207367 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:43.207303    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-tmbbk" event={"ID":"d1243d30-2275-43cc-b5a9-a8de5a66beed","Type":"ContainerDied","Data":"8e4d4aa28e2d88c76d141f0052fc65d2b28a9a216ac627744fbe19f0549ba2a8"}
Jul 13 09:12:43.207454 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:43.207440    2553 scope.go:117] "RemoveContainer" containerID="8e4d4aa28e2d88c76d141f0052fc65d2b28a9a216ac627744fbe19f0549ba2a8"
Jul 13 09:12:43.208807 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:43.208785    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-k6qjb" event={"ID":"c63b1cf8-18be-4229-88d4-de471969a548","Type":"ContainerStarted","Data":"9b31dbde04d439b5d4a3301132bacd6d3c30cbc5a3ba44631fadb6a26845d041"}
Jul 13 09:12:43.210347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:43.210327    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nkjv5" event={"ID":"33fa8a0a-8233-4229-8419-61d00b687381","Type":"ContainerStarted","Data":"ff5452abd49dc004db1951d9be6b6a9426b7c610db27ea902823d0a5d089c337"}
Jul 13 09:12:43.223960 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:43.223916    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ddnmg" podStartSLOduration=1.619671028 podStartE2EDuration="5.223897844s" totalImagesPullingTime="3.604226816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:12:43.223270462 +0000 UTC m=+252.301147719" watchObservedRunningTime="2026-07-13 09:12:43.223897844 +0000 UTC m=+252.301775098"
Jul 13 09:12:43.239584 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:43.239545    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs\") pod \"network-metrics-daemon-rrhxd\" (UID: \"caf4af40-8763-4401-8dd4-dfe646c17704\") " pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:12:43.241916 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:43.241890    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 13 09:12:43.242726 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:43.242704    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs podName:caf4af40-8763-4401-8dd4-dfe646c17704 nodeName:}" failed. No retries permitted until 2026-07-13 09:14:45.242644282 +0000 UTC m=+374.320521530 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs") pod "network-metrics-daemon-rrhxd" (UID: "caf4af40-8763-4401-8dd4-dfe646c17704") : secret "metrics-daemon-secret" not found
Jul 13 09:12:43.244621 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:43.244568    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nkjv5" podStartSLOduration=1.6547798980000001 podStartE2EDuration="5.244548564s" totalImagesPullingTime="3.589768666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:12:43.242484926 +0000 UTC m=+252.320362223" watchObservedRunningTime="2026-07-13 09:12:43.244548564 +0000 UTC m=+252.322425881"
Jul 13 09:12:43.280233 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:43.280189    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-k6qjb" podStartSLOduration=1.7674686990000001 podStartE2EDuration="5.280174822s" totalImagesPullingTime="3.512706123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:12:43.279392817 +0000 UTC m=+252.357270072" watchObservedRunningTime="2026-07-13 09:12:43.280174822 +0000 UTC m=+252.358052077"
Jul 13 09:12:43.887279 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:43.887189    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tgl6j"]
Jul 13 09:12:43.889803 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:43.889779    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:43.895239 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:43.895215    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 13 09:12:43.895486 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:43.895466    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 13 09:12:43.896898 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:43.896776    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kg5m9\""
Jul 13 09:12:43.945126 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:43.945083    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1badcca5-97df-45ad-ae75-116c7d043994-crio-socket\") pod \"insights-runtime-extractor-tgl6j\" (UID: \"1badcca5-97df-45ad-ae75-116c7d043994\") " pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:43.945309 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:43.945127    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1badcca5-97df-45ad-ae75-116c7d043994-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tgl6j\" (UID: \"1badcca5-97df-45ad-ae75-116c7d043994\") " pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:43.945309 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:43.945185    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5kc5\" (UniqueName: \"kubernetes.io/projected/1badcca5-97df-45ad-ae75-116c7d043994-kube-api-access-j5kc5\") pod \"insights-runtime-extractor-tgl6j\" (UID: \"1badcca5-97df-45ad-ae75-116c7d043994\") " pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:43.945309 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:43.945211    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1badcca5-97df-45ad-ae75-116c7d043994-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tgl6j\" (UID: \"1badcca5-97df-45ad-ae75-116c7d043994\") " pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:43.945445 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:43.945312    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1badcca5-97df-45ad-ae75-116c7d043994-data-volume\") pod \"insights-runtime-extractor-tgl6j\" (UID: \"1badcca5-97df-45ad-ae75-116c7d043994\") " pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:43.957296 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:43.957265    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tgl6j"]
Jul 13 09:12:44.046405 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:44.046366    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1badcca5-97df-45ad-ae75-116c7d043994-crio-socket\") pod \"insights-runtime-extractor-tgl6j\" (UID: \"1badcca5-97df-45ad-ae75-116c7d043994\") " pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:44.046405 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:44.046410    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1badcca5-97df-45ad-ae75-116c7d043994-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tgl6j\" (UID: \"1badcca5-97df-45ad-ae75-116c7d043994\") " pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:44.046599 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:44.046481    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 09:12:44.046599 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:44.046498    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1badcca5-97df-45ad-ae75-116c7d043994-crio-socket\") pod \"insights-runtime-extractor-tgl6j\" (UID: \"1badcca5-97df-45ad-ae75-116c7d043994\") " pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:44.046599 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:44.046539    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1badcca5-97df-45ad-ae75-116c7d043994-kube-rbac-proxy-cm podName:1badcca5-97df-45ad-ae75-116c7d043994 nodeName:}" failed. No retries permitted until 2026-07-13 09:12:44.546523402 +0000 UTC m=+253.624400638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1badcca5-97df-45ad-ae75-116c7d043994-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tgl6j" (UID: "1badcca5-97df-45ad-ae75-116c7d043994") : configmap "kube-rbac-proxy" not found
Jul 13 09:12:44.046723 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:44.046618    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5kc5\" (UniqueName: \"kubernetes.io/projected/1badcca5-97df-45ad-ae75-116c7d043994-kube-api-access-j5kc5\") pod \"insights-runtime-extractor-tgl6j\" (UID: \"1badcca5-97df-45ad-ae75-116c7d043994\") " pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:44.046723 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:44.046643    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1badcca5-97df-45ad-ae75-116c7d043994-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tgl6j\" (UID: \"1badcca5-97df-45ad-ae75-116c7d043994\") " pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:44.046723 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:44.046679    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1badcca5-97df-45ad-ae75-116c7d043994-data-volume\") pod \"insights-runtime-extractor-tgl6j\" (UID: \"1badcca5-97df-45ad-ae75-116c7d043994\") " pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:44.046826 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:44.046795    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 09:12:44.046858 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:44.046851    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1badcca5-97df-45ad-ae75-116c7d043994-insights-runtime-extractor-tls podName:1badcca5-97df-45ad-ae75-116c7d043994 nodeName:}" failed. No retries permitted until 2026-07-13 09:12:44.546822734 +0000 UTC m=+253.624699971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1badcca5-97df-45ad-ae75-116c7d043994-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tgl6j" (UID: "1badcca5-97df-45ad-ae75-116c7d043994") : secret "insights-runtime-extractor-tls" not found
Jul 13 09:12:44.047036 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:44.047020    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1badcca5-97df-45ad-ae75-116c7d043994-data-volume\") pod \"insights-runtime-extractor-tgl6j\" (UID: \"1badcca5-97df-45ad-ae75-116c7d043994\") " pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:44.056496 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:44.056465    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5kc5\" (UniqueName: \"kubernetes.io/projected/1badcca5-97df-45ad-ae75-116c7d043994-kube-api-access-j5kc5\") pod \"insights-runtime-extractor-tgl6j\" (UID: \"1badcca5-97df-45ad-ae75-116c7d043994\") " pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:44.214862 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:44.214793    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tmbbk_d1243d30-2275-43cc-b5a9-a8de5a66beed/console-operator/1.log"
Jul 13 09:12:44.215143 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:44.215128    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tmbbk_d1243d30-2275-43cc-b5a9-a8de5a66beed/console-operator/0.log"
Jul 13 09:12:44.215190 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:44.215161    2553 generic.go:356] "Generic (PLEG): container finished" podID="d1243d30-2275-43cc-b5a9-a8de5a66beed" containerID="fe40bfa2fab5fdec73ac997959562168e38df5d7ca7347b6dfa533451424a264" exitCode=255
Jul 13 09:12:44.215228 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:44.215193    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-tmbbk" event={"ID":"d1243d30-2275-43cc-b5a9-a8de5a66beed","Type":"ContainerDied","Data":"fe40bfa2fab5fdec73ac997959562168e38df5d7ca7347b6dfa533451424a264"}
Jul 13 09:12:44.215270 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:44.215249    2553 scope.go:117] "RemoveContainer" containerID="8e4d4aa28e2d88c76d141f0052fc65d2b28a9a216ac627744fbe19f0549ba2a8"
Jul 13 09:12:44.215450 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:44.215423    2553 scope.go:117] "RemoveContainer" containerID="fe40bfa2fab5fdec73ac997959562168e38df5d7ca7347b6dfa533451424a264"
Jul 13 09:12:44.215645 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:44.215620    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-tmbbk_openshift-console-operator(d1243d30-2275-43cc-b5a9-a8de5a66beed)\"" pod="openshift-console-operator/console-operator-7866497494-tmbbk" podUID="d1243d30-2275-43cc-b5a9-a8de5a66beed"
Jul 13 09:12:44.552002 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:44.551914    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1badcca5-97df-45ad-ae75-116c7d043994-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tgl6j\" (UID: \"1badcca5-97df-45ad-ae75-116c7d043994\") " pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:44.552163 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:44.552015    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1badcca5-97df-45ad-ae75-116c7d043994-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tgl6j\" (UID: \"1badcca5-97df-45ad-ae75-116c7d043994\") " pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:44.552163 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:44.552069    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 09:12:44.552163 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:44.552084    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 09:12:44.552163 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:44.552143    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1badcca5-97df-45ad-ae75-116c7d043994-kube-rbac-proxy-cm podName:1badcca5-97df-45ad-ae75-116c7d043994 nodeName:}" failed. No retries permitted until 2026-07-13 09:12:45.552128211 +0000 UTC m=+254.630005443 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1badcca5-97df-45ad-ae75-116c7d043994-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tgl6j" (UID: "1badcca5-97df-45ad-ae75-116c7d043994") : configmap "kube-rbac-proxy" not found
Jul 13 09:12:44.552163 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:44.552157    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1badcca5-97df-45ad-ae75-116c7d043994-insights-runtime-extractor-tls podName:1badcca5-97df-45ad-ae75-116c7d043994 nodeName:}" failed. No retries permitted until 2026-07-13 09:12:45.552150982 +0000 UTC m=+254.630028214 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1badcca5-97df-45ad-ae75-116c7d043994-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tgl6j" (UID: "1badcca5-97df-45ad-ae75-116c7d043994") : secret "insights-runtime-extractor-tls" not found
Jul 13 09:12:44.823140 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:44.823059    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2q9cd"]
Jul 13 09:12:44.826093 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:44.826077    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2q9cd"
Jul 13 09:12:44.831324 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:44.831298    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 13 09:12:44.831324 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:44.831313    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 13 09:12:44.831523 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:44.831368    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-t42cc\""
Jul 13 09:12:44.838665 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:44.838647    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2q9cd"]
Jul 13 09:12:44.854765 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:44.854742    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdx72\" (UniqueName: \"kubernetes.io/projected/e9a2b636-7547-473a-a5e1-692f5fc76f01-kube-api-access-zdx72\") pod \"migrator-7f59b54f6c-2q9cd\" (UID: \"e9a2b636-7547-473a-a5e1-692f5fc76f01\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2q9cd"
Jul 13 09:12:44.955380 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:44.955346    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdx72\" (UniqueName: \"kubernetes.io/projected/e9a2b636-7547-473a-a5e1-692f5fc76f01-kube-api-access-zdx72\") pod \"migrator-7f59b54f6c-2q9cd\" (UID: \"e9a2b636-7547-473a-a5e1-692f5fc76f01\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2q9cd"
Jul 13 09:12:44.964474 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:44.964438    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdx72\" (UniqueName: \"kubernetes.io/projected/e9a2b636-7547-473a-a5e1-692f5fc76f01-kube-api-access-zdx72\") pod \"migrator-7f59b54f6c-2q9cd\" (UID: \"e9a2b636-7547-473a-a5e1-692f5fc76f01\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2q9cd"
Jul 13 09:12:45.135644 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:45.135611    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2q9cd"
Jul 13 09:12:45.219789 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:45.219750    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tmbbk_d1243d30-2275-43cc-b5a9-a8de5a66beed/console-operator/1.log"
Jul 13 09:12:45.220274 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:45.220188    2553 scope.go:117] "RemoveContainer" containerID="fe40bfa2fab5fdec73ac997959562168e38df5d7ca7347b6dfa533451424a264"
Jul 13 09:12:45.220395 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:45.220366    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-tmbbk_openshift-console-operator(d1243d30-2275-43cc-b5a9-a8de5a66beed)\"" pod="openshift-console-operator/console-operator-7866497494-tmbbk" podUID="d1243d30-2275-43cc-b5a9-a8de5a66beed"
Jul 13 09:12:45.261018 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:45.260991    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2q9cd"]
Jul 13 09:12:45.264173 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:12:45.264150    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9a2b636_7547_473a_a5e1_692f5fc76f01.slice/crio-f7b789e01205729cbf259cd751c244f22e1211bdd43efe9741996e96d317de3e WatchSource:0}: Error finding container f7b789e01205729cbf259cd751c244f22e1211bdd43efe9741996e96d317de3e: Status 404 returned error can't find the container with id f7b789e01205729cbf259cd751c244f22e1211bdd43efe9741996e96d317de3e
Jul 13 09:12:45.560850 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:45.560761    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1badcca5-97df-45ad-ae75-116c7d043994-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tgl6j\" (UID: \"1badcca5-97df-45ad-ae75-116c7d043994\") " pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:45.561002 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:45.560866    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1badcca5-97df-45ad-ae75-116c7d043994-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tgl6j\" (UID: \"1badcca5-97df-45ad-ae75-116c7d043994\") " pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:45.561002 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:45.560909    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 09:12:45.561002 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:45.560934    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 09:12:45.561002 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:45.560978    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1badcca5-97df-45ad-ae75-116c7d043994-insights-runtime-extractor-tls podName:1badcca5-97df-45ad-ae75-116c7d043994 nodeName:}" failed. No retries permitted until 2026-07-13 09:12:47.560961563 +0000 UTC m=+256.638838801 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1badcca5-97df-45ad-ae75-116c7d043994-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tgl6j" (UID: "1badcca5-97df-45ad-ae75-116c7d043994") : secret "insights-runtime-extractor-tls" not found
Jul 13 09:12:45.561002 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:45.560993    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1badcca5-97df-45ad-ae75-116c7d043994-kube-rbac-proxy-cm podName:1badcca5-97df-45ad-ae75-116c7d043994 nodeName:}" failed. No retries permitted until 2026-07-13 09:12:47.560986885 +0000 UTC m=+256.638864118 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1badcca5-97df-45ad-ae75-116c7d043994-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tgl6j" (UID: "1badcca5-97df-45ad-ae75-116c7d043994") : configmap "kube-rbac-proxy" not found
Jul 13 09:12:45.691557 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:45.691528    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-btlb4_85e00737-0392-4971-b5bb-0eb2d8f14e5f/dns-node-resolver/0.log"
Jul 13 09:12:46.224701 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:46.224647    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2q9cd" event={"ID":"e9a2b636-7547-473a-a5e1-692f5fc76f01","Type":"ContainerStarted","Data":"f7b789e01205729cbf259cd751c244f22e1211bdd43efe9741996e96d317de3e"}
Jul 13 09:12:46.367592 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:46.367557    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/12891776-d5ad-4b5e-9c3c-4285c514c6af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-5wkhg\" (UID: \"12891776-d5ad-4b5e-9c3c-4285c514c6af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5wkhg"
Jul 13 09:12:46.367825 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:46.367762    2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 09:12:46.367897 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:46.367831    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12891776-d5ad-4b5e-9c3c-4285c514c6af-cluster-monitoring-operator-tls podName:12891776-d5ad-4b5e-9c3c-4285c514c6af nodeName:}" failed. No retries permitted until 2026-07-13 09:12:54.367811903 +0000 UTC m=+263.445689141 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/12891776-d5ad-4b5e-9c3c-4285c514c6af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-5wkhg" (UID: "12891776-d5ad-4b5e-9c3c-4285c514c6af") : secret "cluster-monitoring-operator-tls" not found
Jul 13 09:12:46.468261 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:46.468230    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1261e6f-ca9e-4297-9bdb-77a357c052dd-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-45npf\" (UID: \"a1261e6f-ca9e-4297-9bdb-77a357c052dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45npf"
Jul 13 09:12:46.468422 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:46.468398    2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 09:12:46.468509 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:46.468480    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1261e6f-ca9e-4297-9bdb-77a357c052dd-samples-operator-tls podName:a1261e6f-ca9e-4297-9bdb-77a357c052dd nodeName:}" failed. No retries permitted until 2026-07-13 09:12:54.468457342 +0000 UTC m=+263.546334576 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a1261e6f-ca9e-4297-9bdb-77a357c052dd-samples-operator-tls") pod "cluster-samples-operator-65db858894-45npf" (UID: "a1261e6f-ca9e-4297-9bdb-77a357c052dd") : secret "samples-operator-tls" not found
Jul 13 09:12:46.692388 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:46.692360    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9qslx_f477a535-0e7f-45e0-9889-b30d8e06abc0/node-ca/0.log"
Jul 13 09:12:47.229387 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:47.229353    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2q9cd" event={"ID":"e9a2b636-7547-473a-a5e1-692f5fc76f01","Type":"ContainerStarted","Data":"6b54101c733b0828ec8492d657d52b46030c165a3480509f504af64de8070e27"}
Jul 13 09:12:47.229796 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:47.229404    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2q9cd" event={"ID":"e9a2b636-7547-473a-a5e1-692f5fc76f01","Type":"ContainerStarted","Data":"82cd7ef1ea89da3d79a8997cac8448d792970de294a9792710413ec952e67660"}
Jul 13 09:12:47.246634 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:47.246578    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2q9cd" podStartSLOduration=2.108883441 podStartE2EDuration="3.246558654s" totalImagesPullingTime="1.137675213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:12:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:12:47.246526258 +0000 UTC m=+256.324403512" watchObservedRunningTime="2026-07-13 09:12:47.246558654 +0000 UTC m=+256.324435896"
Jul 13 09:12:47.491263 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:47.491189    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8wp8c_5e28a544-d35a-4036-bab4-87432d8949f9/serve-healthcheck-canary/0.log"
Jul 13 09:12:47.578025 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:47.577986    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1badcca5-97df-45ad-ae75-116c7d043994-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tgl6j\" (UID: \"1badcca5-97df-45ad-ae75-116c7d043994\") " pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:47.578212 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:47.578109    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1badcca5-97df-45ad-ae75-116c7d043994-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tgl6j\" (UID: \"1badcca5-97df-45ad-ae75-116c7d043994\") " pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:47.578212 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:47.578129    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 09:12:47.578212 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:47.578188    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1badcca5-97df-45ad-ae75-116c7d043994-insights-runtime-extractor-tls podName:1badcca5-97df-45ad-ae75-116c7d043994 nodeName:}" failed. No retries permitted until 2026-07-13 09:12:51.578172802 +0000 UTC m=+260.656050035 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1badcca5-97df-45ad-ae75-116c7d043994-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tgl6j" (UID: "1badcca5-97df-45ad-ae75-116c7d043994") : secret "insights-runtime-extractor-tls" not found
Jul 13 09:12:47.578340 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:47.578230    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 09:12:47.578340 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:47.578288    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1badcca5-97df-45ad-ae75-116c7d043994-kube-rbac-proxy-cm podName:1badcca5-97df-45ad-ae75-116c7d043994 nodeName:}" failed. No retries permitted until 2026-07-13 09:12:51.57827292 +0000 UTC m=+260.656150159 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1badcca5-97df-45ad-ae75-116c7d043994-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tgl6j" (UID: "1badcca5-97df-45ad-ae75-116c7d043994") : configmap "kube-rbac-proxy" not found
Jul 13 09:12:49.063179 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:49.063150    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-tmbbk"
Jul 13 09:12:49.063524 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:49.063204    2553 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-tmbbk"
Jul 13 09:12:49.063524 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:49.063513    2553 scope.go:117] "RemoveContainer" containerID="fe40bfa2fab5fdec73ac997959562168e38df5d7ca7347b6dfa533451424a264"
Jul 13 09:12:49.063667 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:49.063649    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-tmbbk_openshift-console-operator(d1243d30-2275-43cc-b5a9-a8de5a66beed)\"" pod="openshift-console-operator/console-operator-7866497494-tmbbk" podUID="d1243d30-2275-43cc-b5a9-a8de5a66beed"
Jul 13 09:12:51.609927 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:51.609885    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1badcca5-97df-45ad-ae75-116c7d043994-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tgl6j\" (UID: \"1badcca5-97df-45ad-ae75-116c7d043994\") " pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:51.610394 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:51.610078    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 09:12:51.610394 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:51.610129    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1badcca5-97df-45ad-ae75-116c7d043994-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tgl6j\" (UID: \"1badcca5-97df-45ad-ae75-116c7d043994\") " pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:51.610394 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:51.610155    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1badcca5-97df-45ad-ae75-116c7d043994-insights-runtime-extractor-tls podName:1badcca5-97df-45ad-ae75-116c7d043994 nodeName:}" failed. No retries permitted until 2026-07-13 09:12:59.610134576 +0000 UTC m=+268.688011813 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1badcca5-97df-45ad-ae75-116c7d043994-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tgl6j" (UID: "1badcca5-97df-45ad-ae75-116c7d043994") : secret "insights-runtime-extractor-tls" not found
Jul 13 09:12:51.610394 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:51.610189    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 09:12:51.610394 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:51.610236    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1badcca5-97df-45ad-ae75-116c7d043994-kube-rbac-proxy-cm podName:1badcca5-97df-45ad-ae75-116c7d043994 nodeName:}" failed. No retries permitted until 2026-07-13 09:12:59.610224534 +0000 UTC m=+268.688101767 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1badcca5-97df-45ad-ae75-116c7d043994-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tgl6j" (UID: "1badcca5-97df-45ad-ae75-116c7d043994") : configmap "kube-rbac-proxy" not found
Jul 13 09:12:54.433966 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:54.433882    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/12891776-d5ad-4b5e-9c3c-4285c514c6af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-5wkhg\" (UID: \"12891776-d5ad-4b5e-9c3c-4285c514c6af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5wkhg"
Jul 13 09:12:54.434347 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:54.434005    2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 09:12:54.434347 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:12:54.434074    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12891776-d5ad-4b5e-9c3c-4285c514c6af-cluster-monitoring-operator-tls podName:12891776-d5ad-4b5e-9c3c-4285c514c6af nodeName:}" failed. No retries permitted until 2026-07-13 09:13:10.434056205 +0000 UTC m=+279.511933438 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/12891776-d5ad-4b5e-9c3c-4285c514c6af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-5wkhg" (UID: "12891776-d5ad-4b5e-9c3c-4285c514c6af") : secret "cluster-monitoring-operator-tls" not found
Jul 13 09:12:54.534365 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:54.534334    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1261e6f-ca9e-4297-9bdb-77a357c052dd-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-45npf\" (UID: \"a1261e6f-ca9e-4297-9bdb-77a357c052dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45npf"
Jul 13 09:12:54.536734 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:54.536712    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1261e6f-ca9e-4297-9bdb-77a357c052dd-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-45npf\" (UID: \"a1261e6f-ca9e-4297-9bdb-77a357c052dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45npf"
Jul 13 09:12:54.657182 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:54.657139    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45npf"
Jul 13 09:12:54.780297 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:54.780269    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45npf"]
Jul 13 09:12:55.254564 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:55.254527    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45npf" event={"ID":"a1261e6f-ca9e-4297-9bdb-77a357c052dd","Type":"ContainerStarted","Data":"f094f65a74f480d21ace8d5909e562ded7f2e6f087f3aba502812b71b421dc9b"}
Jul 13 09:12:57.262722 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:57.262670    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45npf" event={"ID":"a1261e6f-ca9e-4297-9bdb-77a357c052dd","Type":"ContainerStarted","Data":"d88c55d76eb253a7be5fbfa84497b2beaab1259035f56982f521236e8ffc6ef7"}
Jul 13 09:12:57.263204 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:57.262778    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45npf" event={"ID":"a1261e6f-ca9e-4297-9bdb-77a357c052dd","Type":"ContainerStarted","Data":"d3b90e0089744986014bed0c749ef673f237ec11c56776781301069fab46ec25"}
Jul 13 09:12:57.280673 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:57.280618    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-45npf" podStartSLOduration=17.788609643 podStartE2EDuration="19.2806027s" totalImagesPullingTime="1.491993057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:12:57.279108987 +0000 UTC m=+266.356986241" watchObservedRunningTime="2026-07-13 09:12:57.2806027 +0000 UTC m=+266.358479955"
Jul 13 09:12:59.677791 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:59.677757    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1badcca5-97df-45ad-ae75-116c7d043994-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tgl6j\" (UID: \"1badcca5-97df-45ad-ae75-116c7d043994\") " pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:59.678255 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:59.677812    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1badcca5-97df-45ad-ae75-116c7d043994-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tgl6j\" (UID: \"1badcca5-97df-45ad-ae75-116c7d043994\") " pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:59.678305 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:59.678285    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1badcca5-97df-45ad-ae75-116c7d043994-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tgl6j\" (UID: \"1badcca5-97df-45ad-ae75-116c7d043994\") " pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:59.680007 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:59.679982    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1badcca5-97df-45ad-ae75-116c7d043994-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tgl6j\" (UID: \"1badcca5-97df-45ad-ae75-116c7d043994\") " pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:59.800601 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:59.800572    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tgl6j"
Jul 13 09:12:59.926541 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:12:59.926517    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tgl6j"]
Jul 13 09:12:59.929077 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:12:59.929025    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1badcca5_97df_45ad_ae75_116c7d043994.slice/crio-2c25a09b557aeabd1dc2083f5a49f3cf2e98f3ec506dbd792081e7574a909921 WatchSource:0}: Error finding container 2c25a09b557aeabd1dc2083f5a49f3cf2e98f3ec506dbd792081e7574a909921: Status 404 returned error can't find the container with id 2c25a09b557aeabd1dc2083f5a49f3cf2e98f3ec506dbd792081e7574a909921
Jul 13 09:13:00.273736 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:00.273627    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tgl6j" event={"ID":"1badcca5-97df-45ad-ae75-116c7d043994","Type":"ContainerStarted","Data":"2c25a09b557aeabd1dc2083f5a49f3cf2e98f3ec506dbd792081e7574a909921"}
Jul 13 09:13:00.476306 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:00.475932    2553 scope.go:117] "RemoveContainer" containerID="fe40bfa2fab5fdec73ac997959562168e38df5d7ca7347b6dfa533451424a264"
Jul 13 09:13:01.279376 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:01.279346    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tmbbk_d1243d30-2275-43cc-b5a9-a8de5a66beed/console-operator/1.log"
Jul 13 09:13:01.279819 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:01.279446    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-tmbbk" event={"ID":"d1243d30-2275-43cc-b5a9-a8de5a66beed","Type":"ContainerStarted","Data":"36291b7ad623f4b1e63b9bad6f4311d396b3e6d094b4f3b1c7498ef688b5f0b4"}
Jul 13 09:13:01.279819 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:01.279794    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-tmbbk"
Jul 13 09:13:01.299328 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:01.299273    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-tmbbk" podStartSLOduration=19.87218471 podStartE2EDuration="23.299255679s" totalImagesPullingTime="3.427070969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:13:01.299049821 +0000 UTC m=+270.376927100" watchObservedRunningTime="2026-07-13 09:13:01.299255679 +0000 UTC m=+270.377132935"
Jul 13 09:13:01.343089 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:01.343060    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-tmbbk"
Jul 13 09:13:04.289703 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:04.289658    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tgl6j" event={"ID":"1badcca5-97df-45ad-ae75-116c7d043994","Type":"ContainerStarted","Data":"4aa8cc2209ae429d86349eaa7b8cbd1fb8c8131db2bb6de85e3b39e4445ef974"}
Jul 13 09:13:05.294851 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:05.294816    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tgl6j" event={"ID":"1badcca5-97df-45ad-ae75-116c7d043994","Type":"ContainerStarted","Data":"434a0573733f4eef6e29fe2bd3c652ec2e9370523bd94835870bb679623aa5a5"}
Jul 13 09:13:08.306148 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:08.306112    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tgl6j" event={"ID":"1badcca5-97df-45ad-ae75-116c7d043994","Type":"ContainerStarted","Data":"873092bfb47d843a3499b214ef303fc0dd9b244ba27a85f433f8420c6fc90e29"}
Jul 13 09:13:09.513265 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:09.513207    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tgl6j" podStartSLOduration=19.122891208 podStartE2EDuration="26.513187537s" totalImagesPullingTime="7.390296329s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 09:12:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:13:08.325145638 +0000 UTC m=+277.403022894" watchObservedRunningTime="2026-07-13 09:13:09.513187537 +0000 UTC m=+278.591064792"
Jul 13 09:13:09.514543 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:09.514519    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-kgcg7"]
Jul 13 09:13:09.516565 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:09.516546    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-kgcg7"
Jul 13 09:13:09.519937 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:09.519915    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 13 09:13:09.520385 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:09.520369    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-4llz2\""
Jul 13 09:13:09.521128 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:09.521109    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 13 09:13:09.539262 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:09.539234    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-kgcg7"]
Jul 13 09:13:09.668339 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:09.668309    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxs2c\" (UniqueName: \"kubernetes.io/projected/d706057a-268b-42c4-ac26-67fd4330f9d9-kube-api-access-sxs2c\") pod \"downloads-68c9cbb497-kgcg7\" (UID: \"d706057a-268b-42c4-ac26-67fd4330f9d9\") " pod="openshift-console/downloads-68c9cbb497-kgcg7"
Jul 13 09:13:09.769267 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:09.769196    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxs2c\" (UniqueName: \"kubernetes.io/projected/d706057a-268b-42c4-ac26-67fd4330f9d9-kube-api-access-sxs2c\") pod \"downloads-68c9cbb497-kgcg7\" (UID: \"d706057a-268b-42c4-ac26-67fd4330f9d9\") " pod="openshift-console/downloads-68c9cbb497-kgcg7"
Jul 13 09:13:09.778852 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:09.778822    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxs2c\" (UniqueName: \"kubernetes.io/projected/d706057a-268b-42c4-ac26-67fd4330f9d9-kube-api-access-sxs2c\") pod \"downloads-68c9cbb497-kgcg7\" (UID: \"d706057a-268b-42c4-ac26-67fd4330f9d9\") " pod="openshift-console/downloads-68c9cbb497-kgcg7"
Jul 13 09:13:09.825090 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:09.825018    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-kgcg7"
Jul 13 09:13:09.948367 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:09.948314    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-kgcg7"]
Jul 13 09:13:09.951607 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:13:09.951579    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd706057a_268b_42c4_ac26_67fd4330f9d9.slice/crio-0b9e11e2249fafe9c9b942c38133402970d8d76e108ea8a772479e8c0344f201 WatchSource:0}: Error finding container 0b9e11e2249fafe9c9b942c38133402970d8d76e108ea8a772479e8c0344f201: Status 404 returned error can't find the container with id 0b9e11e2249fafe9c9b942c38133402970d8d76e108ea8a772479e8c0344f201
Jul 13 09:13:10.317299 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:10.317266    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-kgcg7" event={"ID":"d706057a-268b-42c4-ac26-67fd4330f9d9","Type":"ContainerStarted","Data":"0b9e11e2249fafe9c9b942c38133402970d8d76e108ea8a772479e8c0344f201"}
Jul 13 09:13:10.477001 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:10.476968    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/12891776-d5ad-4b5e-9c3c-4285c514c6af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-5wkhg\" (UID: \"12891776-d5ad-4b5e-9c3c-4285c514c6af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5wkhg"
Jul 13 09:13:10.479736 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:10.479706    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/12891776-d5ad-4b5e-9c3c-4285c514c6af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-5wkhg\" (UID: \"12891776-d5ad-4b5e-9c3c-4285c514c6af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5wkhg"
Jul 13 09:13:10.766312 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:10.766277    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5wkhg"
Jul 13 09:13:10.902621 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:10.902590    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5wkhg"]
Jul 13 09:13:10.906037 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:13:10.906004    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12891776_d5ad_4b5e_9c3c_4285c514c6af.slice/crio-71d47dfb572c2453d046f999808b8a07ed415090bc826e7dd0ab8f38f1005056 WatchSource:0}: Error finding container 71d47dfb572c2453d046f999808b8a07ed415090bc826e7dd0ab8f38f1005056: Status 404 returned error can't find the container with id 71d47dfb572c2453d046f999808b8a07ed415090bc826e7dd0ab8f38f1005056
Jul 13 09:13:11.322019 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:11.321987    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5wkhg" event={"ID":"12891776-d5ad-4b5e-9c3c-4285c514c6af","Type":"ContainerStarted","Data":"71d47dfb572c2453d046f999808b8a07ed415090bc826e7dd0ab8f38f1005056"}
Jul 13 09:13:13.331387 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:13.331351    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5wkhg" event={"ID":"12891776-d5ad-4b5e-9c3c-4285c514c6af","Type":"ContainerStarted","Data":"4828d81968b275672f5055e8bbaa4eb4c459eb22ff02d774882235aa9ba824a9"}
Jul 13 09:13:13.352577 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:13.352530    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5wkhg" podStartSLOduration=33.413715067 podStartE2EDuration="35.352509464s" totalImagesPullingTime="1.938794397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:13:13.350408458 +0000 UTC m=+282.428285738" watchObservedRunningTime="2026-07-13 09:13:13.352509464 +0000 UTC m=+282.430386720"
Jul 13 09:13:14.975807 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:13:14.975759    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn" podUID="eaa1f1f3-ea75-4c49-8ada-3cbe5125009d"
Jul 13 09:13:14.975807 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:13:14.975768    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-hfv8k" podUID="6485b81d-8dac-4cab-8f1a-653e0116ba01"
Jul 13 09:13:15.339191 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:15.339116    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-hfv8k"
Jul 13 09:13:15.339336 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:15.339124    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:13:18.646252 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:18.646207    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-hfv8k\" (UID: \"6485b81d-8dac-4cab-8f1a-653e0116ba01\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hfv8k"
Jul 13 09:13:18.649123 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:18.649098    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6485b81d-8dac-4cab-8f1a-653e0116ba01-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-hfv8k\" (UID: \"6485b81d-8dac-4cab-8f1a-653e0116ba01\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-hfv8k"
Jul 13 09:13:18.747231 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:18.747196    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:13:18.747406 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:18.747317    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls\") pod \"dns-default-vrnb8\" (UID: \"382f0622-3acb-41c7-a231-3b688b8c212e\") " pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:13:18.749931 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:18.749868    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/382f0622-3acb-41c7-a231-3b688b8c212e-metrics-tls\") pod \"dns-default-vrnb8\" (UID: \"382f0622-3acb-41c7-a231-3b688b8c212e\") " pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:13:18.750053 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:18.750006    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls\") pod \"image-registry-6479ff8fc8-x4bkn\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") " pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:13:18.879627 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:18.879591    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jbvrj\""
Jul 13 09:13:18.886948 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:18.886917    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:13:18.943127 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:18.942937    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qppg4\""
Jul 13 09:13:18.943127 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:18.942995    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zh9fs\""
Jul 13 09:13:18.950321 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:18.950250    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-hfv8k"
Jul 13 09:13:18.950453 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:18.950338    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:13:19.043534 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:19.043462    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vrnb8"]
Jul 13 09:13:19.045680 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:13:19.045657    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod382f0622_3acb_41c7_a231_3b688b8c212e.slice/crio-c9e79c4c3903860449c3a730583e1721f703a6cbe77d137142c9d7f94a87d9db WatchSource:0}: Error finding container c9e79c4c3903860449c3a730583e1721f703a6cbe77d137142c9d7f94a87d9db: Status 404 returned error can't find the container with id c9e79c4c3903860449c3a730583e1721f703a6cbe77d137142c9d7f94a87d9db
Jul 13 09:13:19.115233 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:19.115207    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-hfv8k"]
Jul 13 09:13:19.118814 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:13:19.118784    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6485b81d_8dac_4cab_8f1a_653e0116ba01.slice/crio-80a786fa4ae521aea89aae5fcffb47bc9637ea2f16531ed021022833db873d2a WatchSource:0}: Error finding container 80a786fa4ae521aea89aae5fcffb47bc9637ea2f16531ed021022833db873d2a: Status 404 returned error can't find the container with id 80a786fa4ae521aea89aae5fcffb47bc9637ea2f16531ed021022833db873d2a
Jul 13 09:13:19.132560 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:19.132534    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6479ff8fc8-x4bkn"]
Jul 13 09:13:19.135771 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:13:19.135745    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaa1f1f3_ea75_4c49_8ada_3cbe5125009d.slice/crio-ba67b98a121a6d52621f9c23e450e5d4198277df9900a70307dcb4d7df559219 WatchSource:0}: Error finding container ba67b98a121a6d52621f9c23e450e5d4198277df9900a70307dcb4d7df559219: Status 404 returned error can't find the container with id ba67b98a121a6d52621f9c23e450e5d4198277df9900a70307dcb4d7df559219
Jul 13 09:13:19.354289 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:19.354250    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vrnb8" event={"ID":"382f0622-3acb-41c7-a231-3b688b8c212e","Type":"ContainerStarted","Data":"c9e79c4c3903860449c3a730583e1721f703a6cbe77d137142c9d7f94a87d9db"}
Jul 13 09:13:19.356434 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:19.356403    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn" event={"ID":"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d","Type":"ContainerStarted","Data":"a1245e5e8e3f1c27fd3f528715d3fa19aceeb62b98368a0185cadf9d32e87ef6"}
Jul 13 09:13:19.356585 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:19.356449    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn" event={"ID":"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d","Type":"ContainerStarted","Data":"ba67b98a121a6d52621f9c23e450e5d4198277df9900a70307dcb4d7df559219"}
Jul 13 09:13:19.356585 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:19.356491    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:13:19.358025 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:19.357999    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-hfv8k" event={"ID":"6485b81d-8dac-4cab-8f1a-653e0116ba01","Type":"ContainerStarted","Data":"80a786fa4ae521aea89aae5fcffb47bc9637ea2f16531ed021022833db873d2a"}
Jul 13 09:13:19.377812 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:19.377752    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn" podStartSLOduration=287.377728913 podStartE2EDuration="4m47.377728913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:08:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:13:19.376429412 +0000 UTC m=+288.454306690" watchObservedRunningTime="2026-07-13 09:13:19.377728913 +0000 UTC m=+288.455606148"
Jul 13 09:13:23.820071 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:23.820035    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6rcf6"]
Jul 13 09:13:23.822792 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:23.822767    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:23.825520 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:23.825498    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cmhg8\""
Jul 13 09:13:23.825711 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:23.825532    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 13 09:13:23.825840 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:23.825822    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 13 09:13:23.825917 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:23.825829    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 13 09:13:23.826342 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:23.826322    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 13 09:13:23.990988 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:23.990945    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d983bfe-dbbb-4d67-a99b-919992b833dd-sys\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:23.990988 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:23.990986    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6d983bfe-dbbb-4d67-a99b-919992b833dd-node-exporter-textfile\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:23.991228 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:23.991009    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d983bfe-dbbb-4d67-a99b-919992b833dd-metrics-client-ca\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:23.991228 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:23.991079    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6d983bfe-dbbb-4d67-a99b-919992b833dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:23.991228 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:23.991147    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d983bfe-dbbb-4d67-a99b-919992b833dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:23.991228 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:23.991182    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nqfl\" (UniqueName: \"kubernetes.io/projected/6d983bfe-dbbb-4d67-a99b-919992b833dd-kube-api-access-2nqfl\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:23.991228 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:23.991220    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d983bfe-dbbb-4d67-a99b-919992b833dd-node-exporter-tls\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:23.991402 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:23.991292    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6d983bfe-dbbb-4d67-a99b-919992b833dd-node-exporter-wtmp\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:23.991402 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:23.991347    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6d983bfe-dbbb-4d67-a99b-919992b833dd-root\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:24.092042 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.091965    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6d983bfe-dbbb-4d67-a99b-919992b833dd-root\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:24.092190 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.092050    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d983bfe-dbbb-4d67-a99b-919992b833dd-sys\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:24.092190 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.092077    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6d983bfe-dbbb-4d67-a99b-919992b833dd-node-exporter-textfile\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:24.092190 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.092090    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6d983bfe-dbbb-4d67-a99b-919992b833dd-root\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:24.092190 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.092130    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d983bfe-dbbb-4d67-a99b-919992b833dd-sys\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:24.092190 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.092105    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d983bfe-dbbb-4d67-a99b-919992b833dd-metrics-client-ca\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:24.092452 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.092209    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6d983bfe-dbbb-4d67-a99b-919992b833dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:24.092452 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.092235    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d983bfe-dbbb-4d67-a99b-919992b833dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:24.092452 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.092252    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nqfl\" (UniqueName: \"kubernetes.io/projected/6d983bfe-dbbb-4d67-a99b-919992b833dd-kube-api-access-2nqfl\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:24.092452 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.092280    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d983bfe-dbbb-4d67-a99b-919992b833dd-node-exporter-tls\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:24.092452 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.092313    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6d983bfe-dbbb-4d67-a99b-919992b833dd-node-exporter-wtmp\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:24.092452 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.092414    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6d983bfe-dbbb-4d67-a99b-919992b833dd-node-exporter-textfile\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:24.092767 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.092612    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6d983bfe-dbbb-4d67-a99b-919992b833dd-node-exporter-wtmp\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:24.092840 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.092819    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6d983bfe-dbbb-4d67-a99b-919992b833dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:24.093168 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.093139    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d983bfe-dbbb-4d67-a99b-919992b833dd-metrics-client-ca\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:24.094918 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.094898    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d983bfe-dbbb-4d67-a99b-919992b833dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:24.095151 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.095135    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d983bfe-dbbb-4d67-a99b-919992b833dd-node-exporter-tls\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:24.104394 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.104373    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nqfl\" (UniqueName: \"kubernetes.io/projected/6d983bfe-dbbb-4d67-a99b-919992b833dd-kube-api-access-2nqfl\") pod \"node-exporter-6rcf6\" (UID: \"6d983bfe-dbbb-4d67-a99b-919992b833dd\") " pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:24.133681 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.133661    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6rcf6"
Jul 13 09:13:24.859144 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.859098    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 09:13:24.862554 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.862532    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:24.865482 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.865458    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 13 09:13:24.865594 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.865576    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 13 09:13:24.865766 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.865747    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 13 09:13:24.865866 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.865764    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mjbqh\""
Jul 13 09:13:24.865866 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.865818    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 13 09:13:24.865866 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.865851    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 13 09:13:24.866116 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.866062    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 13 09:13:24.866639 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.866617    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 13 09:13:24.866753 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.866676    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 13 09:13:24.866992 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.866976    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 13 09:13:24.881410 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.881383    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 09:13:24.999415 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.999376    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-web-config\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:24.999614 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.999430    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq2bj\" (UniqueName: \"kubernetes.io/projected/de1d3834-475b-47af-b3ec-5e67397be947-kube-api-access-bq2bj\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:24.999614 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.999541    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:24.999614 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.999582    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:24.999614 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.999611    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/de1d3834-475b-47af-b3ec-5e67397be947-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:24.999864 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.999647    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:24.999864 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.999716    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de1d3834-475b-47af-b3ec-5e67397be947-tls-assets\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:24.999864 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.999740    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:24.999864 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.999769    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1d3834-475b-47af-b3ec-5e67397be947-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:24.999864 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.999849    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.000103 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.999894    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de1d3834-475b-47af-b3ec-5e67397be947-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.000103 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.999916    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de1d3834-475b-47af-b3ec-5e67397be947-config-out\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.000103 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:24.999941    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-config-volume\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.101280 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.101244    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de1d3834-475b-47af-b3ec-5e67397be947-tls-assets\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.101280 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.101284    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.101548 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.101516    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1d3834-475b-47af-b3ec-5e67397be947-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.101615 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.101577    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.101675 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.101621    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de1d3834-475b-47af-b3ec-5e67397be947-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.101675 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.101655    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de1d3834-475b-47af-b3ec-5e67397be947-config-out\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.101807 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.101697    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-config-volume\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.101807 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.101792    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-web-config\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.101903 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.101820    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq2bj\" (UniqueName: \"kubernetes.io/projected/de1d3834-475b-47af-b3ec-5e67397be947-kube-api-access-bq2bj\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.101903 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.101886    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.102002 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.101915    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.102002 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.101945    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/de1d3834-475b-47af-b3ec-5e67397be947-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.102002 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.101983    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.103268 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.102522    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1d3834-475b-47af-b3ec-5e67397be947-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.103268 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.102860    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de1d3834-475b-47af-b3ec-5e67397be947-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.104757 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.104567    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/de1d3834-475b-47af-b3ec-5e67397be947-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.105079 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.105037    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-config-volume\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.105562 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.105378    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.105562 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.105525    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.106135 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.106094    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-web-config\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.106221 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.106175    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de1d3834-475b-47af-b3ec-5e67397be947-config-out\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.106920 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.106897    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.107532 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.107487    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.107722 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.107674    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.108124 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.108104    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de1d3834-475b-47af-b3ec-5e67397be947-tls-assets\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.111654 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.111601    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq2bj\" (UniqueName: \"kubernetes.io/projected/de1d3834-475b-47af-b3ec-5e67397be947-kube-api-access-bq2bj\") pod \"alertmanager-main-0\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.178067 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.178034    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:13:25.773785 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.773751    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-8554754dcd-wkrvw"]
Jul 13 09:13:25.776731 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.776702    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:25.779505 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.779482    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 13 09:13:25.779629 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.779486    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 13 09:13:25.779629 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.779487    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 13 09:13:25.779761 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.779744    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 13 09:13:25.780349 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.780327    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-46hjr\""
Jul 13 09:13:25.780455 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.780364    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 13 09:13:25.780455 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.780337    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cdv2h3q30ps4d\""
Jul 13 09:13:25.790126 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.790102    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8554754dcd-wkrvw"]
Jul 13 09:13:25.908731 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.908665    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3c4ce238-518c-42b7-8eda-6d2b61880898-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8554754dcd-wkrvw\" (UID: \"3c4ce238-518c-42b7-8eda-6d2b61880898\") " pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:25.909123 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.908796    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c4ce238-518c-42b7-8eda-6d2b61880898-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8554754dcd-wkrvw\" (UID: \"3c4ce238-518c-42b7-8eda-6d2b61880898\") " pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:25.909123 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.908839    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c4ce238-518c-42b7-8eda-6d2b61880898-metrics-client-ca\") pod \"thanos-querier-8554754dcd-wkrvw\" (UID: \"3c4ce238-518c-42b7-8eda-6d2b61880898\") " pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:25.909123 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.908923    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c4ce238-518c-42b7-8eda-6d2b61880898-secret-grpc-tls\") pod \"thanos-querier-8554754dcd-wkrvw\" (UID: \"3c4ce238-518c-42b7-8eda-6d2b61880898\") " pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:25.909123 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.908960    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3c4ce238-518c-42b7-8eda-6d2b61880898-secret-thanos-querier-tls\") pod \"thanos-querier-8554754dcd-wkrvw\" (UID: \"3c4ce238-518c-42b7-8eda-6d2b61880898\") " pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:25.909123 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.909024    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3c4ce238-518c-42b7-8eda-6d2b61880898-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8554754dcd-wkrvw\" (UID: \"3c4ce238-518c-42b7-8eda-6d2b61880898\") " pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:25.909123 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.909077    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c4ce238-518c-42b7-8eda-6d2b61880898-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8554754dcd-wkrvw\" (UID: \"3c4ce238-518c-42b7-8eda-6d2b61880898\") " pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:25.909123 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:25.909107    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jms2z\" (UniqueName: \"kubernetes.io/projected/3c4ce238-518c-42b7-8eda-6d2b61880898-kube-api-access-jms2z\") pod \"thanos-querier-8554754dcd-wkrvw\" (UID: \"3c4ce238-518c-42b7-8eda-6d2b61880898\") " pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:26.010187 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:26.010150    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c4ce238-518c-42b7-8eda-6d2b61880898-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8554754dcd-wkrvw\" (UID: \"3c4ce238-518c-42b7-8eda-6d2b61880898\") " pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:26.010368 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:26.010196    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c4ce238-518c-42b7-8eda-6d2b61880898-metrics-client-ca\") pod \"thanos-querier-8554754dcd-wkrvw\" (UID: \"3c4ce238-518c-42b7-8eda-6d2b61880898\") " pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:26.010368 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:26.010225    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c4ce238-518c-42b7-8eda-6d2b61880898-secret-grpc-tls\") pod \"thanos-querier-8554754dcd-wkrvw\" (UID: \"3c4ce238-518c-42b7-8eda-6d2b61880898\") " pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:26.010483 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:26.010405    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3c4ce238-518c-42b7-8eda-6d2b61880898-secret-thanos-querier-tls\") pod \"thanos-querier-8554754dcd-wkrvw\" (UID: \"3c4ce238-518c-42b7-8eda-6d2b61880898\") " pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:26.010483 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:26.010458    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3c4ce238-518c-42b7-8eda-6d2b61880898-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8554754dcd-wkrvw\" (UID: \"3c4ce238-518c-42b7-8eda-6d2b61880898\") " pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:26.010593 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:26.010519    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c4ce238-518c-42b7-8eda-6d2b61880898-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8554754dcd-wkrvw\" (UID: \"3c4ce238-518c-42b7-8eda-6d2b61880898\") " pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:26.010593 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:26.010551    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jms2z\" (UniqueName: \"kubernetes.io/projected/3c4ce238-518c-42b7-8eda-6d2b61880898-kube-api-access-jms2z\") pod \"thanos-querier-8554754dcd-wkrvw\" (UID: \"3c4ce238-518c-42b7-8eda-6d2b61880898\") " pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:26.010593 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:26.010584    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3c4ce238-518c-42b7-8eda-6d2b61880898-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8554754dcd-wkrvw\" (UID: \"3c4ce238-518c-42b7-8eda-6d2b61880898\") " pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:26.010989 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:26.010967    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c4ce238-518c-42b7-8eda-6d2b61880898-metrics-client-ca\") pod \"thanos-querier-8554754dcd-wkrvw\" (UID: \"3c4ce238-518c-42b7-8eda-6d2b61880898\") " pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:26.013338 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:26.013293    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c4ce238-518c-42b7-8eda-6d2b61880898-secret-grpc-tls\") pod \"thanos-querier-8554754dcd-wkrvw\" (UID: \"3c4ce238-518c-42b7-8eda-6d2b61880898\") " pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:26.013727 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:26.013651    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3c4ce238-518c-42b7-8eda-6d2b61880898-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8554754dcd-wkrvw\" (UID: \"3c4ce238-518c-42b7-8eda-6d2b61880898\") " pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:26.013837 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:26.013778    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3c4ce238-518c-42b7-8eda-6d2b61880898-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8554754dcd-wkrvw\" (UID: \"3c4ce238-518c-42b7-8eda-6d2b61880898\") " pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:26.014009 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:26.013986    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3c4ce238-518c-42b7-8eda-6d2b61880898-secret-thanos-querier-tls\") pod \"thanos-querier-8554754dcd-wkrvw\" (UID: \"3c4ce238-518c-42b7-8eda-6d2b61880898\") " pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:26.014291 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:26.014266    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c4ce238-518c-42b7-8eda-6d2b61880898-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8554754dcd-wkrvw\" (UID: \"3c4ce238-518c-42b7-8eda-6d2b61880898\") " pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:26.014392 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:26.014373    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c4ce238-518c-42b7-8eda-6d2b61880898-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8554754dcd-wkrvw\" (UID: \"3c4ce238-518c-42b7-8eda-6d2b61880898\") " pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:26.019170 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:26.019146    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jms2z\" (UniqueName: \"kubernetes.io/projected/3c4ce238-518c-42b7-8eda-6d2b61880898-kube-api-access-jms2z\") pod \"thanos-querier-8554754dcd-wkrvw\" (UID: \"3c4ce238-518c-42b7-8eda-6d2b61880898\") " pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:26.089070 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:26.088982    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:27.478010 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:13:27.477972    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rrhxd" podUID="caf4af40-8763-4401-8dd4-dfe646c17704"
Jul 13 09:13:27.651334 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:13:27.651300    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d983bfe_dbbb_4d67_a99b_919992b833dd.slice/crio-d55ec0c469606b0bc7296ed4aa7c9934ad23c3b73b99097d535e3ce77c00690f WatchSource:0}: Error finding container d55ec0c469606b0bc7296ed4aa7c9934ad23c3b73b99097d535e3ce77c00690f: Status 404 returned error can't find the container with id d55ec0c469606b0bc7296ed4aa7c9934ad23c3b73b99097d535e3ce77c00690f
Jul 13 09:13:27.827843 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:27.827769    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8554754dcd-wkrvw"]
Jul 13 09:13:27.830343 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:13:27.830317    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c4ce238_518c_42b7_8eda_6d2b61880898.slice/crio-14f159dca52164dcce6cf212dcaf3c9037add1942eb023c14619f3b2081a6b3e WatchSource:0}: Error finding container 14f159dca52164dcce6cf212dcaf3c9037add1942eb023c14619f3b2081a6b3e: Status 404 returned error can't find the container with id 14f159dca52164dcce6cf212dcaf3c9037add1942eb023c14619f3b2081a6b3e
Jul 13 09:13:27.845613 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:27.845584    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 09:13:27.848402 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:13:27.848376    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde1d3834_475b_47af_b3ec_5e67397be947.slice/crio-143d1c8936fd6d1cce44883fa31cd2fed0db00d017eb01a8bf17f108e6caaa19 WatchSource:0}: Error finding container 143d1c8936fd6d1cce44883fa31cd2fed0db00d017eb01a8bf17f108e6caaa19: Status 404 returned error can't find the container with id 143d1c8936fd6d1cce44883fa31cd2fed0db00d017eb01a8bf17f108e6caaa19
Jul 13 09:13:28.098048 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.097964    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-788976c5cc-tsjgz"]
Jul 13 09:13:28.104349 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.104314    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:13:28.107864 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.107839    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fq0aj1ohtlfmq\""
Jul 13 09:13:28.107978 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.107908    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 13 09:13:28.107978 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.107940    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 13 09:13:28.108105 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.108015    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 13 09:13:28.108226 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.108208    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 13 09:13:28.108717 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.108681    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6cszh\""
Jul 13 09:13:28.113434 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.113367    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-788976c5cc-tsjgz"]
Jul 13 09:13:28.233275 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.233233    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/dfc4a4f8-b3df-4835-a630-7a3492f447b6-secret-metrics-server-client-certs\") pod \"metrics-server-788976c5cc-tsjgz\" (UID: \"dfc4a4f8-b3df-4835-a630-7a3492f447b6\") " pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:13:28.233531 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.233299    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdqn7\" (UniqueName: \"kubernetes.io/projected/dfc4a4f8-b3df-4835-a630-7a3492f447b6-kube-api-access-kdqn7\") pod \"metrics-server-788976c5cc-tsjgz\" (UID: \"dfc4a4f8-b3df-4835-a630-7a3492f447b6\") " pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:13:28.233531 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.233348    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/dfc4a4f8-b3df-4835-a630-7a3492f447b6-secret-metrics-server-tls\") pod \"metrics-server-788976c5cc-tsjgz\" (UID: \"dfc4a4f8-b3df-4835-a630-7a3492f447b6\") " pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:13:28.233531 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.233412    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/dfc4a4f8-b3df-4835-a630-7a3492f447b6-audit-log\") pod \"metrics-server-788976c5cc-tsjgz\" (UID: \"dfc4a4f8-b3df-4835-a630-7a3492f447b6\") " pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:13:28.233531 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.233442    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfc4a4f8-b3df-4835-a630-7a3492f447b6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-788976c5cc-tsjgz\" (UID: \"dfc4a4f8-b3df-4835-a630-7a3492f447b6\") " pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:13:28.233531 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.233479    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/dfc4a4f8-b3df-4835-a630-7a3492f447b6-metrics-server-audit-profiles\") pod \"metrics-server-788976c5cc-tsjgz\" (UID: \"dfc4a4f8-b3df-4835-a630-7a3492f447b6\") " pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:13:28.233531 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.233529    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dfc4a4f8-b3df-4835-a630-7a3492f447b6-client-ca-bundle\") pod \"metrics-server-788976c5cc-tsjgz\" (UID: \"dfc4a4f8-b3df-4835-a630-7a3492f447b6\") " pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:13:28.335988 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.335225    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/dfc4a4f8-b3df-4835-a630-7a3492f447b6-audit-log\") pod \"metrics-server-788976c5cc-tsjgz\" (UID: \"dfc4a4f8-b3df-4835-a630-7a3492f447b6\") " pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:13:28.335988 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.335278    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfc4a4f8-b3df-4835-a630-7a3492f447b6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-788976c5cc-tsjgz\" (UID: \"dfc4a4f8-b3df-4835-a630-7a3492f447b6\") " pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:13:28.335988 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.335313    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/dfc4a4f8-b3df-4835-a630-7a3492f447b6-metrics-server-audit-profiles\") pod \"metrics-server-788976c5cc-tsjgz\" (UID: \"dfc4a4f8-b3df-4835-a630-7a3492f447b6\") " pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:13:28.335988 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.335359    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dfc4a4f8-b3df-4835-a630-7a3492f447b6-client-ca-bundle\") pod \"metrics-server-788976c5cc-tsjgz\" (UID: \"dfc4a4f8-b3df-4835-a630-7a3492f447b6\") " pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:13:28.335988 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.335420    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/dfc4a4f8-b3df-4835-a630-7a3492f447b6-secret-metrics-server-client-certs\") pod \"metrics-server-788976c5cc-tsjgz\" (UID: \"dfc4a4f8-b3df-4835-a630-7a3492f447b6\") " pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:13:28.335988 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.335460    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdqn7\" (UniqueName: \"kubernetes.io/projected/dfc4a4f8-b3df-4835-a630-7a3492f447b6-kube-api-access-kdqn7\") pod \"metrics-server-788976c5cc-tsjgz\" (UID: \"dfc4a4f8-b3df-4835-a630-7a3492f447b6\") " pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:13:28.335988 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.335497    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/dfc4a4f8-b3df-4835-a630-7a3492f447b6-secret-metrics-server-tls\") pod \"metrics-server-788976c5cc-tsjgz\" (UID: \"dfc4a4f8-b3df-4835-a630-7a3492f447b6\") " pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:13:28.338271 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.337982    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfc4a4f8-b3df-4835-a630-7a3492f447b6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-788976c5cc-tsjgz\" (UID: \"dfc4a4f8-b3df-4835-a630-7a3492f447b6\") " pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:13:28.338271 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.338224    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/dfc4a4f8-b3df-4835-a630-7a3492f447b6-metrics-server-audit-profiles\") pod \"metrics-server-788976c5cc-tsjgz\" (UID: \"dfc4a4f8-b3df-4835-a630-7a3492f447b6\") " pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:13:28.338561 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.338521    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/dfc4a4f8-b3df-4835-a630-7a3492f447b6-audit-log\") pod \"metrics-server-788976c5cc-tsjgz\" (UID: \"dfc4a4f8-b3df-4835-a630-7a3492f447b6\") " pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:13:28.339316 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.339263    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/dfc4a4f8-b3df-4835-a630-7a3492f447b6-secret-metrics-server-tls\") pod \"metrics-server-788976c5cc-tsjgz\" (UID: \"dfc4a4f8-b3df-4835-a630-7a3492f447b6\") " pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:13:28.341745 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.341679    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dfc4a4f8-b3df-4835-a630-7a3492f447b6-client-ca-bundle\") pod \"metrics-server-788976c5cc-tsjgz\" (UID: \"dfc4a4f8-b3df-4835-a630-7a3492f447b6\") " pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:13:28.344930 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.344910    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/dfc4a4f8-b3df-4835-a630-7a3492f447b6-secret-metrics-server-client-certs\") pod \"metrics-server-788976c5cc-tsjgz\" (UID: \"dfc4a4f8-b3df-4835-a630-7a3492f447b6\") " pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:13:28.346082 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.346059    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdqn7\" (UniqueName: \"kubernetes.io/projected/dfc4a4f8-b3df-4835-a630-7a3492f447b6-kube-api-access-kdqn7\") pod \"metrics-server-788976c5cc-tsjgz\" (UID: \"dfc4a4f8-b3df-4835-a630-7a3492f447b6\") " pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:13:28.398955 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.398898    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vrnb8" event={"ID":"382f0622-3acb-41c7-a231-3b688b8c212e","Type":"ContainerStarted","Data":"d2283642084b0d4b236098cd5c0c65ed0fab2c6f1f8f60bfbe4c8e2a1c22cf95"}
Jul 13 09:13:28.399136 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.399058    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vrnb8" event={"ID":"382f0622-3acb-41c7-a231-3b688b8c212e","Type":"ContainerStarted","Data":"c16202ce30b9fb856ec4c7cb08e0a863aee11e9bacc02c585269fd113bb61839"}
Jul 13 09:13:28.399267 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.399249    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:13:28.401916 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.401885    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-hfv8k" event={"ID":"6485b81d-8dac-4cab-8f1a-653e0116ba01","Type":"ContainerStarted","Data":"f755c04c65150d9bcdf79902a17384ab3f2c9c6537e9800b4a97d0769d935ff4"}
Jul 13 09:13:28.404324 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.404275    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw" event={"ID":"3c4ce238-518c-42b7-8eda-6d2b61880898","Type":"ContainerStarted","Data":"14f159dca52164dcce6cf212dcaf3c9037add1942eb023c14619f3b2081a6b3e"}
Jul 13 09:13:28.406284 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.406204    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de1d3834-475b-47af-b3ec-5e67397be947","Type":"ContainerStarted","Data":"143d1c8936fd6d1cce44883fa31cd2fed0db00d017eb01a8bf17f108e6caaa19"}
Jul 13 09:13:28.410664 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.409907    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-kgcg7" event={"ID":"d706057a-268b-42c4-ac26-67fd4330f9d9","Type":"ContainerStarted","Data":"e84e47a5a3145dc0feb924135224ee59f6e2a8733a4f803474d5d4ccd259f86c"}
Jul 13 09:13:28.410664 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.410609    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-kgcg7"
Jul 13 09:13:28.412411 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.411941    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6rcf6" event={"ID":"6d983bfe-dbbb-4d67-a99b-919992b833dd","Type":"ContainerStarted","Data":"d55ec0c469606b0bc7296ed4aa7c9934ad23c3b73b99097d535e3ce77c00690f"}
Jul 13 09:13:28.417571 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.415916    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:13:28.417571 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.417471    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vrnb8" podStartSLOduration=251.811310169 podStartE2EDuration="4m20.417452283s" totalImagesPullingTime="8.606142114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:09:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:13:28.415384107 +0000 UTC m=+297.493261388" watchObservedRunningTime="2026-07-13 09:13:28.417452283 +0000 UTC m=+297.495329538"
Jul 13 09:13:28.425516 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.425458    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-kgcg7"
Jul 13 09:13:28.433995 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.432452    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-hfv8k" podStartSLOduration=279.906132101 podStartE2EDuration="4m48.432433882s" totalImagesPullingTime="8.526301781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:08:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:13:28.430519111 +0000 UTC m=+297.508396366" watchObservedRunningTime="2026-07-13 09:13:28.432433882 +0000 UTC m=+297.510311140"
Jul 13 09:13:28.448511 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.448307    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-kgcg7" podStartSLOduration=1.718023812 podStartE2EDuration="19.448285167s" totalImagesPullingTime="17.730261355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:13:28.44753384 +0000 UTC m=+297.525411140" watchObservedRunningTime="2026-07-13 09:13:28.448285167 +0000 UTC m=+297.526162419"
Jul 13 09:13:28.663609 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.663528    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-554b96bbd5-7ldpm"]
Jul 13 09:13:28.672081 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.671175    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:28.674276 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.674219    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 13 09:13:28.675780 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.674606    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 13 09:13:28.675780 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.675026    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 13 09:13:28.675780 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.675243    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 13 09:13:28.675780 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.675464    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 13 09:13:28.675780 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.675628    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4gxx5\""
Jul 13 09:13:28.678274 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.678022    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-554b96bbd5-7ldpm"]
Jul 13 09:13:28.683064 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.682887    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 13 09:13:28.739488 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.739383    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqfm9\" (UniqueName: \"kubernetes.io/projected/deec606c-1fe3-42c6-a50c-39a4a675a003-kube-api-access-cqfm9\") pod \"console-554b96bbd5-7ldpm\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") " pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:28.739488 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.739442    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/deec606c-1fe3-42c6-a50c-39a4a675a003-oauth-serving-cert\") pod \"console-554b96bbd5-7ldpm\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") " pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:28.739488 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.739498    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/deec606c-1fe3-42c6-a50c-39a4a675a003-console-serving-cert\") pod \"console-554b96bbd5-7ldpm\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") " pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:28.739830 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.739526    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/deec606c-1fe3-42c6-a50c-39a4a675a003-console-oauth-config\") pod \"console-554b96bbd5-7ldpm\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") " pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:28.739830 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.739583    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/deec606c-1fe3-42c6-a50c-39a4a675a003-console-config\") pod \"console-554b96bbd5-7ldpm\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") " pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:28.739830 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.739763    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/deec606c-1fe3-42c6-a50c-39a4a675a003-service-ca\") pod \"console-554b96bbd5-7ldpm\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") " pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:28.739830 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.739820    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deec606c-1fe3-42c6-a50c-39a4a675a003-trusted-ca-bundle\") pod \"console-554b96bbd5-7ldpm\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") " pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:28.840472 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.840428    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/deec606c-1fe3-42c6-a50c-39a4a675a003-console-oauth-config\") pod \"console-554b96bbd5-7ldpm\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") " pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:28.840472 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.840485    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/deec606c-1fe3-42c6-a50c-39a4a675a003-console-config\") pod \"console-554b96bbd5-7ldpm\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") " pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:28.840767 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.840545    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/deec606c-1fe3-42c6-a50c-39a4a675a003-service-ca\") pod \"console-554b96bbd5-7ldpm\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") " pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:28.840767 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.840593    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deec606c-1fe3-42c6-a50c-39a4a675a003-trusted-ca-bundle\") pod \"console-554b96bbd5-7ldpm\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") " pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:28.840767 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.840651    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqfm9\" (UniqueName: \"kubernetes.io/projected/deec606c-1fe3-42c6-a50c-39a4a675a003-kube-api-access-cqfm9\") pod \"console-554b96bbd5-7ldpm\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") " pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:28.840767 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.840708    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/deec606c-1fe3-42c6-a50c-39a4a675a003-oauth-serving-cert\") pod \"console-554b96bbd5-7ldpm\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") " pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:28.840960 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.840772    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/deec606c-1fe3-42c6-a50c-39a4a675a003-console-serving-cert\") pod \"console-554b96bbd5-7ldpm\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") " pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:28.842696 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.841813    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/deec606c-1fe3-42c6-a50c-39a4a675a003-oauth-serving-cert\") pod \"console-554b96bbd5-7ldpm\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") " pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:28.842696 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.841823    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/deec606c-1fe3-42c6-a50c-39a4a675a003-console-config\") pod \"console-554b96bbd5-7ldpm\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") " pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:28.842696 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.842538    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/deec606c-1fe3-42c6-a50c-39a4a675a003-service-ca\") pod \"console-554b96bbd5-7ldpm\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") " pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:28.842696 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.842608    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deec606c-1fe3-42c6-a50c-39a4a675a003-trusted-ca-bundle\") pod \"console-554b96bbd5-7ldpm\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") " pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:28.844994 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.844939    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/deec606c-1fe3-42c6-a50c-39a4a675a003-console-serving-cert\") pod \"console-554b96bbd5-7ldpm\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") " pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:28.846901 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.846862    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/deec606c-1fe3-42c6-a50c-39a4a675a003-console-oauth-config\") pod \"console-554b96bbd5-7ldpm\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") " pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:28.850983 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.850939    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqfm9\" (UniqueName: \"kubernetes.io/projected/deec606c-1fe3-42c6-a50c-39a4a675a003-kube-api-access-cqfm9\") pod \"console-554b96bbd5-7ldpm\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") " pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:28.879328 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.878992    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-dd54f88f8-xdf46"]
Jul 13 09:13:28.889275 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.888518    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:28.891718 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.891671    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 13 09:13:28.891983 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.891958    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 13 09:13:28.892382 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.892350    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 13 09:13:28.892716 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.892568    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 13 09:13:28.892822 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.892789    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 13 09:13:28.893748 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.893295    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9kl6p\""
Jul 13 09:13:28.897858 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.897838    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-dd54f88f8-xdf46"]
Jul 13 09:13:28.900170 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.899989    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 13 09:13:28.942354 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.942268    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bb1ba9c8-fa6c-45b8-a579-f83351272d38-telemeter-client-tls\") pod \"telemeter-client-dd54f88f8-xdf46\" (UID: \"bb1ba9c8-fa6c-45b8-a579-f83351272d38\") " pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:28.942354 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.942341    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bb1ba9c8-fa6c-45b8-a579-f83351272d38-secret-telemeter-client\") pod \"telemeter-client-dd54f88f8-xdf46\" (UID: \"bb1ba9c8-fa6c-45b8-a579-f83351272d38\") " pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:28.942604 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.942395    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb1ba9c8-fa6c-45b8-a579-f83351272d38-telemeter-trusted-ca-bundle\") pod \"telemeter-client-dd54f88f8-xdf46\" (UID: \"bb1ba9c8-fa6c-45b8-a579-f83351272d38\") " pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:28.942604 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.942429    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb1ba9c8-fa6c-45b8-a579-f83351272d38-metrics-client-ca\") pod \"telemeter-client-dd54f88f8-xdf46\" (UID: \"bb1ba9c8-fa6c-45b8-a579-f83351272d38\") " pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:28.942604 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.942471    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb1ba9c8-fa6c-45b8-a579-f83351272d38-serving-certs-ca-bundle\") pod \"telemeter-client-dd54f88f8-xdf46\" (UID: \"bb1ba9c8-fa6c-45b8-a579-f83351272d38\") " pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:28.942604 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.942495    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxdzq\" (UniqueName: \"kubernetes.io/projected/bb1ba9c8-fa6c-45b8-a579-f83351272d38-kube-api-access-dxdzq\") pod \"telemeter-client-dd54f88f8-xdf46\" (UID: \"bb1ba9c8-fa6c-45b8-a579-f83351272d38\") " pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:28.942604 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.942535    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bb1ba9c8-fa6c-45b8-a579-f83351272d38-federate-client-tls\") pod \"telemeter-client-dd54f88f8-xdf46\" (UID: \"bb1ba9c8-fa6c-45b8-a579-f83351272d38\") " pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:28.942604 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.942592    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb1ba9c8-fa6c-45b8-a579-f83351272d38-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-dd54f88f8-xdf46\" (UID: \"bb1ba9c8-fa6c-45b8-a579-f83351272d38\") " pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:28.988439 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:28.988171    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:29.043287 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:29.043250    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb1ba9c8-fa6c-45b8-a579-f83351272d38-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-dd54f88f8-xdf46\" (UID: \"bb1ba9c8-fa6c-45b8-a579-f83351272d38\") " pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:29.043455 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:29.043308    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bb1ba9c8-fa6c-45b8-a579-f83351272d38-telemeter-client-tls\") pod \"telemeter-client-dd54f88f8-xdf46\" (UID: \"bb1ba9c8-fa6c-45b8-a579-f83351272d38\") " pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:29.043455 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:29.043364    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bb1ba9c8-fa6c-45b8-a579-f83351272d38-secret-telemeter-client\") pod \"telemeter-client-dd54f88f8-xdf46\" (UID: \"bb1ba9c8-fa6c-45b8-a579-f83351272d38\") " pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:29.043455 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:29.043416    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb1ba9c8-fa6c-45b8-a579-f83351272d38-telemeter-trusted-ca-bundle\") pod \"telemeter-client-dd54f88f8-xdf46\" (UID: \"bb1ba9c8-fa6c-45b8-a579-f83351272d38\") " pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:29.043455 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:29.043446    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb1ba9c8-fa6c-45b8-a579-f83351272d38-metrics-client-ca\") pod \"telemeter-client-dd54f88f8-xdf46\" (UID: \"bb1ba9c8-fa6c-45b8-a579-f83351272d38\") " pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:29.043670 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:29.043488    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb1ba9c8-fa6c-45b8-a579-f83351272d38-serving-certs-ca-bundle\") pod \"telemeter-client-dd54f88f8-xdf46\" (UID: \"bb1ba9c8-fa6c-45b8-a579-f83351272d38\") " pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:29.043670 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:29.043517    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxdzq\" (UniqueName: \"kubernetes.io/projected/bb1ba9c8-fa6c-45b8-a579-f83351272d38-kube-api-access-dxdzq\") pod \"telemeter-client-dd54f88f8-xdf46\" (UID: \"bb1ba9c8-fa6c-45b8-a579-f83351272d38\") " pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:29.043670 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:29.043555    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bb1ba9c8-fa6c-45b8-a579-f83351272d38-federate-client-tls\") pod \"telemeter-client-dd54f88f8-xdf46\" (UID: \"bb1ba9c8-fa6c-45b8-a579-f83351272d38\") " pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:29.045632 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:29.044439    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb1ba9c8-fa6c-45b8-a579-f83351272d38-metrics-client-ca\") pod \"telemeter-client-dd54f88f8-xdf46\" (UID: \"bb1ba9c8-fa6c-45b8-a579-f83351272d38\") " pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:29.045632 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:29.044906    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb1ba9c8-fa6c-45b8-a579-f83351272d38-serving-certs-ca-bundle\") pod \"telemeter-client-dd54f88f8-xdf46\" (UID: \"bb1ba9c8-fa6c-45b8-a579-f83351272d38\") " pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:29.046001 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:29.045957    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb1ba9c8-fa6c-45b8-a579-f83351272d38-telemeter-trusted-ca-bundle\") pod \"telemeter-client-dd54f88f8-xdf46\" (UID: \"bb1ba9c8-fa6c-45b8-a579-f83351272d38\") " pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:29.046892 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:29.046846    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb1ba9c8-fa6c-45b8-a579-f83351272d38-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-dd54f88f8-xdf46\" (UID: \"bb1ba9c8-fa6c-45b8-a579-f83351272d38\") " pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:29.046990 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:29.046897    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bb1ba9c8-fa6c-45b8-a579-f83351272d38-secret-telemeter-client\") pod \"telemeter-client-dd54f88f8-xdf46\" (UID: \"bb1ba9c8-fa6c-45b8-a579-f83351272d38\") " pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:29.048196 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:29.048152    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bb1ba9c8-fa6c-45b8-a579-f83351272d38-federate-client-tls\") pod \"telemeter-client-dd54f88f8-xdf46\" (UID: \"bb1ba9c8-fa6c-45b8-a579-f83351272d38\") " pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:29.049238 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:29.049198    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bb1ba9c8-fa6c-45b8-a579-f83351272d38-telemeter-client-tls\") pod \"telemeter-client-dd54f88f8-xdf46\" (UID: \"bb1ba9c8-fa6c-45b8-a579-f83351272d38\") " pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:29.055391 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:29.055355    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxdzq\" (UniqueName: \"kubernetes.io/projected/bb1ba9c8-fa6c-45b8-a579-f83351272d38-kube-api-access-dxdzq\") pod \"telemeter-client-dd54f88f8-xdf46\" (UID: \"bb1ba9c8-fa6c-45b8-a579-f83351272d38\") " pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:29.205261 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:29.205043    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46"
Jul 13 09:13:30.003440 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.003408    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 09:13:30.058371 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.058338    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 09:13:30.058524 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.058509    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.062343 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.061553    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xn57v\""
Jul 13 09:13:30.062343 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.061720    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 13 09:13:30.062343 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.061813    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 13 09:13:30.062343 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.061920    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 13 09:13:30.062343 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.062032    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 13 09:13:30.062343 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.062038    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 13 09:13:30.062343 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.062219    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 13 09:13:30.062343 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.062330    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 13 09:13:30.063381 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.063169    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 13 09:13:30.063381 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.063385    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 13 09:13:30.063629 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.063560    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 13 09:13:30.063774 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.063757    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dp6n6qa04kcir\""
Jul 13 09:13:30.064903 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.064879    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 13 09:13:30.065104 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.065038    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 13 09:13:30.070715 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.070681    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 13 09:13:30.071172 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.071152    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 13 09:13:30.158323 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.155070    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.158323 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.155124    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.158323 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.155153    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.158323 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.155181    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/146881d8-5cfc-45fe-a790-ca445f287b49-config-out\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.158323 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.155212    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.158323 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.155240    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.158323 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.155275    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh4cn\" (UniqueName: \"kubernetes.io/projected/146881d8-5cfc-45fe-a790-ca445f287b49-kube-api-access-qh4cn\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.158323 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.155313    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.158323 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.155340    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.158323 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.155365    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-web-config\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.158323 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.155411    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-config\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.158323 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.155440    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.158323 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.155466    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.158323 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.155498    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.158323 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.155533    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/146881d8-5cfc-45fe-a790-ca445f287b49-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.158323 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.155558    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.159283 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.155588    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.159283 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.155628    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.159283 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.155656    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.159283 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.155742    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.257369 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.257092    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-config\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.257369 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.257140    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.257369 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.257170    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.257369 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.257238    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.257369 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.257272    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/146881d8-5cfc-45fe-a790-ca445f287b49-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.257369 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.257305    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.257369 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.257335    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.257369 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.257372    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.257883 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.257397    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.257883 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.257454    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.257883 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.257518    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.257883 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.257540    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.257883 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.257570    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.257883 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.257601    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/146881d8-5cfc-45fe-a790-ca445f287b49-config-out\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.257883 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.257641    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.257883 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.257667    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.257883 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.257731    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh4cn\" (UniqueName: \"kubernetes.io/projected/146881d8-5cfc-45fe-a790-ca445f287b49-kube-api-access-qh4cn\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.257883 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.257773    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.257883 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.257797    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.257883 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.257820    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-web-config\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.259680 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.259215    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.267535 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.260251    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.267535 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.260268    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.267535 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.260463    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.267535 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.260972    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.267535 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.261532    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.267995 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.267730    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.272472 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.271474    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.275102 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.275082    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-554b96bbd5-7ldpm"]
Jul 13 09:13:30.275296 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.275097    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.276361 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.276294    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.277563 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.277540    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.277760 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.277742    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh4cn\" (UniqueName: \"kubernetes.io/projected/146881d8-5cfc-45fe-a790-ca445f287b49-kube-api-access-qh4cn\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.279646 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.279230    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-config\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.279646 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.279400    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.279646 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.279547    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/146881d8-5cfc-45fe-a790-ca445f287b49-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.279646 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.279614    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.279903 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.279789    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-web-config\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.281264 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.281203    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.281372 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.281291    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/146881d8-5cfc-45fe-a790-ca445f287b49-config-out\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.281622 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.281517    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.285400 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.285344    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-dd54f88f8-xdf46"]
Jul 13 09:13:30.305618 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.305465    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-788976c5cc-tsjgz"]
Jul 13 09:13:30.377798 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.377764    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:30.423968 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.423920    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de1d3834-475b-47af-b3ec-5e67397be947","Type":"ContainerStarted","Data":"739f0a4d15e5bb0cd7dc4b00783c0e173336362258bda13dab35fbae92e326e7"}
Jul 13 09:13:30.425982 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:30.425945    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6rcf6" event={"ID":"6d983bfe-dbbb-4d67-a99b-919992b833dd","Type":"ContainerStarted","Data":"b4329903cd83e7a12312d17e42a30063323a8aced837ab360bb2feccd8f960fa"}
Jul 13 09:13:31.046596 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:31.046569    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 09:13:31.128455 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:13:31.128410    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod146881d8_5cfc_45fe_a790_ca445f287b49.slice/crio-b806bc83db4bff0c990ec2d06afb69663e273452b232dc5498ccfad0f8ab8ca9 WatchSource:0}: Error finding container b806bc83db4bff0c990ec2d06afb69663e273452b232dc5498ccfad0f8ab8ca9: Status 404 returned error can't find the container with id b806bc83db4bff0c990ec2d06afb69663e273452b232dc5498ccfad0f8ab8ca9
Jul 13 09:13:31.413648 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:31.407659    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tmbbk_d1243d30-2275-43cc-b5a9-a8de5a66beed/console-operator/1.log"
Jul 13 09:13:31.413648 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:31.409145    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tmbbk_d1243d30-2275-43cc-b5a9-a8de5a66beed/console-operator/1.log"
Jul 13 09:13:31.439999 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:31.439961    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46" event={"ID":"bb1ba9c8-fa6c-45b8-a579-f83351272d38","Type":"ContainerStarted","Data":"801436bc043788dfc90e4b1e4ff382137773bf4209fbf462c057cf2e6ffcc192"}
Jul 13 09:13:31.442821 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:31.442798    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t558b_db263c9c-ef1c-4e74-968b-f8822c77dffc/ovn-acl-logging/0.log"
Jul 13 09:13:31.443030 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:31.443009    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t558b_db263c9c-ef1c-4e74-968b-f8822c77dffc/ovn-acl-logging/0.log"
Jul 13 09:13:31.444299 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:31.444274    2553 generic.go:356] "Generic (PLEG): container finished" podID="de1d3834-475b-47af-b3ec-5e67397be947" containerID="739f0a4d15e5bb0cd7dc4b00783c0e173336362258bda13dab35fbae92e326e7" exitCode=0
Jul 13 09:13:31.444498 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:31.444386    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de1d3834-475b-47af-b3ec-5e67397be947","Type":"ContainerDied","Data":"739f0a4d15e5bb0cd7dc4b00783c0e173336362258bda13dab35fbae92e326e7"}
Jul 13 09:13:31.447859 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:31.447836    2553 generic.go:356] "Generic (PLEG): container finished" podID="6d983bfe-dbbb-4d67-a99b-919992b833dd" containerID="b4329903cd83e7a12312d17e42a30063323a8aced837ab360bb2feccd8f960fa" exitCode=0
Jul 13 09:13:31.448054 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:31.448036    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6rcf6" event={"ID":"6d983bfe-dbbb-4d67-a99b-919992b833dd","Type":"ContainerDied","Data":"b4329903cd83e7a12312d17e42a30063323a8aced837ab360bb2feccd8f960fa"}
Jul 13 09:13:31.451750 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:31.451732    2553 kubelet.go:1648] "Image garbage collection succeeded"
Jul 13 09:13:31.451996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:31.451895    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz" event={"ID":"dfc4a4f8-b3df-4835-a630-7a3492f447b6","Type":"ContainerStarted","Data":"03fc5da90939696d80d6157bba8b78471cb7146aba7870a795abd6b8d2145cca"}
Jul 13 09:13:31.456206 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:31.456157    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554b96bbd5-7ldpm" event={"ID":"deec606c-1fe3-42c6-a50c-39a4a675a003","Type":"ContainerStarted","Data":"8186f1044d4eaf56ea04f9e71a3abb4e0b4b5c88e09b04545746e528ebb37b90"}
Jul 13 09:13:31.462324 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:31.462202    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw" event={"ID":"3c4ce238-518c-42b7-8eda-6d2b61880898","Type":"ContainerStarted","Data":"32ecd11b17ca2d450bd7f20e3d041f21a74c90ca8eadcc1abce430f73601988d"}
Jul 13 09:13:31.462324 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:31.462276    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw" event={"ID":"3c4ce238-518c-42b7-8eda-6d2b61880898","Type":"ContainerStarted","Data":"feceac4f8a704b552361f8fdbe919d0bb11c09674d6905e0b02f7df6be4fa7b1"}
Jul 13 09:13:31.465458 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:31.465432    2553 generic.go:356] "Generic (PLEG): container finished" podID="146881d8-5cfc-45fe-a790-ca445f287b49" containerID="6a32670f8fa3f482126053b7bd57be3938906c0bc822432dcb231d4ef05a1086" exitCode=0
Jul 13 09:13:31.465554 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:31.465468    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"146881d8-5cfc-45fe-a790-ca445f287b49","Type":"ContainerDied","Data":"6a32670f8fa3f482126053b7bd57be3938906c0bc822432dcb231d4ef05a1086"}
Jul 13 09:13:31.465554 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:31.465525    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"146881d8-5cfc-45fe-a790-ca445f287b49","Type":"ContainerStarted","Data":"b806bc83db4bff0c990ec2d06afb69663e273452b232dc5498ccfad0f8ab8ca9"}
Jul 13 09:13:32.512589 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:32.512495    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6rcf6" event={"ID":"6d983bfe-dbbb-4d67-a99b-919992b833dd","Type":"ContainerStarted","Data":"8d56e210c479d51a77013ee4c7a020b598a948a47ecfe058cd96814fb62020c9"}
Jul 13 09:13:32.513124 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:32.512597    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6rcf6" event={"ID":"6d983bfe-dbbb-4d67-a99b-919992b833dd","Type":"ContainerStarted","Data":"fd9c07d4f9cd8ef21c71588e468cbbf817de48445f9c61231a9199e7bfbfaeec"}
Jul 13 09:13:32.527141 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:32.527109    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw" event={"ID":"3c4ce238-518c-42b7-8eda-6d2b61880898","Type":"ContainerStarted","Data":"ccf816d77d26377196b46f33dd7f119de1642498b77d3b4633e661d678d6a8b1"}
Jul 13 09:13:32.537293 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:32.537238    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6rcf6" podStartSLOduration=7.07384966 podStartE2EDuration="9.537218018s" totalImagesPullingTime="2.374601954s" totalInitContainerRuntime="88.766404ms" isStatefulPod=true podCreationTimestamp="2026-07-13 09:13:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:13:32.535332258 +0000 UTC m=+301.613209570" watchObservedRunningTime="2026-07-13 09:13:32.537218018 +0000 UTC m=+301.615095276"
Jul 13 09:13:38.420369 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:38.420337    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vrnb8"
Jul 13 09:13:38.956771 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:38.956735    2553 patch_prober.go:28] interesting pod/image-registry-6479ff8fc8-x4bkn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 13 09:13:38.956886 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:38.956803    2553 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn" podUID="eaa1f1f3-ea75-4c49-8ada-3cbe5125009d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 09:13:39.567797 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:39.567764    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46" event={"ID":"bb1ba9c8-fa6c-45b8-a579-f83351272d38","Type":"ContainerStarted","Data":"54a95786b73b75dccf4f417d37077e11d81c80577cf41930ac42b36037d62f7a"}
Jul 13 09:13:39.568172 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:39.567837    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46" event={"ID":"bb1ba9c8-fa6c-45b8-a579-f83351272d38","Type":"ContainerStarted","Data":"ec44fe9b9994ed212f43c3a662478fda0930f2e89d0e6f3d461d48f53a5a70ce"}
Jul 13 09:13:39.568172 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:39.567870    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46" event={"ID":"bb1ba9c8-fa6c-45b8-a579-f83351272d38","Type":"ContainerStarted","Data":"13b41d6d39aa133b9e5dc7a79e6c99776432d3127ba38be310d9572008d9686b"}
Jul 13 09:13:39.571354 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:39.571326    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de1d3834-475b-47af-b3ec-5e67397be947","Type":"ContainerStarted","Data":"ab84f1ab518df48431003a809d7dbeabd389bc4ae3f2b3f99b88a9be4ae48236"}
Jul 13 09:13:39.571444 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:39.571413    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de1d3834-475b-47af-b3ec-5e67397be947","Type":"ContainerStarted","Data":"d62ed25f2be594839b6eb99be64c74ebc090576d2cf9cf19d5511bd47db2d319"}
Jul 13 09:13:39.571518 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:39.571452    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de1d3834-475b-47af-b3ec-5e67397be947","Type":"ContainerStarted","Data":"97f7d99751ccc9b8565ad069c49dc30d556fcd4c39a625a45f011190393d77dc"}
Jul 13 09:13:39.571518 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:39.571488    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de1d3834-475b-47af-b3ec-5e67397be947","Type":"ContainerStarted","Data":"eda88bf4d780c15ae6576cd96d509e404d616e2791ba0f50156e6437f985ad88"}
Jul 13 09:13:39.573491 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:39.573225    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz" event={"ID":"dfc4a4f8-b3df-4835-a630-7a3492f447b6","Type":"ContainerStarted","Data":"8d53e4b800593309d78a8c9619ebfded32b70d8e00ec0f567123a3d7f088653d"}
Jul 13 09:13:39.575413 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:39.575390    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554b96bbd5-7ldpm" event={"ID":"deec606c-1fe3-42c6-a50c-39a4a675a003","Type":"ContainerStarted","Data":"2b4b2ba66f1cf6f5c81a18396210fdc51cd857cd4e2d4eed63e261fb2c1b355e"}
Jul 13 09:13:39.578362 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:39.578337    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw" event={"ID":"3c4ce238-518c-42b7-8eda-6d2b61880898","Type":"ContainerStarted","Data":"ebc05b11591ed8b8a92c45c1b0fbf0fedc206a4fc67ae23569fd67974cebb3fd"}
Jul 13 09:13:39.578450 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:39.578408    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:39.578450 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:39.578447    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw" event={"ID":"3c4ce238-518c-42b7-8eda-6d2b61880898","Type":"ContainerStarted","Data":"725cb4998b2b3baf4976c271bad1cba8e23d97d98f6ae13ea659d75107c2bac7"}
Jul 13 09:13:39.578571 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:39.578486    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw" event={"ID":"3c4ce238-518c-42b7-8eda-6d2b61880898","Type":"ContainerStarted","Data":"6a0077ac39621c1a13afb2cb45c2a732f939e9a95c29ac63041916e834a345c7"}
Jul 13 09:13:39.581527 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:39.581494    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"146881d8-5cfc-45fe-a790-ca445f287b49","Type":"ContainerStarted","Data":"ec6eb121fc0dfa406fd86e7575b518028de946fbcb13f01896266244643c5c24"}
Jul 13 09:13:39.581611 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:39.581558    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"146881d8-5cfc-45fe-a790-ca445f287b49","Type":"ContainerStarted","Data":"91cdbc985b4b0cc2aca073fc345b00d15011f16731beaf405d9deb070a51bba5"}
Jul 13 09:13:39.581611 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:39.581597    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"146881d8-5cfc-45fe-a790-ca445f287b49","Type":"ContainerStarted","Data":"3eef0b1441f4f6cbf8ee0c796eb2f2d772fc3db35f6989960b860b0360f1aba5"}
Jul 13 09:13:39.581707 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:39.581640    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"146881d8-5cfc-45fe-a790-ca445f287b49","Type":"ContainerStarted","Data":"6ec288ef83505ae16507c6d923ecd195ff21c4cb6e0f18b8da8e6d710712b754"}
Jul 13 09:13:39.584292 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:39.584276    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw"
Jul 13 09:13:39.600417 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:39.600366    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-dd54f88f8-xdf46" podStartSLOduration=3.645181577 podStartE2EDuration="11.600347999s" totalImagesPullingTime="7.955166422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:13:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:13:39.595089458 +0000 UTC m=+308.672966710" watchObservedRunningTime="2026-07-13 09:13:39.600347999 +0000 UTC m=+308.678225247"
Jul 13 09:13:39.623358 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:39.623314    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-8554754dcd-wkrvw" podStartSLOduration=4.07029739 podStartE2EDuration="14.623298958s" totalImagesPullingTime="10.553001568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:13:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:13:39.621322497 +0000 UTC m=+308.699199773" watchObservedRunningTime="2026-07-13 09:13:39.623298958 +0000 UTC m=+308.701176212"
Jul 13 09:13:39.650938 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:39.648595    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-554b96bbd5-7ldpm" podStartSLOduration=3.694668636 podStartE2EDuration="11.648575156s" totalImagesPullingTime="7.95390652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:13:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:13:39.646477003 +0000 UTC m=+308.724354276" watchObservedRunningTime="2026-07-13 09:13:39.648575156 +0000 UTC m=+308.726452412"
Jul 13 09:13:39.677411 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:39.677363    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz" podStartSLOduration=3.727916157 podStartE2EDuration="11.677343224s" totalImagesPullingTime="7.949427067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:13:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:13:39.673142443 +0000 UTC m=+308.751019711" watchObservedRunningTime="2026-07-13 09:13:39.677343224 +0000 UTC m=+308.755220482"
Jul 13 09:13:40.366289 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:40.366257    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:13:40.475765 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:40.475737    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:13:40.589047 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:40.589011    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"146881d8-5cfc-45fe-a790-ca445f287b49","Type":"ContainerStarted","Data":"ddc75b1d2f9b711abbb8530f903c7c8c0435781e789538209393dd0a42a44f73"}
Jul 13 09:13:40.589548 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:40.589084    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"146881d8-5cfc-45fe-a790-ca445f287b49","Type":"ContainerStarted","Data":"ec7ca87f5afba10462849d7da2d71ae467ad6a1a08abed098e122abbe69e299a"}
Jul 13 09:13:40.592160 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:40.592133    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de1d3834-475b-47af-b3ec-5e67397be947","Type":"ContainerStarted","Data":"015620f032fa7a22ae516a3064c3b70e213d0f30bc56473ccd98fdb67e592bd0"}
Jul 13 09:13:40.592271 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:40.592190    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de1d3834-475b-47af-b3ec-5e67397be947","Type":"ContainerStarted","Data":"967b56e6b8f7ac3d1ed1538839c8d99b2fff3c70abe2e383f88a464c9a570c79"}
Jul 13 09:13:40.617310 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:40.617211    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.207410828 podStartE2EDuration="11.617192211s" totalImagesPullingTime="7.38798254s" totalInitContainerRuntime="21.798843ms" isStatefulPod=false podCreationTimestamp="2026-07-13 09:13:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:13:40.616658412 +0000 UTC m=+309.694535719" watchObservedRunningTime="2026-07-13 09:13:40.617192211 +0000 UTC m=+309.695069472"
Jul 13 09:13:40.642058 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:40.641989    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=7.025190926 podStartE2EDuration="16.641968755s" totalImagesPullingTime="9.572307725s" totalInitContainerRuntime="44.470104ms" isStatefulPod=false podCreationTimestamp="2026-07-13 09:13:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:13:40.641707756 +0000 UTC m=+309.719585038" watchObservedRunningTime="2026-07-13 09:13:40.641968755 +0000 UTC m=+309.719846010"
Jul 13 09:13:42.042998 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:42.042966    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6479ff8fc8-x4bkn"]
Jul 13 09:13:45.378319 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:45.378285    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:13:48.416709 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:48.416660    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:13:48.417089 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:48.416734    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:13:48.628246 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:48.628213    2553 generic.go:356] "Generic (PLEG): container finished" podID="33fa8a0a-8233-4229-8419-61d00b687381" containerID="ff5452abd49dc004db1951d9be6b6a9426b7c610db27ea902823d0a5d089c337" exitCode=0
Jul 13 09:13:48.628390 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:48.628287    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nkjv5" event={"ID":"33fa8a0a-8233-4229-8419-61d00b687381","Type":"ContainerDied","Data":"ff5452abd49dc004db1951d9be6b6a9426b7c610db27ea902823d0a5d089c337"}
Jul 13 09:13:48.628613 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:48.628601    2553 scope.go:117] "RemoveContainer" containerID="ff5452abd49dc004db1951d9be6b6a9426b7c610db27ea902823d0a5d089c337"
Jul 13 09:13:48.988699 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:48.988659    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:48.988890 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:48.988753    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:48.993602 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:48.993580    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:49.634116 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:49.634083    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nkjv5" event={"ID":"33fa8a0a-8233-4229-8419-61d00b687381","Type":"ContainerStarted","Data":"67701a1cafd4ae96fea05efaadb3b3fb06eed4dd7baf6cc589c7b9a528bdd1a9"}
Jul 13 09:13:49.638000 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:49.637976    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:13:51.717228 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:13:51.717199    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-554b96bbd5-7ldpm"]
Jul 13 09:14:03.692194 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:03.692161    2553 generic.go:356] "Generic (PLEG): container finished" podID="7f918b89-58ae-4153-a7ba-f73ae80030db" containerID="7a8c06a664be91699d8d639e153ecf04b6de3ae2a66d45f5f955e627f440630a" exitCode=0
Jul 13 09:14:03.692610 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:03.692228    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ddnmg" event={"ID":"7f918b89-58ae-4153-a7ba-f73ae80030db","Type":"ContainerDied","Data":"7a8c06a664be91699d8d639e153ecf04b6de3ae2a66d45f5f955e627f440630a"}
Jul 13 09:14:03.692610 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:03.692577    2553 scope.go:117] "RemoveContainer" containerID="7a8c06a664be91699d8d639e153ecf04b6de3ae2a66d45f5f955e627f440630a"
Jul 13 09:14:04.698481 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:04.698451    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ddnmg" event={"ID":"7f918b89-58ae-4153-a7ba-f73ae80030db","Type":"ContainerStarted","Data":"9ae01dfb5d1031bd2b5e7d040776d6cf7374ec20d792eeb932113a2357fb21bb"}
Jul 13 09:14:07.063169 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.063102    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn" podUID="eaa1f1f3-ea75-4c49-8ada-3cbe5125009d" containerName="registry" containerID="cri-o://a1245e5e8e3f1c27fd3f528715d3fa19aceeb62b98368a0185cadf9d32e87ef6" gracePeriod=30
Jul 13 09:14:07.350971 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.350936    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:14:07.441465 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.441433    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-installation-pull-secrets\") pod \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") "
Jul 13 09:14:07.441465 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.441469    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkbcm\" (UniqueName: \"kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-kube-api-access-wkbcm\") pod \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") "
Jul 13 09:14:07.441751 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.441492    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-certificates\") pod \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") "
Jul 13 09:14:07.441751 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.441514    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-bound-sa-token\") pod \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") "
Jul 13 09:14:07.441751 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.441531    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-image-registry-private-configuration\") pod \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") "
Jul 13 09:14:07.441751 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.441612    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls\") pod \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") "
Jul 13 09:14:07.441751 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.441731    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-trusted-ca\") pod \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") "
Jul 13 09:14:07.442008 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.441760    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-ca-trust-extracted\") pod \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\" (UID: \"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d\") "
Jul 13 09:14:07.442068 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.442040    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "eaa1f1f3-ea75-4c49-8ada-3cbe5125009d" (UID: "eaa1f1f3-ea75-4c49-8ada-3cbe5125009d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:14:07.442417 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.442377    2553 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-certificates\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:07.442550 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.442520    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "eaa1f1f3-ea75-4c49-8ada-3cbe5125009d" (UID: "eaa1f1f3-ea75-4c49-8ada-3cbe5125009d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:14:07.444286 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.444219    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "eaa1f1f3-ea75-4c49-8ada-3cbe5125009d" (UID: "eaa1f1f3-ea75-4c49-8ada-3cbe5125009d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:14:07.444398 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.444286    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "eaa1f1f3-ea75-4c49-8ada-3cbe5125009d" (UID: "eaa1f1f3-ea75-4c49-8ada-3cbe5125009d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:14:07.444398 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.444361    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-kube-api-access-wkbcm" (OuterVolumeSpecName: "kube-api-access-wkbcm") pod "eaa1f1f3-ea75-4c49-8ada-3cbe5125009d" (UID: "eaa1f1f3-ea75-4c49-8ada-3cbe5125009d"). InnerVolumeSpecName "kube-api-access-wkbcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:14:07.444398 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.444375    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "eaa1f1f3-ea75-4c49-8ada-3cbe5125009d" (UID: "eaa1f1f3-ea75-4c49-8ada-3cbe5125009d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:14:07.444521 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.444388    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "eaa1f1f3-ea75-4c49-8ada-3cbe5125009d" (UID: "eaa1f1f3-ea75-4c49-8ada-3cbe5125009d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:14:07.451829 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.451800    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "eaa1f1f3-ea75-4c49-8ada-3cbe5125009d" (UID: "eaa1f1f3-ea75-4c49-8ada-3cbe5125009d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 09:14:07.543780 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.543737    2553 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-installation-pull-secrets\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:07.543780 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.543768    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkbcm\" (UniqueName: \"kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-kube-api-access-wkbcm\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:07.543780 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.543779    2553 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-bound-sa-token\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:07.543780 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.543788    2553 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-image-registry-private-configuration\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:07.544042 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.543797    2553 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-registry-tls\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:07.544042 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.543807    2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-trusted-ca\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:07.544042 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.543814    2553 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d-ca-trust-extracted\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:07.711906 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.711872    2553 generic.go:356] "Generic (PLEG): container finished" podID="eaa1f1f3-ea75-4c49-8ada-3cbe5125009d" containerID="a1245e5e8e3f1c27fd3f528715d3fa19aceeb62b98368a0185cadf9d32e87ef6" exitCode=0
Jul 13 09:14:07.712122 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.711914    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn"
Jul 13 09:14:07.712122 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.711956    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn" event={"ID":"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d","Type":"ContainerDied","Data":"a1245e5e8e3f1c27fd3f528715d3fa19aceeb62b98368a0185cadf9d32e87ef6"}
Jul 13 09:14:07.712122 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.712000    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6479ff8fc8-x4bkn" event={"ID":"eaa1f1f3-ea75-4c49-8ada-3cbe5125009d","Type":"ContainerDied","Data":"ba67b98a121a6d52621f9c23e450e5d4198277df9900a70307dcb4d7df559219"}
Jul 13 09:14:07.712122 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.712027    2553 scope.go:117] "RemoveContainer" containerID="a1245e5e8e3f1c27fd3f528715d3fa19aceeb62b98368a0185cadf9d32e87ef6"
Jul 13 09:14:07.720295 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.720276    2553 scope.go:117] "RemoveContainer" containerID="a1245e5e8e3f1c27fd3f528715d3fa19aceeb62b98368a0185cadf9d32e87ef6"
Jul 13 09:14:07.720551 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:14:07.720531    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1245e5e8e3f1c27fd3f528715d3fa19aceeb62b98368a0185cadf9d32e87ef6\": container with ID starting with a1245e5e8e3f1c27fd3f528715d3fa19aceeb62b98368a0185cadf9d32e87ef6 not found: ID does not exist" containerID="a1245e5e8e3f1c27fd3f528715d3fa19aceeb62b98368a0185cadf9d32e87ef6"
Jul 13 09:14:07.720620 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.720558    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1245e5e8e3f1c27fd3f528715d3fa19aceeb62b98368a0185cadf9d32e87ef6"} err="failed to get container status \"a1245e5e8e3f1c27fd3f528715d3fa19aceeb62b98368a0185cadf9d32e87ef6\": rpc error: code = NotFound desc = could not find container \"a1245e5e8e3f1c27fd3f528715d3fa19aceeb62b98368a0185cadf9d32e87ef6\": container with ID starting with a1245e5e8e3f1c27fd3f528715d3fa19aceeb62b98368a0185cadf9d32e87ef6 not found: ID does not exist"
Jul 13 09:14:07.740308 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.740284    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6479ff8fc8-x4bkn"]
Jul 13 09:14:07.744614 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:07.744593    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6479ff8fc8-x4bkn"]
Jul 13 09:14:08.421702 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:08.421664    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:14:08.425537 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:08.425512    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-788976c5cc-tsjgz"
Jul 13 09:14:09.481501 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:09.481460    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaa1f1f3-ea75-4c49-8ada-3cbe5125009d" path="/var/lib/kubelet/pods/eaa1f1f3-ea75-4c49-8ada-3cbe5125009d/volumes"
Jul 13 09:14:13.738406 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:13.738372    2553 generic.go:356] "Generic (PLEG): container finished" podID="c63b1cf8-18be-4229-88d4-de471969a548" containerID="9b31dbde04d439b5d4a3301132bacd6d3c30cbc5a3ba44631fadb6a26845d041" exitCode=0
Jul 13 09:14:13.738406 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:13.738409    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-k6qjb" event={"ID":"c63b1cf8-18be-4229-88d4-de471969a548","Type":"ContainerDied","Data":"9b31dbde04d439b5d4a3301132bacd6d3c30cbc5a3ba44631fadb6a26845d041"}
Jul 13 09:14:13.738834 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:13.738739    2553 scope.go:117] "RemoveContainer" containerID="9b31dbde04d439b5d4a3301132bacd6d3c30cbc5a3ba44631fadb6a26845d041"
Jul 13 09:14:14.744538 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:14.744503    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-k6qjb" event={"ID":"c63b1cf8-18be-4229-88d4-de471969a548","Type":"ContainerStarted","Data":"4726b7fb33de04cec00d32f5142cbe13c0b3089a551da24d9892e291c43ff0e5"}
Jul 13 09:14:16.738320 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:16.738273    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-554b96bbd5-7ldpm" podUID="deec606c-1fe3-42c6-a50c-39a4a675a003" containerName="console" containerID="cri-o://2b4b2ba66f1cf6f5c81a18396210fdc51cd857cd4e2d4eed63e261fb2c1b355e" gracePeriod=15
Jul 13 09:14:17.015763 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.015707    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:14:17.131150 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.131121    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/deec606c-1fe3-42c6-a50c-39a4a675a003-console-serving-cert\") pod \"deec606c-1fe3-42c6-a50c-39a4a675a003\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") "
Jul 13 09:14:17.131308 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.131165    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/deec606c-1fe3-42c6-a50c-39a4a675a003-oauth-serving-cert\") pod \"deec606c-1fe3-42c6-a50c-39a4a675a003\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") "
Jul 13 09:14:17.131308 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.131189    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deec606c-1fe3-42c6-a50c-39a4a675a003-trusted-ca-bundle\") pod \"deec606c-1fe3-42c6-a50c-39a4a675a003\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") "
Jul 13 09:14:17.131433 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.131366    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/deec606c-1fe3-42c6-a50c-39a4a675a003-console-oauth-config\") pod \"deec606c-1fe3-42c6-a50c-39a4a675a003\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") "
Jul 13 09:14:17.131492 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.131440    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqfm9\" (UniqueName: \"kubernetes.io/projected/deec606c-1fe3-42c6-a50c-39a4a675a003-kube-api-access-cqfm9\") pod \"deec606c-1fe3-42c6-a50c-39a4a675a003\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") "
Jul 13 09:14:17.131492 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.131470    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/deec606c-1fe3-42c6-a50c-39a4a675a003-console-config\") pod \"deec606c-1fe3-42c6-a50c-39a4a675a003\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") "
Jul 13 09:14:17.131605 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.131511    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/deec606c-1fe3-42c6-a50c-39a4a675a003-service-ca\") pod \"deec606c-1fe3-42c6-a50c-39a4a675a003\" (UID: \"deec606c-1fe3-42c6-a50c-39a4a675a003\") "
Jul 13 09:14:17.131605 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.131538    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deec606c-1fe3-42c6-a50c-39a4a675a003-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "deec606c-1fe3-42c6-a50c-39a4a675a003" (UID: "deec606c-1fe3-42c6-a50c-39a4a675a003"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:14:17.131605 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.131579    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deec606c-1fe3-42c6-a50c-39a4a675a003-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "deec606c-1fe3-42c6-a50c-39a4a675a003" (UID: "deec606c-1fe3-42c6-a50c-39a4a675a003"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:14:17.131885 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.131861    2553 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/deec606c-1fe3-42c6-a50c-39a4a675a003-oauth-serving-cert\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:17.132030 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.131887    2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deec606c-1fe3-42c6-a50c-39a4a675a003-trusted-ca-bundle\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:17.132030 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.131955    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deec606c-1fe3-42c6-a50c-39a4a675a003-console-config" (OuterVolumeSpecName: "console-config") pod "deec606c-1fe3-42c6-a50c-39a4a675a003" (UID: "deec606c-1fe3-42c6-a50c-39a4a675a003"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:14:17.132120 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.132036    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deec606c-1fe3-42c6-a50c-39a4a675a003-service-ca" (OuterVolumeSpecName: "service-ca") pod "deec606c-1fe3-42c6-a50c-39a4a675a003" (UID: "deec606c-1fe3-42c6-a50c-39a4a675a003"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:14:17.133531 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.133507    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deec606c-1fe3-42c6-a50c-39a4a675a003-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "deec606c-1fe3-42c6-a50c-39a4a675a003" (UID: "deec606c-1fe3-42c6-a50c-39a4a675a003"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:14:17.133753 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.133726    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deec606c-1fe3-42c6-a50c-39a4a675a003-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "deec606c-1fe3-42c6-a50c-39a4a675a003" (UID: "deec606c-1fe3-42c6-a50c-39a4a675a003"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:14:17.133753 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.133732    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deec606c-1fe3-42c6-a50c-39a4a675a003-kube-api-access-cqfm9" (OuterVolumeSpecName: "kube-api-access-cqfm9") pod "deec606c-1fe3-42c6-a50c-39a4a675a003" (UID: "deec606c-1fe3-42c6-a50c-39a4a675a003"). InnerVolumeSpecName "kube-api-access-cqfm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:14:17.232442 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.232407    2553 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/deec606c-1fe3-42c6-a50c-39a4a675a003-console-serving-cert\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:17.232442 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.232435    2553 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/deec606c-1fe3-42c6-a50c-39a4a675a003-console-oauth-config\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:17.232442 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.232444    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqfm9\" (UniqueName: \"kubernetes.io/projected/deec606c-1fe3-42c6-a50c-39a4a675a003-kube-api-access-cqfm9\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:17.232664 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.232455    2553 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/deec606c-1fe3-42c6-a50c-39a4a675a003-console-config\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:17.232664 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.232464    2553 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/deec606c-1fe3-42c6-a50c-39a4a675a003-service-ca\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:17.758863 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.758780    2553 generic.go:356] "Generic (PLEG): container finished" podID="deec606c-1fe3-42c6-a50c-39a4a675a003" containerID="2b4b2ba66f1cf6f5c81a18396210fdc51cd857cd4e2d4eed63e261fb2c1b355e" exitCode=0
Jul 13 09:14:17.758863 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.758828    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554b96bbd5-7ldpm"
Jul 13 09:14:17.758863 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.758845    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554b96bbd5-7ldpm" event={"ID":"deec606c-1fe3-42c6-a50c-39a4a675a003","Type":"ContainerDied","Data":"2b4b2ba66f1cf6f5c81a18396210fdc51cd857cd4e2d4eed63e261fb2c1b355e"}
Jul 13 09:14:17.759369 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.758893    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554b96bbd5-7ldpm" event={"ID":"deec606c-1fe3-42c6-a50c-39a4a675a003","Type":"ContainerDied","Data":"8186f1044d4eaf56ea04f9e71a3abb4e0b4b5c88e09b04545746e528ebb37b90"}
Jul 13 09:14:17.759369 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.758919    2553 scope.go:117] "RemoveContainer" containerID="2b4b2ba66f1cf6f5c81a18396210fdc51cd857cd4e2d4eed63e261fb2c1b355e"
Jul 13 09:14:17.767499 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.767465    2553 scope.go:117] "RemoveContainer" containerID="2b4b2ba66f1cf6f5c81a18396210fdc51cd857cd4e2d4eed63e261fb2c1b355e"
Jul 13 09:14:17.767782 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:14:17.767761    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b4b2ba66f1cf6f5c81a18396210fdc51cd857cd4e2d4eed63e261fb2c1b355e\": container with ID starting with 2b4b2ba66f1cf6f5c81a18396210fdc51cd857cd4e2d4eed63e261fb2c1b355e not found: ID does not exist" containerID="2b4b2ba66f1cf6f5c81a18396210fdc51cd857cd4e2d4eed63e261fb2c1b355e"
Jul 13 09:14:17.767854 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.767791    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b4b2ba66f1cf6f5c81a18396210fdc51cd857cd4e2d4eed63e261fb2c1b355e"} err="failed to get container status \"2b4b2ba66f1cf6f5c81a18396210fdc51cd857cd4e2d4eed63e261fb2c1b355e\": rpc error: code = NotFound desc = could not find container \"2b4b2ba66f1cf6f5c81a18396210fdc51cd857cd4e2d4eed63e261fb2c1b355e\": container with ID starting with 2b4b2ba66f1cf6f5c81a18396210fdc51cd857cd4e2d4eed63e261fb2c1b355e not found: ID does not exist"
Jul 13 09:14:17.777835 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.777813    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-554b96bbd5-7ldpm"]
Jul 13 09:14:17.785559 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:17.785540    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-554b96bbd5-7ldpm"]
Jul 13 09:14:19.481004 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:19.480969    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="deec606c-1fe3-42c6-a50c-39a4a675a003" path="/var/lib/kubelet/pods/deec606c-1fe3-42c6-a50c-39a4a675a003/volumes"
Jul 13 09:14:30.379051 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:30.378966    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:30.398028 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:30.398002    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:30.833295 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:30.833231    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:44.219519 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:44.219482    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 09:14:44.220016 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:44.219852    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="alertmanager" containerID="cri-o://eda88bf4d780c15ae6576cd96d509e404d616e2791ba0f50156e6437f985ad88" gracePeriod=120
Jul 13 09:14:44.220016 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:44.219903    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="kube-rbac-proxy-metric" containerID="cri-o://967b56e6b8f7ac3d1ed1538839c8d99b2fff3c70abe2e383f88a464c9a570c79" gracePeriod=120
Jul 13 09:14:44.220016 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:44.219910    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="kube-rbac-proxy-web" containerID="cri-o://d62ed25f2be594839b6eb99be64c74ebc090576d2cf9cf19d5511bd47db2d319" gracePeriod=120
Jul 13 09:14:44.220016 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:44.219935    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="kube-rbac-proxy" containerID="cri-o://ab84f1ab518df48431003a809d7dbeabd389bc4ae3f2b3f99b88a9be4ae48236" gracePeriod=120
Jul 13 09:14:44.220016 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:44.219959    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="config-reloader" containerID="cri-o://97f7d99751ccc9b8565ad069c49dc30d556fcd4c39a625a45f011190393d77dc" gracePeriod=120
Jul 13 09:14:44.220016 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:44.219995    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="prom-label-proxy" containerID="cri-o://015620f032fa7a22ae516a3064c3b70e213d0f30bc56473ccd98fdb67e592bd0" gracePeriod=120
Jul 13 09:14:44.877045 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:44.877015    2553 generic.go:356] "Generic (PLEG): container finished" podID="de1d3834-475b-47af-b3ec-5e67397be947" containerID="015620f032fa7a22ae516a3064c3b70e213d0f30bc56473ccd98fdb67e592bd0" exitCode=0
Jul 13 09:14:44.877045 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:44.877041    2553 generic.go:356] "Generic (PLEG): container finished" podID="de1d3834-475b-47af-b3ec-5e67397be947" containerID="ab84f1ab518df48431003a809d7dbeabd389bc4ae3f2b3f99b88a9be4ae48236" exitCode=0
Jul 13 09:14:44.877045 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:44.877047    2553 generic.go:356] "Generic (PLEG): container finished" podID="de1d3834-475b-47af-b3ec-5e67397be947" containerID="97f7d99751ccc9b8565ad069c49dc30d556fcd4c39a625a45f011190393d77dc" exitCode=0
Jul 13 09:14:44.877045 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:44.877052    2553 generic.go:356] "Generic (PLEG): container finished" podID="de1d3834-475b-47af-b3ec-5e67397be947" containerID="eda88bf4d780c15ae6576cd96d509e404d616e2791ba0f50156e6437f985ad88" exitCode=0
Jul 13 09:14:44.877327 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:44.877070    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de1d3834-475b-47af-b3ec-5e67397be947","Type":"ContainerDied","Data":"015620f032fa7a22ae516a3064c3b70e213d0f30bc56473ccd98fdb67e592bd0"}
Jul 13 09:14:44.877327 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:44.877147    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de1d3834-475b-47af-b3ec-5e67397be947","Type":"ContainerDied","Data":"ab84f1ab518df48431003a809d7dbeabd389bc4ae3f2b3f99b88a9be4ae48236"}
Jul 13 09:14:44.877327 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:44.877174    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de1d3834-475b-47af-b3ec-5e67397be947","Type":"ContainerDied","Data":"97f7d99751ccc9b8565ad069c49dc30d556fcd4c39a625a45f011190393d77dc"}
Jul 13 09:14:44.877327 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:44.877198    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de1d3834-475b-47af-b3ec-5e67397be947","Type":"ContainerDied","Data":"eda88bf4d780c15ae6576cd96d509e404d616e2791ba0f50156e6437f985ad88"}
Jul 13 09:14:45.278018 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.277939    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs\") pod \"network-metrics-daemon-rrhxd\" (UID: \"caf4af40-8763-4401-8dd4-dfe646c17704\") " pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:14:45.280241 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.280219    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf4af40-8763-4401-8dd4-dfe646c17704-metrics-certs\") pod \"network-metrics-daemon-rrhxd\" (UID: \"caf4af40-8763-4401-8dd4-dfe646c17704\") " pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:14:45.469251 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.469230    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:45.579402 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.579323    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zlq2v\""
Jul 13 09:14:45.580500 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.580480    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/de1d3834-475b-47af-b3ec-5e67397be947-alertmanager-main-db\") pod \"de1d3834-475b-47af-b3ec-5e67397be947\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") "
Jul 13 09:14:45.580552 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.580512    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-secret-alertmanager-main-tls\") pod \"de1d3834-475b-47af-b3ec-5e67397be947\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") "
Jul 13 09:14:45.580552 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.580529    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-config-volume\") pod \"de1d3834-475b-47af-b3ec-5e67397be947\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") "
Jul 13 09:14:45.580650 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.580558    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de1d3834-475b-47af-b3ec-5e67397be947-metrics-client-ca\") pod \"de1d3834-475b-47af-b3ec-5e67397be947\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") "
Jul 13 09:14:45.580650 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.580587    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bq2bj\" (UniqueName: \"kubernetes.io/projected/de1d3834-475b-47af-b3ec-5e67397be947-kube-api-access-bq2bj\") pod \"de1d3834-475b-47af-b3ec-5e67397be947\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") "
Jul 13 09:14:45.580650 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.580628    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-secret-alertmanager-kube-rbac-proxy-web\") pod \"de1d3834-475b-47af-b3ec-5e67397be947\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") "
Jul 13 09:14:45.580868 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.580656    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-secret-alertmanager-kube-rbac-proxy-metric\") pod \"de1d3834-475b-47af-b3ec-5e67397be947\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") "
Jul 13 09:14:45.580868 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.580677    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1d3834-475b-47af-b3ec-5e67397be947-alertmanager-trusted-ca-bundle\") pod \"de1d3834-475b-47af-b3ec-5e67397be947\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") "
Jul 13 09:14:45.580868 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.580741    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-secret-alertmanager-kube-rbac-proxy\") pod \"de1d3834-475b-47af-b3ec-5e67397be947\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") "
Jul 13 09:14:45.580868 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.580777    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-cluster-tls-config\") pod \"de1d3834-475b-47af-b3ec-5e67397be947\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") "
Jul 13 09:14:45.580868 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.580801    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de1d3834-475b-47af-b3ec-5e67397be947-config-out\") pod \"de1d3834-475b-47af-b3ec-5e67397be947\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") "
Jul 13 09:14:45.580868 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.580841    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-web-config\") pod \"de1d3834-475b-47af-b3ec-5e67397be947\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") "
Jul 13 09:14:45.580868 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.580835    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de1d3834-475b-47af-b3ec-5e67397be947-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "de1d3834-475b-47af-b3ec-5e67397be947" (UID: "de1d3834-475b-47af-b3ec-5e67397be947"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 09:14:45.581288 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.580914    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de1d3834-475b-47af-b3ec-5e67397be947-tls-assets\") pod \"de1d3834-475b-47af-b3ec-5e67397be947\" (UID: \"de1d3834-475b-47af-b3ec-5e67397be947\") "
Jul 13 09:14:45.581288 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.580910    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de1d3834-475b-47af-b3ec-5e67397be947-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "de1d3834-475b-47af-b3ec-5e67397be947" (UID: "de1d3834-475b-47af-b3ec-5e67397be947"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:14:45.581288 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.581186    2553 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/de1d3834-475b-47af-b3ec-5e67397be947-alertmanager-main-db\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:45.581288 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.581208    2553 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de1d3834-475b-47af-b3ec-5e67397be947-metrics-client-ca\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:45.581492 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.581351    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de1d3834-475b-47af-b3ec-5e67397be947-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "de1d3834-475b-47af-b3ec-5e67397be947" (UID: "de1d3834-475b-47af-b3ec-5e67397be947"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:14:45.583406 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.583369    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "de1d3834-475b-47af-b3ec-5e67397be947" (UID: "de1d3834-475b-47af-b3ec-5e67397be947"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:14:45.583528 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.583439    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "de1d3834-475b-47af-b3ec-5e67397be947" (UID: "de1d3834-475b-47af-b3ec-5e67397be947"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:14:45.583644 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.583613    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-config-volume" (OuterVolumeSpecName: "config-volume") pod "de1d3834-475b-47af-b3ec-5e67397be947" (UID: "de1d3834-475b-47af-b3ec-5e67397be947"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:14:45.583847 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.583821    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de1d3834-475b-47af-b3ec-5e67397be947-kube-api-access-bq2bj" (OuterVolumeSpecName: "kube-api-access-bq2bj") pod "de1d3834-475b-47af-b3ec-5e67397be947" (UID: "de1d3834-475b-47af-b3ec-5e67397be947"). InnerVolumeSpecName "kube-api-access-bq2bj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:14:45.583923 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.583848    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de1d3834-475b-47af-b3ec-5e67397be947-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "de1d3834-475b-47af-b3ec-5e67397be947" (UID: "de1d3834-475b-47af-b3ec-5e67397be947"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:14:45.583923 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.583905    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "de1d3834-475b-47af-b3ec-5e67397be947" (UID: "de1d3834-475b-47af-b3ec-5e67397be947"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:14:45.584018 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.583978    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "de1d3834-475b-47af-b3ec-5e67397be947" (UID: "de1d3834-475b-47af-b3ec-5e67397be947"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:14:45.584956 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.584931    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de1d3834-475b-47af-b3ec-5e67397be947-config-out" (OuterVolumeSpecName: "config-out") pod "de1d3834-475b-47af-b3ec-5e67397be947" (UID: "de1d3834-475b-47af-b3ec-5e67397be947"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 09:14:45.587002 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.586980    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rrhxd"
Jul 13 09:14:45.588645 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.588617    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "de1d3834-475b-47af-b3ec-5e67397be947" (UID: "de1d3834-475b-47af-b3ec-5e67397be947"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:14:45.596177 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.596152    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-web-config" (OuterVolumeSpecName: "web-config") pod "de1d3834-475b-47af-b3ec-5e67397be947" (UID: "de1d3834-475b-47af-b3ec-5e67397be947"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:14:45.682225 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.682190    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq2bj\" (UniqueName: \"kubernetes.io/projected/de1d3834-475b-47af-b3ec-5e67397be947-kube-api-access-bq2bj\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:45.682225 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.682219    2553 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:45.682225 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.682230    2553 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:45.682478 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.682240    2553 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1d3834-475b-47af-b3ec-5e67397be947-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:45.682478 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.682251    2553 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:45.682478 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.682260    2553 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-cluster-tls-config\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:45.682478 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.682268    2553 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de1d3834-475b-47af-b3ec-5e67397be947-config-out\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:45.682478 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.682277    2553 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-web-config\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:45.682478 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.682284    2553 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de1d3834-475b-47af-b3ec-5e67397be947-tls-assets\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:45.682478 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.682292    2553 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-secret-alertmanager-main-tls\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:45.682478 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.682301    2553 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/de1d3834-475b-47af-b3ec-5e67397be947-config-volume\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:45.712353 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.712330    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rrhxd"]
Jul 13 09:14:45.714247 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:14:45.714220    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf4af40_8763_4401_8dd4_dfe646c17704.slice/crio-59c41a0346f51ee67b11894c5f3f0caa75bef0c72a346cc8d8881fe544e1d6ba WatchSource:0}: Error finding container 59c41a0346f51ee67b11894c5f3f0caa75bef0c72a346cc8d8881fe544e1d6ba: Status 404 returned error can't find the container with id 59c41a0346f51ee67b11894c5f3f0caa75bef0c72a346cc8d8881fe544e1d6ba
Jul 13 09:14:45.716096 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.716079    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 09:14:45.884330 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.884297    2553 generic.go:356] "Generic (PLEG): container finished" podID="de1d3834-475b-47af-b3ec-5e67397be947" containerID="967b56e6b8f7ac3d1ed1538839c8d99b2fff3c70abe2e383f88a464c9a570c79" exitCode=0
Jul 13 09:14:45.884330 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.884324    2553 generic.go:356] "Generic (PLEG): container finished" podID="de1d3834-475b-47af-b3ec-5e67397be947" containerID="d62ed25f2be594839b6eb99be64c74ebc090576d2cf9cf19d5511bd47db2d319" exitCode=0
Jul 13 09:14:45.884525 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.884345    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de1d3834-475b-47af-b3ec-5e67397be947","Type":"ContainerDied","Data":"967b56e6b8f7ac3d1ed1538839c8d99b2fff3c70abe2e383f88a464c9a570c79"}
Jul 13 09:14:45.884525 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.884373    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:45.884525 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.884418    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de1d3834-475b-47af-b3ec-5e67397be947","Type":"ContainerDied","Data":"d62ed25f2be594839b6eb99be64c74ebc090576d2cf9cf19d5511bd47db2d319"}
Jul 13 09:14:45.884525 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.884447    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de1d3834-475b-47af-b3ec-5e67397be947","Type":"ContainerDied","Data":"143d1c8936fd6d1cce44883fa31cd2fed0db00d017eb01a8bf17f108e6caaa19"}
Jul 13 09:14:45.884525 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.884492    2553 scope.go:117] "RemoveContainer" containerID="015620f032fa7a22ae516a3064c3b70e213d0f30bc56473ccd98fdb67e592bd0"
Jul 13 09:14:45.885630 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.885610    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rrhxd" event={"ID":"caf4af40-8763-4401-8dd4-dfe646c17704","Type":"ContainerStarted","Data":"59c41a0346f51ee67b11894c5f3f0caa75bef0c72a346cc8d8881fe544e1d6ba"}
Jul 13 09:14:45.892644 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.892629    2553 scope.go:117] "RemoveContainer" containerID="967b56e6b8f7ac3d1ed1538839c8d99b2fff3c70abe2e383f88a464c9a570c79"
Jul 13 09:14:45.899400 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.899386    2553 scope.go:117] "RemoveContainer" containerID="ab84f1ab518df48431003a809d7dbeabd389bc4ae3f2b3f99b88a9be4ae48236"
Jul 13 09:14:45.906106 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.906087    2553 scope.go:117] "RemoveContainer" containerID="d62ed25f2be594839b6eb99be64c74ebc090576d2cf9cf19d5511bd47db2d319"
Jul 13 09:14:45.909063 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.909043    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 09:14:45.913051 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.913033    2553 scope.go:117] "RemoveContainer" containerID="97f7d99751ccc9b8565ad069c49dc30d556fcd4c39a625a45f011190393d77dc"
Jul 13 09:14:45.914376 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.914359    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 09:14:45.919763 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.919748    2553 scope.go:117] "RemoveContainer" containerID="eda88bf4d780c15ae6576cd96d509e404d616e2791ba0f50156e6437f985ad88"
Jul 13 09:14:45.926580 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.926566    2553 scope.go:117] "RemoveContainer" containerID="739f0a4d15e5bb0cd7dc4b00783c0e173336362258bda13dab35fbae92e326e7"
Jul 13 09:14:45.933300 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.933285    2553 scope.go:117] "RemoveContainer" containerID="015620f032fa7a22ae516a3064c3b70e213d0f30bc56473ccd98fdb67e592bd0"
Jul 13 09:14:45.933529 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:14:45.933513    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"015620f032fa7a22ae516a3064c3b70e213d0f30bc56473ccd98fdb67e592bd0\": container with ID starting with 015620f032fa7a22ae516a3064c3b70e213d0f30bc56473ccd98fdb67e592bd0 not found: ID does not exist" containerID="015620f032fa7a22ae516a3064c3b70e213d0f30bc56473ccd98fdb67e592bd0"
Jul 13 09:14:45.933575 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.933542    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"015620f032fa7a22ae516a3064c3b70e213d0f30bc56473ccd98fdb67e592bd0"} err="failed to get container status \"015620f032fa7a22ae516a3064c3b70e213d0f30bc56473ccd98fdb67e592bd0\": rpc error: code = NotFound desc = could not find container \"015620f032fa7a22ae516a3064c3b70e213d0f30bc56473ccd98fdb67e592bd0\": container with ID starting with 015620f032fa7a22ae516a3064c3b70e213d0f30bc56473ccd98fdb67e592bd0 not found: ID does not exist"
Jul 13 09:14:45.933575 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.933560    2553 scope.go:117] "RemoveContainer" containerID="967b56e6b8f7ac3d1ed1538839c8d99b2fff3c70abe2e383f88a464c9a570c79"
Jul 13 09:14:45.933791 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:14:45.933774    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"967b56e6b8f7ac3d1ed1538839c8d99b2fff3c70abe2e383f88a464c9a570c79\": container with ID starting with 967b56e6b8f7ac3d1ed1538839c8d99b2fff3c70abe2e383f88a464c9a570c79 not found: ID does not exist" containerID="967b56e6b8f7ac3d1ed1538839c8d99b2fff3c70abe2e383f88a464c9a570c79"
Jul 13 09:14:45.933835 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.933797    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"967b56e6b8f7ac3d1ed1538839c8d99b2fff3c70abe2e383f88a464c9a570c79"} err="failed to get container status \"967b56e6b8f7ac3d1ed1538839c8d99b2fff3c70abe2e383f88a464c9a570c79\": rpc error: code = NotFound desc = could not find container \"967b56e6b8f7ac3d1ed1538839c8d99b2fff3c70abe2e383f88a464c9a570c79\": container with ID starting with 967b56e6b8f7ac3d1ed1538839c8d99b2fff3c70abe2e383f88a464c9a570c79 not found: ID does not exist"
Jul 13 09:14:45.933835 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.933814    2553 scope.go:117] "RemoveContainer" containerID="ab84f1ab518df48431003a809d7dbeabd389bc4ae3f2b3f99b88a9be4ae48236"
Jul 13 09:14:45.934043 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:14:45.934028    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab84f1ab518df48431003a809d7dbeabd389bc4ae3f2b3f99b88a9be4ae48236\": container with ID starting with ab84f1ab518df48431003a809d7dbeabd389bc4ae3f2b3f99b88a9be4ae48236 not found: ID does not exist" containerID="ab84f1ab518df48431003a809d7dbeabd389bc4ae3f2b3f99b88a9be4ae48236"
Jul 13 09:14:45.934091 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.934045    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab84f1ab518df48431003a809d7dbeabd389bc4ae3f2b3f99b88a9be4ae48236"} err="failed to get container status \"ab84f1ab518df48431003a809d7dbeabd389bc4ae3f2b3f99b88a9be4ae48236\": rpc error: code = NotFound desc = could not find container \"ab84f1ab518df48431003a809d7dbeabd389bc4ae3f2b3f99b88a9be4ae48236\": container with ID starting with ab84f1ab518df48431003a809d7dbeabd389bc4ae3f2b3f99b88a9be4ae48236 not found: ID does not exist"
Jul 13 09:14:45.934091 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.934056    2553 scope.go:117] "RemoveContainer" containerID="d62ed25f2be594839b6eb99be64c74ebc090576d2cf9cf19d5511bd47db2d319"
Jul 13 09:14:45.934253 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:14:45.934228    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d62ed25f2be594839b6eb99be64c74ebc090576d2cf9cf19d5511bd47db2d319\": container with ID starting with d62ed25f2be594839b6eb99be64c74ebc090576d2cf9cf19d5511bd47db2d319 not found: ID does not exist" containerID="d62ed25f2be594839b6eb99be64c74ebc090576d2cf9cf19d5511bd47db2d319"
Jul 13 09:14:45.934294 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.934258    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d62ed25f2be594839b6eb99be64c74ebc090576d2cf9cf19d5511bd47db2d319"} err="failed to get container status \"d62ed25f2be594839b6eb99be64c74ebc090576d2cf9cf19d5511bd47db2d319\": rpc error: code = NotFound desc = could not find container \"d62ed25f2be594839b6eb99be64c74ebc090576d2cf9cf19d5511bd47db2d319\": container with ID starting with d62ed25f2be594839b6eb99be64c74ebc090576d2cf9cf19d5511bd47db2d319 not found: ID does not exist"
Jul 13 09:14:45.934294 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.934271    2553 scope.go:117] "RemoveContainer" containerID="97f7d99751ccc9b8565ad069c49dc30d556fcd4c39a625a45f011190393d77dc"
Jul 13 09:14:45.934478 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:14:45.934462    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97f7d99751ccc9b8565ad069c49dc30d556fcd4c39a625a45f011190393d77dc\": container with ID starting with 97f7d99751ccc9b8565ad069c49dc30d556fcd4c39a625a45f011190393d77dc not found: ID does not exist" containerID="97f7d99751ccc9b8565ad069c49dc30d556fcd4c39a625a45f011190393d77dc"
Jul 13 09:14:45.934520 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.934483    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97f7d99751ccc9b8565ad069c49dc30d556fcd4c39a625a45f011190393d77dc"} err="failed to get container status \"97f7d99751ccc9b8565ad069c49dc30d556fcd4c39a625a45f011190393d77dc\": rpc error: code = NotFound desc = could not find container \"97f7d99751ccc9b8565ad069c49dc30d556fcd4c39a625a45f011190393d77dc\": container with ID starting with 97f7d99751ccc9b8565ad069c49dc30d556fcd4c39a625a45f011190393d77dc not found: ID does not exist"
Jul 13 09:14:45.934520 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.934495    2553 scope.go:117] "RemoveContainer" containerID="eda88bf4d780c15ae6576cd96d509e404d616e2791ba0f50156e6437f985ad88"
Jul 13 09:14:45.934776 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:14:45.934753    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eda88bf4d780c15ae6576cd96d509e404d616e2791ba0f50156e6437f985ad88\": container with ID starting with eda88bf4d780c15ae6576cd96d509e404d616e2791ba0f50156e6437f985ad88 not found: ID does not exist" containerID="eda88bf4d780c15ae6576cd96d509e404d616e2791ba0f50156e6437f985ad88"
Jul 13 09:14:45.934859 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.934783    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eda88bf4d780c15ae6576cd96d509e404d616e2791ba0f50156e6437f985ad88"} err="failed to get container status \"eda88bf4d780c15ae6576cd96d509e404d616e2791ba0f50156e6437f985ad88\": rpc error: code = NotFound desc = could not find container \"eda88bf4d780c15ae6576cd96d509e404d616e2791ba0f50156e6437f985ad88\": container with ID starting with eda88bf4d780c15ae6576cd96d509e404d616e2791ba0f50156e6437f985ad88 not found: ID does not exist"
Jul 13 09:14:45.934859 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.934806    2553 scope.go:117] "RemoveContainer" containerID="739f0a4d15e5bb0cd7dc4b00783c0e173336362258bda13dab35fbae92e326e7"
Jul 13 09:14:45.935107 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:14:45.935085    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"739f0a4d15e5bb0cd7dc4b00783c0e173336362258bda13dab35fbae92e326e7\": container with ID starting with 739f0a4d15e5bb0cd7dc4b00783c0e173336362258bda13dab35fbae92e326e7 not found: ID does not exist" containerID="739f0a4d15e5bb0cd7dc4b00783c0e173336362258bda13dab35fbae92e326e7"
Jul 13 09:14:45.935185 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.935112    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"739f0a4d15e5bb0cd7dc4b00783c0e173336362258bda13dab35fbae92e326e7"} err="failed to get container status \"739f0a4d15e5bb0cd7dc4b00783c0e173336362258bda13dab35fbae92e326e7\": rpc error: code = NotFound desc = could not find container \"739f0a4d15e5bb0cd7dc4b00783c0e173336362258bda13dab35fbae92e326e7\": container with ID starting with 739f0a4d15e5bb0cd7dc4b00783c0e173336362258bda13dab35fbae92e326e7 not found: ID does not exist"
Jul 13 09:14:45.935185 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.935131    2553 scope.go:117] "RemoveContainer" containerID="015620f032fa7a22ae516a3064c3b70e213d0f30bc56473ccd98fdb67e592bd0"
Jul 13 09:14:45.935431 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.935410    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"015620f032fa7a22ae516a3064c3b70e213d0f30bc56473ccd98fdb67e592bd0"} err="failed to get container status \"015620f032fa7a22ae516a3064c3b70e213d0f30bc56473ccd98fdb67e592bd0\": rpc error: code = NotFound desc = could not find container \"015620f032fa7a22ae516a3064c3b70e213d0f30bc56473ccd98fdb67e592bd0\": container with ID starting with 015620f032fa7a22ae516a3064c3b70e213d0f30bc56473ccd98fdb67e592bd0 not found: ID does not exist"
Jul 13 09:14:45.935431 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.935429    2553 scope.go:117] "RemoveContainer" containerID="967b56e6b8f7ac3d1ed1538839c8d99b2fff3c70abe2e383f88a464c9a570c79"
Jul 13 09:14:45.935729 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.935680    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"967b56e6b8f7ac3d1ed1538839c8d99b2fff3c70abe2e383f88a464c9a570c79"} err="failed to get container status \"967b56e6b8f7ac3d1ed1538839c8d99b2fff3c70abe2e383f88a464c9a570c79\": rpc error: code = NotFound desc = could not find container \"967b56e6b8f7ac3d1ed1538839c8d99b2fff3c70abe2e383f88a464c9a570c79\": container with ID starting with 967b56e6b8f7ac3d1ed1538839c8d99b2fff3c70abe2e383f88a464c9a570c79 not found: ID does not exist"
Jul 13 09:14:45.935809 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.935730    2553 scope.go:117] "RemoveContainer" containerID="ab84f1ab518df48431003a809d7dbeabd389bc4ae3f2b3f99b88a9be4ae48236"
Jul 13 09:14:45.935978 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.935957    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab84f1ab518df48431003a809d7dbeabd389bc4ae3f2b3f99b88a9be4ae48236"} err="failed to get container status \"ab84f1ab518df48431003a809d7dbeabd389bc4ae3f2b3f99b88a9be4ae48236\": rpc error: code = NotFound desc = could not find container \"ab84f1ab518df48431003a809d7dbeabd389bc4ae3f2b3f99b88a9be4ae48236\": container with ID starting with ab84f1ab518df48431003a809d7dbeabd389bc4ae3f2b3f99b88a9be4ae48236 not found: ID does not exist"
Jul 13 09:14:45.935978 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.935978    2553 scope.go:117] "RemoveContainer" containerID="d62ed25f2be594839b6eb99be64c74ebc090576d2cf9cf19d5511bd47db2d319"
Jul 13 09:14:45.936191 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.936173    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d62ed25f2be594839b6eb99be64c74ebc090576d2cf9cf19d5511bd47db2d319"} err="failed to get container status \"d62ed25f2be594839b6eb99be64c74ebc090576d2cf9cf19d5511bd47db2d319\": rpc error: code = NotFound desc = could not find container \"d62ed25f2be594839b6eb99be64c74ebc090576d2cf9cf19d5511bd47db2d319\": container with ID starting with d62ed25f2be594839b6eb99be64c74ebc090576d2cf9cf19d5511bd47db2d319 not found: ID does not exist"
Jul 13 09:14:45.936264 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.936194    2553 scope.go:117] "RemoveContainer" containerID="97f7d99751ccc9b8565ad069c49dc30d556fcd4c39a625a45f011190393d77dc"
Jul 13 09:14:45.936436 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.936416    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97f7d99751ccc9b8565ad069c49dc30d556fcd4c39a625a45f011190393d77dc"} err="failed to get container status \"97f7d99751ccc9b8565ad069c49dc30d556fcd4c39a625a45f011190393d77dc\": rpc error: code = NotFound desc = could not find container \"97f7d99751ccc9b8565ad069c49dc30d556fcd4c39a625a45f011190393d77dc\": container with ID starting with 97f7d99751ccc9b8565ad069c49dc30d556fcd4c39a625a45f011190393d77dc not found: ID does not exist"
Jul 13 09:14:45.936436 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.936435    2553 scope.go:117] "RemoveContainer" containerID="eda88bf4d780c15ae6576cd96d509e404d616e2791ba0f50156e6437f985ad88"
Jul 13 09:14:45.936652 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.936613    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eda88bf4d780c15ae6576cd96d509e404d616e2791ba0f50156e6437f985ad88"} err="failed to get container status \"eda88bf4d780c15ae6576cd96d509e404d616e2791ba0f50156e6437f985ad88\": rpc error: code = NotFound desc = could not find container \"eda88bf4d780c15ae6576cd96d509e404d616e2791ba0f50156e6437f985ad88\": container with ID starting with eda88bf4d780c15ae6576cd96d509e404d616e2791ba0f50156e6437f985ad88 not found: ID does not exist"
Jul 13 09:14:45.936652 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.936634    2553 scope.go:117] "RemoveContainer" containerID="739f0a4d15e5bb0cd7dc4b00783c0e173336362258bda13dab35fbae92e326e7"
Jul 13 09:14:45.936829 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.936814    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"739f0a4d15e5bb0cd7dc4b00783c0e173336362258bda13dab35fbae92e326e7"} err="failed to get container status \"739f0a4d15e5bb0cd7dc4b00783c0e173336362258bda13dab35fbae92e326e7\": rpc error: code = NotFound desc = could not find container \"739f0a4d15e5bb0cd7dc4b00783c0e173336362258bda13dab35fbae92e326e7\": container with ID starting with 739f0a4d15e5bb0cd7dc4b00783c0e173336362258bda13dab35fbae92e326e7 not found: ID does not exist"
Jul 13 09:14:45.950092 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950072    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 09:14:45.950376 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950364    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="config-reloader"
Jul 13 09:14:45.950415 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950377    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="config-reloader"
Jul 13 09:14:45.950415 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950387    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaa1f1f3-ea75-4c49-8ada-3cbe5125009d" containerName="registry"
Jul 13 09:14:45.950415 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950393    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaa1f1f3-ea75-4c49-8ada-3cbe5125009d" containerName="registry"
Jul 13 09:14:45.950415 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950402    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="alertmanager"
Jul 13 09:14:45.950415 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950407    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="alertmanager"
Jul 13 09:14:45.950581 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950417    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deec606c-1fe3-42c6-a50c-39a4a675a003" containerName="console"
Jul 13 09:14:45.950581 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950423    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="deec606c-1fe3-42c6-a50c-39a4a675a003" containerName="console"
Jul 13 09:14:45.950581 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950428    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="kube-rbac-proxy-metric"
Jul 13 09:14:45.950581 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950433    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="kube-rbac-proxy-metric"
Jul 13 09:14:45.950581 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950443    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="prom-label-proxy"
Jul 13 09:14:45.950581 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950449    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="prom-label-proxy"
Jul 13 09:14:45.950581 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950456    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="init-config-reloader"
Jul 13 09:14:45.950581 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950461    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="init-config-reloader"
Jul 13 09:14:45.950581 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950468    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="kube-rbac-proxy"
Jul 13 09:14:45.950581 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950473    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="kube-rbac-proxy"
Jul 13 09:14:45.950581 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950483    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="kube-rbac-proxy-web"
Jul 13 09:14:45.950581 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950488    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="kube-rbac-proxy-web"
Jul 13 09:14:45.950581 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950548    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaa1f1f3-ea75-4c49-8ada-3cbe5125009d" containerName="registry"
Jul 13 09:14:45.950581 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950554    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="deec606c-1fe3-42c6-a50c-39a4a675a003" containerName="console"
Jul 13 09:14:45.950581 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950563    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="config-reloader"
Jul 13 09:14:45.950581 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950568    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="kube-rbac-proxy-web"
Jul 13 09:14:45.950581 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950573    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="kube-rbac-proxy"
Jul 13 09:14:45.950581 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950580    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="alertmanager"
Jul 13 09:14:45.950581 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950587    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="prom-label-proxy"
Jul 13 09:14:45.951176 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.950593    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="de1d3834-475b-47af-b3ec-5e67397be947" containerName="kube-rbac-proxy-metric"
Jul 13 09:14:45.953852 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.953838    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:45.959129 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.959109    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mjbqh\""
Jul 13 09:14:45.959248 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.959111    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 13 09:14:45.959342 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.959244    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 13 09:14:45.959484 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.959462    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 13 09:14:45.959672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.959638    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 13 09:14:45.959785 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.959673    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 13 09:14:45.960126 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.960008    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 13 09:14:45.960126 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.960046    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 13 09:14:45.960249 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.960174    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 13 09:14:45.966599 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.966582    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 13 09:14:45.982718 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:45.982698    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 09:14:46.084754 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.084719    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0982d942-fa73-4586-8da4-223657639e15-config-out\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.084754 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.084751    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxhb8\" (UniqueName: \"kubernetes.io/projected/0982d942-fa73-4586-8da4-223657639e15-kube-api-access-qxhb8\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.084969 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.084827    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0982d942-fa73-4586-8da4-223657639e15-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.084969 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.084902    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0982d942-fa73-4586-8da4-223657639e15-web-config\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.084969 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.084931    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0982d942-fa73-4586-8da4-223657639e15-config-volume\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.084969 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.084964    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0982d942-fa73-4586-8da4-223657639e15-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.085118 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.084995    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0982d942-fa73-4586-8da4-223657639e15-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.085118 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.085019    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0982d942-fa73-4586-8da4-223657639e15-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.085118 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.085037    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0982d942-fa73-4586-8da4-223657639e15-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.085118 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.085056    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0982d942-fa73-4586-8da4-223657639e15-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.085118 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.085100    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0982d942-fa73-4586-8da4-223657639e15-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.085287 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.085137    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0982d942-fa73-4586-8da4-223657639e15-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.085287 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.085158    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0982d942-fa73-4586-8da4-223657639e15-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.186151 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.186068    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0982d942-fa73-4586-8da4-223657639e15-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.186151 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.186106    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0982d942-fa73-4586-8da4-223657639e15-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.186151 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.186139    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0982d942-fa73-4586-8da4-223657639e15-config-out\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.186466 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.186163    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxhb8\" (UniqueName: \"kubernetes.io/projected/0982d942-fa73-4586-8da4-223657639e15-kube-api-access-qxhb8\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.186466 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.186188    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0982d942-fa73-4586-8da4-223657639e15-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.186466 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.186251    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0982d942-fa73-4586-8da4-223657639e15-web-config\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.186466 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.186279    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0982d942-fa73-4586-8da4-223657639e15-config-volume\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.186466 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.186325    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0982d942-fa73-4586-8da4-223657639e15-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.186466 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.186353    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0982d942-fa73-4586-8da4-223657639e15-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.186466 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.186379    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0982d942-fa73-4586-8da4-223657639e15-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.186466 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.186405    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0982d942-fa73-4586-8da4-223657639e15-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.186466 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.186430    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0982d942-fa73-4586-8da4-223657639e15-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.186466 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.186460    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0982d942-fa73-4586-8da4-223657639e15-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.187151 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.187126    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0982d942-fa73-4586-8da4-223657639e15-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.188109 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.188080    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0982d942-fa73-4586-8da4-223657639e15-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.189032 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.189009    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0982d942-fa73-4586-8da4-223657639e15-config-out\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.189131 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.189044    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0982d942-fa73-4586-8da4-223657639e15-web-config\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.189131 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.189090    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0982d942-fa73-4586-8da4-223657639e15-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.189364 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.189302    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0982d942-fa73-4586-8da4-223657639e15-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.189364 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.189316    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0982d942-fa73-4586-8da4-223657639e15-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.189494 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.189369    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0982d942-fa73-4586-8da4-223657639e15-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.189615 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.189597    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0982d942-fa73-4586-8da4-223657639e15-config-volume\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.190384 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.190363    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0982d942-fa73-4586-8da4-223657639e15-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.190539 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.190522    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0982d942-fa73-4586-8da4-223657639e15-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.190945 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.190928    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0982d942-fa73-4586-8da4-223657639e15-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.196467 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.196449    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxhb8\" (UniqueName: \"kubernetes.io/projected/0982d942-fa73-4586-8da4-223657639e15-kube-api-access-qxhb8\") pod \"alertmanager-main-0\" (UID: \"0982d942-fa73-4586-8da4-223657639e15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.262820 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.262791    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 09:14:46.426673 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.426638    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 09:14:46.430196 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:14:46.430159    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0982d942_fa73_4586_8da4_223657639e15.slice/crio-f993e0852a77cc492c7dbc14a045df14309d39289c34ac90d56f4d2cf66cba8a WatchSource:0}: Error finding container f993e0852a77cc492c7dbc14a045df14309d39289c34ac90d56f4d2cf66cba8a: Status 404 returned error can't find the container with id f993e0852a77cc492c7dbc14a045df14309d39289c34ac90d56f4d2cf66cba8a
Jul 13 09:14:46.891029 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.891001    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rrhxd" event={"ID":"caf4af40-8763-4401-8dd4-dfe646c17704","Type":"ContainerStarted","Data":"cf1a1c43047ab71f43680b31d67e9269e03208ea819d5a17011df5685fa54fde"}
Jul 13 09:14:46.891180 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.891049    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rrhxd" event={"ID":"caf4af40-8763-4401-8dd4-dfe646c17704","Type":"ContainerStarted","Data":"2438204db11de67f7d009e398c2ae04a69712702c2fc126e52f43f7cb1e52919"}
Jul 13 09:14:46.893221 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.893198    2553 generic.go:356] "Generic (PLEG): container finished" podID="0982d942-fa73-4586-8da4-223657639e15" containerID="acc83d93953295e171d9ffcbafbde72900ae7d06bf2d6e4a552867202814e1a5" exitCode=0
Jul 13 09:14:46.893306 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.893237    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0982d942-fa73-4586-8da4-223657639e15","Type":"ContainerDied","Data":"acc83d93953295e171d9ffcbafbde72900ae7d06bf2d6e4a552867202814e1a5"}
Jul 13 09:14:46.893306 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.893284    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0982d942-fa73-4586-8da4-223657639e15","Type":"ContainerStarted","Data":"f993e0852a77cc492c7dbc14a045df14309d39289c34ac90d56f4d2cf66cba8a"}
Jul 13 09:14:46.910325 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:46.910282    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rrhxd" podStartSLOduration=373.947702815 podStartE2EDuration="6m14.910267197s" totalImagesPullingTime="962.564382ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:14:46.908928726 +0000 UTC m=+375.986805982" watchObservedRunningTime="2026-07-13 09:14:46.910267197 +0000 UTC m=+375.988144451"
Jul 13 09:14:47.481553 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:47.481471    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de1d3834-475b-47af-b3ec-5e67397be947" path="/var/lib/kubelet/pods/de1d3834-475b-47af-b3ec-5e67397be947/volumes"
Jul 13 09:14:47.901220 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:47.901187    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0982d942-fa73-4586-8da4-223657639e15","Type":"ContainerStarted","Data":"e2769d18f923b45ea48a695fac9f6fc9db778ed7e282980cc603b38574b5258f"}
Jul 13 09:14:47.901395 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:47.901264    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0982d942-fa73-4586-8da4-223657639e15","Type":"ContainerStarted","Data":"35f351dce7458cfda9a872664f3f04c5cfb55c66a7388d2c5a658e945401490e"}
Jul 13 09:14:47.901395 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:47.901304    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0982d942-fa73-4586-8da4-223657639e15","Type":"ContainerStarted","Data":"4a3712e4245bb33f4c10046597e7eaea9f40b7947a9f53712bb28f052a9c78a9"}
Jul 13 09:14:47.901395 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:47.901340    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0982d942-fa73-4586-8da4-223657639e15","Type":"ContainerStarted","Data":"55c20e0f83348ed6c4ad19861c8a9497fe44087529ac635402c66257097420f4"}
Jul 13 09:14:47.901395 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:47.901373    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0982d942-fa73-4586-8da4-223657639e15","Type":"ContainerStarted","Data":"109355a0ac4d8074ef48e0ddd9a885c60ea48e4a81c0a94dbed65bd0dd889e85"}
Jul 13 09:14:47.901596 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:47.901412    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0982d942-fa73-4586-8da4-223657639e15","Type":"ContainerStarted","Data":"1dd99353d02cd60406149fbca6a3219a290dcb6097696258ab7395958de0498e"}
Jul 13 09:14:47.937330 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:47.937277    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.920833519 podStartE2EDuration="2.937256152s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.422633ms" isStatefulPod=false podCreationTimestamp="2026-07-13 09:14:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:14:47.934732489 +0000 UTC m=+377.012609763" watchObservedRunningTime="2026-07-13 09:14:47.937256152 +0000 UTC m=+377.015133409"
Jul 13 09:14:48.440885 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:48.440855    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 09:14:48.441145 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:48.441107    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="prometheus" containerID="cri-o://6ec288ef83505ae16507c6d923ecd195ff21c4cb6e0f18b8da8e6d710712b754" gracePeriod=600
Jul 13 09:14:48.441145 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:48.441115    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="kube-rbac-proxy" containerID="cri-o://ec7ca87f5afba10462849d7da2d71ae467ad6a1a08abed098e122abbe69e299a" gracePeriod=600
Jul 13 09:14:48.441343 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:48.441162    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="kube-rbac-proxy-thanos" containerID="cri-o://ddc75b1d2f9b711abbb8530f903c7c8c0435781e789538209393dd0a42a44f73" gracePeriod=600
Jul 13 09:14:48.441343 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:48.441165    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="thanos-sidecar" containerID="cri-o://91cdbc985b4b0cc2aca073fc345b00d15011f16731beaf405d9deb070a51bba5" gracePeriod=600
Jul 13 09:14:48.441343 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:48.441171    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="kube-rbac-proxy-web" containerID="cri-o://ec6eb121fc0dfa406fd86e7575b518028de946fbcb13f01896266244643c5c24" gracePeriod=600
Jul 13 09:14:48.441343 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:48.441253    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="config-reloader" containerID="cri-o://3eef0b1441f4f6cbf8ee0c796eb2f2d772fc3db35f6989960b860b0360f1aba5" gracePeriod=600
Jul 13 09:14:48.910002 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:48.909975    2553 generic.go:356] "Generic (PLEG): container finished" podID="146881d8-5cfc-45fe-a790-ca445f287b49" containerID="ddc75b1d2f9b711abbb8530f903c7c8c0435781e789538209393dd0a42a44f73" exitCode=0
Jul 13 09:14:48.910002 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:48.909999    2553 generic.go:356] "Generic (PLEG): container finished" podID="146881d8-5cfc-45fe-a790-ca445f287b49" containerID="ec7ca87f5afba10462849d7da2d71ae467ad6a1a08abed098e122abbe69e299a" exitCode=0
Jul 13 09:14:48.910002 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:48.910005    2553 generic.go:356] "Generic (PLEG): container finished" podID="146881d8-5cfc-45fe-a790-ca445f287b49" containerID="91cdbc985b4b0cc2aca073fc345b00d15011f16731beaf405d9deb070a51bba5" exitCode=0
Jul 13 09:14:48.910002 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:48.910011    2553 generic.go:356] "Generic (PLEG): container finished" podID="146881d8-5cfc-45fe-a790-ca445f287b49" containerID="3eef0b1441f4f6cbf8ee0c796eb2f2d772fc3db35f6989960b860b0360f1aba5" exitCode=0
Jul 13 09:14:48.910516 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:48.910016    2553 generic.go:356] "Generic (PLEG): container finished" podID="146881d8-5cfc-45fe-a790-ca445f287b49" containerID="6ec288ef83505ae16507c6d923ecd195ff21c4cb6e0f18b8da8e6d710712b754" exitCode=0
Jul 13 09:14:48.910516 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:48.910052    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"146881d8-5cfc-45fe-a790-ca445f287b49","Type":"ContainerDied","Data":"ddc75b1d2f9b711abbb8530f903c7c8c0435781e789538209393dd0a42a44f73"}
Jul 13 09:14:48.910516 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:48.910136    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"146881d8-5cfc-45fe-a790-ca445f287b49","Type":"ContainerDied","Data":"ec7ca87f5afba10462849d7da2d71ae467ad6a1a08abed098e122abbe69e299a"}
Jul 13 09:14:48.910516 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:48.910178    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"146881d8-5cfc-45fe-a790-ca445f287b49","Type":"ContainerDied","Data":"91cdbc985b4b0cc2aca073fc345b00d15011f16731beaf405d9deb070a51bba5"}
Jul 13 09:14:48.910516 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:48.910229    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"146881d8-5cfc-45fe-a790-ca445f287b49","Type":"ContainerDied","Data":"3eef0b1441f4f6cbf8ee0c796eb2f2d772fc3db35f6989960b860b0360f1aba5"}
Jul 13 09:14:48.910516 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:48.910272    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"146881d8-5cfc-45fe-a790-ca445f287b49","Type":"ContainerDied","Data":"6ec288ef83505ae16507c6d923ecd195ff21c4cb6e0f18b8da8e6d710712b754"}
Jul 13 09:14:49.695074 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.695051    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:49.817443 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.817352    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qh4cn\" (UniqueName: \"kubernetes.io/projected/146881d8-5cfc-45fe-a790-ca445f287b49-kube-api-access-qh4cn\") pod \"146881d8-5cfc-45fe-a790-ca445f287b49\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") "
Jul 13 09:14:49.817443 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.817405    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-trusted-ca-bundle\") pod \"146881d8-5cfc-45fe-a790-ca445f287b49\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") "
Jul 13 09:14:49.817443 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.817430    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-configmap-kubelet-serving-ca-bundle\") pod \"146881d8-5cfc-45fe-a790-ca445f287b49\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") "
Jul 13 09:14:49.817778 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.817448    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-k8s-db\") pod \"146881d8-5cfc-45fe-a790-ca445f287b49\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") "
Jul 13 09:14:49.817778 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.817474    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-web-config\") pod \"146881d8-5cfc-45fe-a790-ca445f287b49\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") "
Jul 13 09:14:49.817778 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.817521    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-k8s-rulefiles-2\") pod \"146881d8-5cfc-45fe-a790-ca445f287b49\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") "
Jul 13 09:14:49.817778 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.817545    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/146881d8-5cfc-45fe-a790-ca445f287b49-config-out\") pod \"146881d8-5cfc-45fe-a790-ca445f287b49\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") "
Jul 13 09:14:49.817778 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.817576    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/146881d8-5cfc-45fe-a790-ca445f287b49-tls-assets\") pod \"146881d8-5cfc-45fe-a790-ca445f287b49\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") "
Jul 13 09:14:49.817778 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.817600    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-k8s-rulefiles-1\") pod \"146881d8-5cfc-45fe-a790-ca445f287b49\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") "
Jul 13 09:14:49.817778 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.817637    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"146881d8-5cfc-45fe-a790-ca445f287b49\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") "
Jul 13 09:14:49.817778 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.817664    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-grpc-tls\") pod \"146881d8-5cfc-45fe-a790-ca445f287b49\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") "
Jul 13 09:14:49.817778 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.817730    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-prometheus-k8s-tls\") pod \"146881d8-5cfc-45fe-a790-ca445f287b49\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") "
Jul 13 09:14:49.818201 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.817841    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "146881d8-5cfc-45fe-a790-ca445f287b49" (UID: "146881d8-5cfc-45fe-a790-ca445f287b49"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:14:49.818201 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.817862    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-kube-rbac-proxy\") pod \"146881d8-5cfc-45fe-a790-ca445f287b49\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") "
Jul 13 09:14:49.818201 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.817901    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"146881d8-5cfc-45fe-a790-ca445f287b49\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") "
Jul 13 09:14:49.818201 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.817930    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-configmap-serving-certs-ca-bundle\") pod \"146881d8-5cfc-45fe-a790-ca445f287b49\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") "
Jul 13 09:14:49.818201 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.817933    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "146881d8-5cfc-45fe-a790-ca445f287b49" (UID: "146881d8-5cfc-45fe-a790-ca445f287b49"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:14:49.818201 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.817959    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-thanos-prometheus-http-client-file\") pod \"146881d8-5cfc-45fe-a790-ca445f287b49\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") "
Jul 13 09:14:49.818201 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.817994    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-config\") pod \"146881d8-5cfc-45fe-a790-ca445f287b49\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") "
Jul 13 09:14:49.818201 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.818023    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-configmap-metrics-client-ca\") pod \"146881d8-5cfc-45fe-a790-ca445f287b49\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") "
Jul 13 09:14:49.818201 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.818045    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-metrics-client-certs\") pod \"146881d8-5cfc-45fe-a790-ca445f287b49\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") "
Jul 13 09:14:49.818201 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.818083    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-k8s-rulefiles-0\") pod \"146881d8-5cfc-45fe-a790-ca445f287b49\" (UID: \"146881d8-5cfc-45fe-a790-ca445f287b49\") "
Jul 13 09:14:49.818620 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.818220    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "146881d8-5cfc-45fe-a790-ca445f287b49" (UID: "146881d8-5cfc-45fe-a790-ca445f287b49"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:14:49.818620 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.818442    2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:49.818620 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.818462    2553 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:49.818620 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.818478    2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:49.818851 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.818807    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "146881d8-5cfc-45fe-a790-ca445f287b49" (UID: "146881d8-5cfc-45fe-a790-ca445f287b49"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 09:14:49.819886 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.819853    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "146881d8-5cfc-45fe-a790-ca445f287b49" (UID: "146881d8-5cfc-45fe-a790-ca445f287b49"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:14:49.820305 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.820259    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "146881d8-5cfc-45fe-a790-ca445f287b49" (UID: "146881d8-5cfc-45fe-a790-ca445f287b49"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:14:49.820663 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.820539    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "146881d8-5cfc-45fe-a790-ca445f287b49" (UID: "146881d8-5cfc-45fe-a790-ca445f287b49"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:14:49.820663 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.820649    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "146881d8-5cfc-45fe-a790-ca445f287b49" (UID: "146881d8-5cfc-45fe-a790-ca445f287b49"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:14:49.821232 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.821197    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/146881d8-5cfc-45fe-a790-ca445f287b49-config-out" (OuterVolumeSpecName: "config-out") pod "146881d8-5cfc-45fe-a790-ca445f287b49" (UID: "146881d8-5cfc-45fe-a790-ca445f287b49"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 09:14:49.821740 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.821700    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "146881d8-5cfc-45fe-a790-ca445f287b49" (UID: "146881d8-5cfc-45fe-a790-ca445f287b49"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:14:49.822149 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.822094    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "146881d8-5cfc-45fe-a790-ca445f287b49" (UID: "146881d8-5cfc-45fe-a790-ca445f287b49"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:14:49.822857 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.822831    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/146881d8-5cfc-45fe-a790-ca445f287b49-kube-api-access-qh4cn" (OuterVolumeSpecName: "kube-api-access-qh4cn") pod "146881d8-5cfc-45fe-a790-ca445f287b49" (UID: "146881d8-5cfc-45fe-a790-ca445f287b49"). InnerVolumeSpecName "kube-api-access-qh4cn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:14:49.822983 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.822838    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-config" (OuterVolumeSpecName: "config") pod "146881d8-5cfc-45fe-a790-ca445f287b49" (UID: "146881d8-5cfc-45fe-a790-ca445f287b49"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:14:49.823291 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.823264    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "146881d8-5cfc-45fe-a790-ca445f287b49" (UID: "146881d8-5cfc-45fe-a790-ca445f287b49"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:14:49.823388 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.823352    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/146881d8-5cfc-45fe-a790-ca445f287b49-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "146881d8-5cfc-45fe-a790-ca445f287b49" (UID: "146881d8-5cfc-45fe-a790-ca445f287b49"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:14:49.823782 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.823731    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "146881d8-5cfc-45fe-a790-ca445f287b49" (UID: "146881d8-5cfc-45fe-a790-ca445f287b49"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:14:49.823945 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.823239    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "146881d8-5cfc-45fe-a790-ca445f287b49" (UID: "146881d8-5cfc-45fe-a790-ca445f287b49"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:14:49.824027 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.823996    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "146881d8-5cfc-45fe-a790-ca445f287b49" (UID: "146881d8-5cfc-45fe-a790-ca445f287b49"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:14:49.824471 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.824452    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "146881d8-5cfc-45fe-a790-ca445f287b49" (UID: "146881d8-5cfc-45fe-a790-ca445f287b49"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:14:49.835440 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.835410    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-web-config" (OuterVolumeSpecName: "web-config") pod "146881d8-5cfc-45fe-a790-ca445f287b49" (UID: "146881d8-5cfc-45fe-a790-ca445f287b49"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:14:49.917519 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.917490    2553 generic.go:356] "Generic (PLEG): container finished" podID="146881d8-5cfc-45fe-a790-ca445f287b49" containerID="ec6eb121fc0dfa406fd86e7575b518028de946fbcb13f01896266244643c5c24" exitCode=0
Jul 13 09:14:49.917881 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.917559    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:49.917881 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.917568    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"146881d8-5cfc-45fe-a790-ca445f287b49","Type":"ContainerDied","Data":"ec6eb121fc0dfa406fd86e7575b518028de946fbcb13f01896266244643c5c24"}
Jul 13 09:14:49.917881 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.917632    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"146881d8-5cfc-45fe-a790-ca445f287b49","Type":"ContainerDied","Data":"b806bc83db4bff0c990ec2d06afb69663e273452b232dc5498ccfad0f8ab8ca9"}
Jul 13 09:14:49.917881 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.917663    2553 scope.go:117] "RemoveContainer" containerID="ddc75b1d2f9b711abbb8530f903c7c8c0435781e789538209393dd0a42a44f73"
Jul 13 09:14:49.918926 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.918909    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qh4cn\" (UniqueName: \"kubernetes.io/projected/146881d8-5cfc-45fe-a790-ca445f287b49-kube-api-access-qh4cn\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:49.919005 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.918931    2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-k8s-db\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:49.919005 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.918945    2553 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-web-config\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:49.919005 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.918960    2553 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/146881d8-5cfc-45fe-a790-ca445f287b49-config-out\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:49.919005 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.918972    2553 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/146881d8-5cfc-45fe-a790-ca445f287b49-tls-assets\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:49.919005 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.918984    2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:49.919005 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.918998    2553 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:49.919278 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.919011    2553 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-grpc-tls\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:49.919278 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.919024    2553 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:49.919278 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.919037    2553 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-kube-rbac-proxy\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:49.919278 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.919051    2553 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:49.919278 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.919065    2553 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:49.919278 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.919079    2553 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:49.919278 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.919092    2553 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-config\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:49.919278 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.919105    2553 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-configmap-metrics-client-ca\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:49.919278 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.919119    2553 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/146881d8-5cfc-45fe-a790-ca445f287b49-secret-metrics-client-certs\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:49.919278 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.919133    2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/146881d8-5cfc-45fe-a790-ca445f287b49-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:14:49.933789 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.933769    2553 scope.go:117] "RemoveContainer" containerID="ec7ca87f5afba10462849d7da2d71ae467ad6a1a08abed098e122abbe69e299a"
Jul 13 09:14:49.940698 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.940670    2553 scope.go:117] "RemoveContainer" containerID="ec6eb121fc0dfa406fd86e7575b518028de946fbcb13f01896266244643c5c24"
Jul 13 09:14:49.947504 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.947480    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 09:14:49.947962 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.947946    2553 scope.go:117] "RemoveContainer" containerID="91cdbc985b4b0cc2aca073fc345b00d15011f16731beaf405d9deb070a51bba5"
Jul 13 09:14:49.953036 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.953016    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 09:14:49.955421 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.955405    2553 scope.go:117] "RemoveContainer" containerID="3eef0b1441f4f6cbf8ee0c796eb2f2d772fc3db35f6989960b860b0360f1aba5"
Jul 13 09:14:49.962091 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.962076    2553 scope.go:117] "RemoveContainer" containerID="6ec288ef83505ae16507c6d923ecd195ff21c4cb6e0f18b8da8e6d710712b754"
Jul 13 09:14:49.968791 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.968776    2553 scope.go:117] "RemoveContainer" containerID="6a32670f8fa3f482126053b7bd57be3938906c0bc822432dcb231d4ef05a1086"
Jul 13 09:14:49.975164 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.975149    2553 scope.go:117] "RemoveContainer" containerID="ddc75b1d2f9b711abbb8530f903c7c8c0435781e789538209393dd0a42a44f73"
Jul 13 09:14:49.975414 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:14:49.975395    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddc75b1d2f9b711abbb8530f903c7c8c0435781e789538209393dd0a42a44f73\": container with ID starting with ddc75b1d2f9b711abbb8530f903c7c8c0435781e789538209393dd0a42a44f73 not found: ID does not exist" containerID="ddc75b1d2f9b711abbb8530f903c7c8c0435781e789538209393dd0a42a44f73"
Jul 13 09:14:49.975472 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.975421    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddc75b1d2f9b711abbb8530f903c7c8c0435781e789538209393dd0a42a44f73"} err="failed to get container status \"ddc75b1d2f9b711abbb8530f903c7c8c0435781e789538209393dd0a42a44f73\": rpc error: code = NotFound desc = could not find container \"ddc75b1d2f9b711abbb8530f903c7c8c0435781e789538209393dd0a42a44f73\": container with ID starting with ddc75b1d2f9b711abbb8530f903c7c8c0435781e789538209393dd0a42a44f73 not found: ID does not exist"
Jul 13 09:14:49.975472 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.975439    2553 scope.go:117] "RemoveContainer" containerID="ec7ca87f5afba10462849d7da2d71ae467ad6a1a08abed098e122abbe69e299a"
Jul 13 09:14:49.975676 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:14:49.975659    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec7ca87f5afba10462849d7da2d71ae467ad6a1a08abed098e122abbe69e299a\": container with ID starting with ec7ca87f5afba10462849d7da2d71ae467ad6a1a08abed098e122abbe69e299a not found: ID does not exist" containerID="ec7ca87f5afba10462849d7da2d71ae467ad6a1a08abed098e122abbe69e299a"
Jul 13 09:14:49.975758 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.975701    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec7ca87f5afba10462849d7da2d71ae467ad6a1a08abed098e122abbe69e299a"} err="failed to get container status \"ec7ca87f5afba10462849d7da2d71ae467ad6a1a08abed098e122abbe69e299a\": rpc error: code = NotFound desc = could not find container \"ec7ca87f5afba10462849d7da2d71ae467ad6a1a08abed098e122abbe69e299a\": container with ID starting with ec7ca87f5afba10462849d7da2d71ae467ad6a1a08abed098e122abbe69e299a not found: ID does not exist"
Jul 13 09:14:49.975758 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.975723    2553 scope.go:117] "RemoveContainer" containerID="ec6eb121fc0dfa406fd86e7575b518028de946fbcb13f01896266244643c5c24"
Jul 13 09:14:49.975961 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:14:49.975945    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec6eb121fc0dfa406fd86e7575b518028de946fbcb13f01896266244643c5c24\": container with ID starting with ec6eb121fc0dfa406fd86e7575b518028de946fbcb13f01896266244643c5c24 not found: ID does not exist" containerID="ec6eb121fc0dfa406fd86e7575b518028de946fbcb13f01896266244643c5c24"
Jul 13 09:14:49.976003 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.975966    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec6eb121fc0dfa406fd86e7575b518028de946fbcb13f01896266244643c5c24"} err="failed to get container status \"ec6eb121fc0dfa406fd86e7575b518028de946fbcb13f01896266244643c5c24\": rpc error: code = NotFound desc = could not find container \"ec6eb121fc0dfa406fd86e7575b518028de946fbcb13f01896266244643c5c24\": container with ID starting with ec6eb121fc0dfa406fd86e7575b518028de946fbcb13f01896266244643c5c24 not found: ID does not exist"
Jul 13 09:14:49.976003 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.975981    2553 scope.go:117] "RemoveContainer" containerID="91cdbc985b4b0cc2aca073fc345b00d15011f16731beaf405d9deb070a51bba5"
Jul 13 09:14:49.976179 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:14:49.976165    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91cdbc985b4b0cc2aca073fc345b00d15011f16731beaf405d9deb070a51bba5\": container with ID starting with 91cdbc985b4b0cc2aca073fc345b00d15011f16731beaf405d9deb070a51bba5 not found: ID does not exist" containerID="91cdbc985b4b0cc2aca073fc345b00d15011f16731beaf405d9deb070a51bba5"
Jul 13 09:14:49.976221 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.976181    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91cdbc985b4b0cc2aca073fc345b00d15011f16731beaf405d9deb070a51bba5"} err="failed to get container status \"91cdbc985b4b0cc2aca073fc345b00d15011f16731beaf405d9deb070a51bba5\": rpc error: code = NotFound desc = could not find container \"91cdbc985b4b0cc2aca073fc345b00d15011f16731beaf405d9deb070a51bba5\": container with ID starting with 91cdbc985b4b0cc2aca073fc345b00d15011f16731beaf405d9deb070a51bba5 not found: ID does not exist"
Jul 13 09:14:49.976221 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.976194    2553 scope.go:117] "RemoveContainer" containerID="3eef0b1441f4f6cbf8ee0c796eb2f2d772fc3db35f6989960b860b0360f1aba5"
Jul 13 09:14:49.976393 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:14:49.976374    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3eef0b1441f4f6cbf8ee0c796eb2f2d772fc3db35f6989960b860b0360f1aba5\": container with ID starting with 3eef0b1441f4f6cbf8ee0c796eb2f2d772fc3db35f6989960b860b0360f1aba5 not found: ID does not exist" containerID="3eef0b1441f4f6cbf8ee0c796eb2f2d772fc3db35f6989960b860b0360f1aba5"
Jul 13 09:14:49.976424 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.976398    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eef0b1441f4f6cbf8ee0c796eb2f2d772fc3db35f6989960b860b0360f1aba5"} err="failed to get container status \"3eef0b1441f4f6cbf8ee0c796eb2f2d772fc3db35f6989960b860b0360f1aba5\": rpc error: code = NotFound desc = could not find container \"3eef0b1441f4f6cbf8ee0c796eb2f2d772fc3db35f6989960b860b0360f1aba5\": container with ID starting with 3eef0b1441f4f6cbf8ee0c796eb2f2d772fc3db35f6989960b860b0360f1aba5 not found: ID does not exist"
Jul 13 09:14:49.976424 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.976412    2553 scope.go:117] "RemoveContainer" containerID="6ec288ef83505ae16507c6d923ecd195ff21c4cb6e0f18b8da8e6d710712b754"
Jul 13 09:14:49.976643 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:14:49.976624    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ec288ef83505ae16507c6d923ecd195ff21c4cb6e0f18b8da8e6d710712b754\": container with ID starting with 6ec288ef83505ae16507c6d923ecd195ff21c4cb6e0f18b8da8e6d710712b754 not found: ID does not exist" containerID="6ec288ef83505ae16507c6d923ecd195ff21c4cb6e0f18b8da8e6d710712b754"
Jul 13 09:14:49.976753 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.976644    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ec288ef83505ae16507c6d923ecd195ff21c4cb6e0f18b8da8e6d710712b754"} err="failed to get container status \"6ec288ef83505ae16507c6d923ecd195ff21c4cb6e0f18b8da8e6d710712b754\": rpc error: code = NotFound desc = could not find container \"6ec288ef83505ae16507c6d923ecd195ff21c4cb6e0f18b8da8e6d710712b754\": container with ID starting with 6ec288ef83505ae16507c6d923ecd195ff21c4cb6e0f18b8da8e6d710712b754 not found: ID does not exist"
Jul 13 09:14:49.976753 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.976657    2553 scope.go:117] "RemoveContainer" containerID="6a32670f8fa3f482126053b7bd57be3938906c0bc822432dcb231d4ef05a1086"
Jul 13 09:14:49.976893 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:14:49.976877    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a32670f8fa3f482126053b7bd57be3938906c0bc822432dcb231d4ef05a1086\": container with ID starting with 6a32670f8fa3f482126053b7bd57be3938906c0bc822432dcb231d4ef05a1086 not found: ID does not exist" containerID="6a32670f8fa3f482126053b7bd57be3938906c0bc822432dcb231d4ef05a1086"
Jul 13 09:14:49.976942 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.976900    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a32670f8fa3f482126053b7bd57be3938906c0bc822432dcb231d4ef05a1086"} err="failed to get container status \"6a32670f8fa3f482126053b7bd57be3938906c0bc822432dcb231d4ef05a1086\": rpc error: code = NotFound desc = could not find container \"6a32670f8fa3f482126053b7bd57be3938906c0bc822432dcb231d4ef05a1086\": container with ID starting with 6a32670f8fa3f482126053b7bd57be3938906c0bc822432dcb231d4ef05a1086 not found: ID does not exist"
Jul 13 09:14:49.983676 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.983657    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 09:14:49.984000 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.983987    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="kube-rbac-proxy-thanos"
Jul 13 09:14:49.984044 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.984002    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="kube-rbac-proxy-thanos"
Jul 13 09:14:49.984044 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.984015    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="kube-rbac-proxy"
Jul 13 09:14:49.984044 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.984021    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="kube-rbac-proxy"
Jul 13 09:14:49.984044 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.984029    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="prometheus"
Jul 13 09:14:49.984044 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.984034    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="prometheus"
Jul 13 09:14:49.984044 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.984040    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="config-reloader"
Jul 13 09:14:49.984044 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.984046    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="config-reloader"
Jul 13 09:14:49.984248 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.984055    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="thanos-sidecar"
Jul 13 09:14:49.984248 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.984060    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="thanos-sidecar"
Jul 13 09:14:49.984248 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.984067    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="kube-rbac-proxy-web"
Jul 13 09:14:49.984248 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.984072    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="kube-rbac-proxy-web"
Jul 13 09:14:49.984248 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.984081    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="init-config-reloader"
Jul 13 09:14:49.984248 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.984086    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="init-config-reloader"
Jul 13 09:14:49.984248 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.984139    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="config-reloader"
Jul 13 09:14:49.984248 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.984147    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="prometheus"
Jul 13 09:14:49.984248 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.984153    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="kube-rbac-proxy"
Jul 13 09:14:49.984248 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.984161    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="kube-rbac-proxy-thanos"
Jul 13 09:14:49.984248 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.984168    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="thanos-sidecar"
Jul 13 09:14:49.984248 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.984174    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" containerName="kube-rbac-proxy-web"
Jul 13 09:14:49.987723 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.987707    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:49.990427 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.990403    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 13 09:14:49.990494 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.990430    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 13 09:14:49.990494 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.990454    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 13 09:14:49.990494 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.990430    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 13 09:14:49.990871 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.990851    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 13 09:14:49.991094 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.991075    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 13 09:14:49.991227 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.991112    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 13 09:14:49.991227 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.991178    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dp6n6qa04kcir\""
Jul 13 09:14:49.991227 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.991220    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 13 09:14:49.991407 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.991325    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 13 09:14:49.991537 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.991523    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 13 09:14:49.991617 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.991596    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 13 09:14:49.991680 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.991656    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xn57v\""
Jul 13 09:14:49.992059 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.992039    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 13 09:14:49.993965 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.993945    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 13 09:14:49.996393 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:49.996376    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 13 09:14:50.008606 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.008576    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 09:14:50.121339 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.121251    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.121339 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.121290    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.121339 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.121309    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.121546 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.121389    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/21d6eba6-a86c-4184-8814-118f030747c4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.121546 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.121439    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.121546 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.121459    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21d6eba6-a86c-4184-8814-118f030747c4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.121546 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.121507    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/21d6eba6-a86c-4184-8814-118f030747c4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.121546 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.121527    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21d6eba6-a86c-4184-8814-118f030747c4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.121734 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.121554    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-config\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.121734 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.121570    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/21d6eba6-a86c-4184-8814-118f030747c4-config-out\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.121734 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.121585    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-web-config\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.121734 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.121609    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/21d6eba6-a86c-4184-8814-118f030747c4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.121734 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.121640    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.121734 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.121664    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/21d6eba6-a86c-4184-8814-118f030747c4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.121734 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.121681    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/21d6eba6-a86c-4184-8814-118f030747c4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.121952 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.121750    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnq8z\" (UniqueName: \"kubernetes.io/projected/21d6eba6-a86c-4184-8814-118f030747c4-kube-api-access-vnq8z\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.121952 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.121793    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.121952 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.121815    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.121952 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.121840    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21d6eba6-a86c-4184-8814-118f030747c4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.121952 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.121868    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21d6eba6-a86c-4184-8814-118f030747c4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.222449 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.222415    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.222449 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.222450    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21d6eba6-a86c-4184-8814-118f030747c4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.222646 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.222479    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/21d6eba6-a86c-4184-8814-118f030747c4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.222646 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.222594    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21d6eba6-a86c-4184-8814-118f030747c4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.222646 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.222635    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-config\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.222831 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.222661    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/21d6eba6-a86c-4184-8814-118f030747c4-config-out\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.222831 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.222708    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-web-config\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.222831 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.222735    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/21d6eba6-a86c-4184-8814-118f030747c4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.222831 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.222776    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.222831 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.222813    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/21d6eba6-a86c-4184-8814-118f030747c4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.223084 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.222844    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/21d6eba6-a86c-4184-8814-118f030747c4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.223084 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.222872    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnq8z\" (UniqueName: \"kubernetes.io/projected/21d6eba6-a86c-4184-8814-118f030747c4-kube-api-access-vnq8z\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.223084 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.222905    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.223084 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.222934    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.223084 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.222973    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21d6eba6-a86c-4184-8814-118f030747c4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.223084 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.223012    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21d6eba6-a86c-4184-8814-118f030747c4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.223415 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.223389    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21d6eba6-a86c-4184-8814-118f030747c4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.225378 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.223527    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/21d6eba6-a86c-4184-8814-118f030747c4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.225378 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.223636    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21d6eba6-a86c-4184-8814-118f030747c4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.225378 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.223784    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.225378 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.223798    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/21d6eba6-a86c-4184-8814-118f030747c4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.225378 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.223824    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.225378 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.223856    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.225378 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.223895    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/21d6eba6-a86c-4184-8814-118f030747c4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.225378 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.224778    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21d6eba6-a86c-4184-8814-118f030747c4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.225378 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.224862    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21d6eba6-a86c-4184-8814-118f030747c4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.225378 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.225122    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/21d6eba6-a86c-4184-8814-118f030747c4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.227000 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.226970    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.227795 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.227545    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.227795 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.227654    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.227795 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.227662    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-web-config\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.227795 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.227756    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.228068 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.227813    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.228068 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.227881    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/21d6eba6-a86c-4184-8814-118f030747c4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.228068 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.227891    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/21d6eba6-a86c-4184-8814-118f030747c4-config-out\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.228200 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.228130    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-config\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.228373 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.228352    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.228760 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.228741    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/21d6eba6-a86c-4184-8814-118f030747c4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.228760 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.228757    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21d6eba6-a86c-4184-8814-118f030747c4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.232317 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.232300    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnq8z\" (UniqueName: \"kubernetes.io/projected/21d6eba6-a86c-4184-8814-118f030747c4-kube-api-access-vnq8z\") pod \"prometheus-k8s-0\" (UID: \"21d6eba6-a86c-4184-8814-118f030747c4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.298456 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.298427    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:14:50.433855 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.433830    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 09:14:50.436334 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:14:50.436302    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21d6eba6_a86c_4184_8814_118f030747c4.slice/crio-4aafc888fbf1741c8d77cd83fbec942aaf43b08957400522511fb6f5c1e209a9 WatchSource:0}: Error finding container 4aafc888fbf1741c8d77cd83fbec942aaf43b08957400522511fb6f5c1e209a9: Status 404 returned error can't find the container with id 4aafc888fbf1741c8d77cd83fbec942aaf43b08957400522511fb6f5c1e209a9
Jul 13 09:14:50.924577 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.924547    2553 generic.go:356] "Generic (PLEG): container finished" podID="21d6eba6-a86c-4184-8814-118f030747c4" containerID="c14b17cba8d61f206a0a192a276186a2f93af7ca7e8d03652a67b11b436fac82" exitCode=0
Jul 13 09:14:50.924939 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.924631    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21d6eba6-a86c-4184-8814-118f030747c4","Type":"ContainerDied","Data":"c14b17cba8d61f206a0a192a276186a2f93af7ca7e8d03652a67b11b436fac82"}
Jul 13 09:14:50.924939 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:50.924716    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21d6eba6-a86c-4184-8814-118f030747c4","Type":"ContainerStarted","Data":"4aafc888fbf1741c8d77cd83fbec942aaf43b08957400522511fb6f5c1e209a9"}
Jul 13 09:14:51.486746 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:51.486660    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="146881d8-5cfc-45fe-a790-ca445f287b49" path="/var/lib/kubelet/pods/146881d8-5cfc-45fe-a790-ca445f287b49/volumes"
Jul 13 09:14:51.932117 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:51.932083    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21d6eba6-a86c-4184-8814-118f030747c4","Type":"ContainerStarted","Data":"ccca2a2705ec24fa952d5b17332a58cf4c41bd3ece92543027618e194e533fe9"}
Jul 13 09:14:51.932552 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:51.932145    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21d6eba6-a86c-4184-8814-118f030747c4","Type":"ContainerStarted","Data":"69071e3458c531c82d26b8f023d9931de863dcbd995be0a032bb68249fb05387"}
Jul 13 09:14:51.932552 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:51.932172    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21d6eba6-a86c-4184-8814-118f030747c4","Type":"ContainerStarted","Data":"0242aa7ced1b1190e4e970799b24de521aee625c82ef7397d31cf914a793d88c"}
Jul 13 09:14:51.932552 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:51.932195    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21d6eba6-a86c-4184-8814-118f030747c4","Type":"ContainerStarted","Data":"01c1af992b239928096b61ae1a24f86eb52922968d2deb07ca5baff6b66d1572"}
Jul 13 09:14:51.932552 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:51.932217    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21d6eba6-a86c-4184-8814-118f030747c4","Type":"ContainerStarted","Data":"0eee67eceb5b1b044a1bd608eac936a988ca010efdc0e28a37ce19b14d4d1050"}
Jul 13 09:14:51.932552 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:51.932245    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21d6eba6-a86c-4184-8814-118f030747c4","Type":"ContainerStarted","Data":"b1f715b4fc6ca3f6fff0fe344bfcc58939c2c39aee00b495bf603f2be274bc2c"}
Jul 13 09:14:51.968239 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:51.968193    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.949645269 podStartE2EDuration="2.968173974s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.528705ms" isStatefulPod=false podCreationTimestamp="2026-07-13 09:14:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:14:51.965449243 +0000 UTC m=+381.043326517" watchObservedRunningTime="2026-07-13 09:14:51.968173974 +0000 UTC m=+381.046051229"
Jul 13 09:14:55.298654 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:14:55.298618    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:15:50.299155 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:15:50.299118    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:15:50.314619 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:15:50.314591    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:15:51.202336 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:15:51.202309    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 09:17:03.295945 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:03.295910    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q"]
Jul 13 09:17:03.299192 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:03.299168    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q"
Jul 13 09:17:03.302790 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:03.302764    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 13 09:17:03.303105 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:03.303085    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 13 09:17:03.303172 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:03.303090    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7j5hk\""
Jul 13 09:17:03.303228 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:03.303093    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 13 09:17:03.303519 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:03.303505    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 13 09:17:03.323906 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:03.323882    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q"]
Jul 13 09:17:03.448613 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:03.448584    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2d3f44ac-d847-4f9f-8ea3-5f82d254366b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q\" (UID: \"2d3f44ac-d847-4f9f-8ea3-5f82d254366b\") " pod="opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q"
Jul 13 09:17:03.448797 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:03.448619    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d3f44ac-d847-4f9f-8ea3-5f82d254366b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q\" (UID: \"2d3f44ac-d847-4f9f-8ea3-5f82d254366b\") " pod="opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q"
Jul 13 09:17:03.448797 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:03.448642    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2d3f44ac-d847-4f9f-8ea3-5f82d254366b-manifests\") pod \"opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q\" (UID: \"2d3f44ac-d847-4f9f-8ea3-5f82d254366b\") " pod="opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q"
Jul 13 09:17:03.448797 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:03.448769    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d3f44ac-d847-4f9f-8ea3-5f82d254366b-tmp\") pod \"opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q\" (UID: \"2d3f44ac-d847-4f9f-8ea3-5f82d254366b\") " pod="opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q"
Jul 13 09:17:03.448797 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:03.448793    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh6g7\" (UniqueName: \"kubernetes.io/projected/2d3f44ac-d847-4f9f-8ea3-5f82d254366b-kube-api-access-lh6g7\") pod \"opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q\" (UID: \"2d3f44ac-d847-4f9f-8ea3-5f82d254366b\") " pod="opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q"
Jul 13 09:17:03.549933 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:03.549856    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d3f44ac-d847-4f9f-8ea3-5f82d254366b-tmp\") pod \"opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q\" (UID: \"2d3f44ac-d847-4f9f-8ea3-5f82d254366b\") " pod="opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q"
Jul 13 09:17:03.549933 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:03.549887    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh6g7\" (UniqueName: \"kubernetes.io/projected/2d3f44ac-d847-4f9f-8ea3-5f82d254366b-kube-api-access-lh6g7\") pod \"opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q\" (UID: \"2d3f44ac-d847-4f9f-8ea3-5f82d254366b\") " pod="opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q"
Jul 13 09:17:03.550110 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:03.549964    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2d3f44ac-d847-4f9f-8ea3-5f82d254366b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q\" (UID: \"2d3f44ac-d847-4f9f-8ea3-5f82d254366b\") " pod="opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q"
Jul 13 09:17:03.550110 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:03.549994    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d3f44ac-d847-4f9f-8ea3-5f82d254366b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q\" (UID: \"2d3f44ac-d847-4f9f-8ea3-5f82d254366b\") " pod="opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q"
Jul 13 09:17:03.550110 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:03.550053    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2d3f44ac-d847-4f9f-8ea3-5f82d254366b-manifests\") pod \"opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q\" (UID: \"2d3f44ac-d847-4f9f-8ea3-5f82d254366b\") " pod="opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q"
Jul 13 09:17:03.550376 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:03.550358    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2d3f44ac-d847-4f9f-8ea3-5f82d254366b-manifests\") pod \"opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q\" (UID: \"2d3f44ac-d847-4f9f-8ea3-5f82d254366b\") " pod="opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q"
Jul 13 09:17:03.552107 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:03.552079    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d3f44ac-d847-4f9f-8ea3-5f82d254366b-tmp\") pod \"opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q\" (UID: \"2d3f44ac-d847-4f9f-8ea3-5f82d254366b\") " pod="opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q"
Jul 13 09:17:03.552393 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:03.552376    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2d3f44ac-d847-4f9f-8ea3-5f82d254366b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q\" (UID: \"2d3f44ac-d847-4f9f-8ea3-5f82d254366b\") " pod="opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q"
Jul 13 09:17:03.552524 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:03.552504    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d3f44ac-d847-4f9f-8ea3-5f82d254366b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q\" (UID: \"2d3f44ac-d847-4f9f-8ea3-5f82d254366b\") " pod="opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q"
Jul 13 09:17:03.559329 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:03.559308    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh6g7\" (UniqueName: \"kubernetes.io/projected/2d3f44ac-d847-4f9f-8ea3-5f82d254366b-kube-api-access-lh6g7\") pod \"opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q\" (UID: \"2d3f44ac-d847-4f9f-8ea3-5f82d254366b\") " pod="opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q"
Jul 13 09:17:03.609944 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:03.609916    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q"
Jul 13 09:17:03.761757 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:03.761729    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q"]
Jul 13 09:17:03.764476 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:17:03.764454    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3f44ac_d847_4f9f_8ea3_5f82d254366b.slice/crio-01fa57d4dc0e661d39b1d0ab34a19f6b51547d0c25caa483151337f1e615ce16 WatchSource:0}: Error finding container 01fa57d4dc0e661d39b1d0ab34a19f6b51547d0c25caa483151337f1e615ce16: Status 404 returned error can't find the container with id 01fa57d4dc0e661d39b1d0ab34a19f6b51547d0c25caa483151337f1e615ce16
Jul 13 09:17:04.495003 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:04.494959    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q" event={"ID":"2d3f44ac-d847-4f9f-8ea3-5f82d254366b","Type":"ContainerStarted","Data":"01fa57d4dc0e661d39b1d0ab34a19f6b51547d0c25caa483151337f1e615ce16"}
Jul 13 09:17:07.518955 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:07.518912    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q" event={"ID":"2d3f44ac-d847-4f9f-8ea3-5f82d254366b","Type":"ContainerStarted","Data":"10a0352ba60f3c1e0c48e7cf3c6545f21f6846befdc26a9627316e373c4e739c"}
Jul 13 09:17:08.525053 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:08.525017    2553 generic.go:356] "Generic (PLEG): container finished" podID="2d3f44ac-d847-4f9f-8ea3-5f82d254366b" containerID="10a0352ba60f3c1e0c48e7cf3c6545f21f6846befdc26a9627316e373c4e739c" exitCode=0
Jul 13 09:17:08.525534 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:08.525111    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q" event={"ID":"2d3f44ac-d847-4f9f-8ea3-5f82d254366b","Type":"ContainerDied","Data":"10a0352ba60f3c1e0c48e7cf3c6545f21f6846befdc26a9627316e373c4e739c"}
Jul 13 09:17:09.531131 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:09.531095    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q" event={"ID":"2d3f44ac-d847-4f9f-8ea3-5f82d254366b","Type":"ContainerStarted","Data":"96cac2130dfa77a6135c1ab4c1b2336cab91d417808640f12d5c10484d1e59c4"}
Jul 13 09:17:09.531494 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:09.531194    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q"
Jul 13 09:17:09.563239 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:09.563197    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q" podStartSLOduration=2.17463345 podStartE2EDuration="6.563182775s" totalImagesPullingTime="3.382336875s" totalInitContainerRuntime="1.00621245s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:17:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:17:09.561985282 +0000 UTC m=+518.639862570" watchObservedRunningTime="2026-07-13 09:17:09.563182775 +0000 UTC m=+518.641060028"
Jul 13 09:17:20.537555 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:20.537523    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q"
Jul 13 09:17:21.052315 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:21.052276    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-68884f4547-bxlqc"]
Jul 13 09:17:21.061578 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:21.061549    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68884f4547-bxlqc"
Jul 13 09:17:21.067269 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:21.067245    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 13 09:17:21.067454 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:21.067254    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-22rbc\""
Jul 13 09:17:21.067454 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:21.067306    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 13 09:17:21.067454 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:21.067254    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 13 09:17:21.067770 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:21.067484    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 13 09:17:21.067770 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:21.067567    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 13 09:17:21.069876 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:21.069850    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68884f4547-bxlqc"]
Jul 13 09:17:21.108290 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:21.108267    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02bfba49-377f-4c02-b3f5-9fceddd3802c-cert\") pod \"lws-controller-manager-68884f4547-bxlqc\" (UID: \"02bfba49-377f-4c02-b3f5-9fceddd3802c\") " pod="openshift-lws-operator/lws-controller-manager-68884f4547-bxlqc"
Jul 13 09:17:21.108408 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:21.108300    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/02bfba49-377f-4c02-b3f5-9fceddd3802c-manager-config\") pod \"lws-controller-manager-68884f4547-bxlqc\" (UID: \"02bfba49-377f-4c02-b3f5-9fceddd3802c\") " pod="openshift-lws-operator/lws-controller-manager-68884f4547-bxlqc"
Jul 13 09:17:21.108408 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:21.108318    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/02bfba49-377f-4c02-b3f5-9fceddd3802c-metrics-cert\") pod \"lws-controller-manager-68884f4547-bxlqc\" (UID: \"02bfba49-377f-4c02-b3f5-9fceddd3802c\") " pod="openshift-lws-operator/lws-controller-manager-68884f4547-bxlqc"
Jul 13 09:17:21.108525 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:21.108412    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn6vq\" (UniqueName: \"kubernetes.io/projected/02bfba49-377f-4c02-b3f5-9fceddd3802c-kube-api-access-sn6vq\") pod \"lws-controller-manager-68884f4547-bxlqc\" (UID: \"02bfba49-377f-4c02-b3f5-9fceddd3802c\") " pod="openshift-lws-operator/lws-controller-manager-68884f4547-bxlqc"
Jul 13 09:17:21.209907 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:21.209871    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn6vq\" (UniqueName: \"kubernetes.io/projected/02bfba49-377f-4c02-b3f5-9fceddd3802c-kube-api-access-sn6vq\") pod \"lws-controller-manager-68884f4547-bxlqc\" (UID: \"02bfba49-377f-4c02-b3f5-9fceddd3802c\") " pod="openshift-lws-operator/lws-controller-manager-68884f4547-bxlqc"
Jul 13 09:17:21.210027 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:21.209975    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02bfba49-377f-4c02-b3f5-9fceddd3802c-cert\") pod \"lws-controller-manager-68884f4547-bxlqc\" (UID: \"02bfba49-377f-4c02-b3f5-9fceddd3802c\") " pod="openshift-lws-operator/lws-controller-manager-68884f4547-bxlqc"
Jul 13 09:17:21.210027 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:21.210002    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/02bfba49-377f-4c02-b3f5-9fceddd3802c-manager-config\") pod \"lws-controller-manager-68884f4547-bxlqc\" (UID: \"02bfba49-377f-4c02-b3f5-9fceddd3802c\") " pod="openshift-lws-operator/lws-controller-manager-68884f4547-bxlqc"
Jul 13 09:17:21.210027 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:21.210017    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/02bfba49-377f-4c02-b3f5-9fceddd3802c-metrics-cert\") pod \"lws-controller-manager-68884f4547-bxlqc\" (UID: \"02bfba49-377f-4c02-b3f5-9fceddd3802c\") " pod="openshift-lws-operator/lws-controller-manager-68884f4547-bxlqc"
Jul 13 09:17:21.210725 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:21.210701    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/02bfba49-377f-4c02-b3f5-9fceddd3802c-manager-config\") pod \"lws-controller-manager-68884f4547-bxlqc\" (UID: \"02bfba49-377f-4c02-b3f5-9fceddd3802c\") " pod="openshift-lws-operator/lws-controller-manager-68884f4547-bxlqc"
Jul 13 09:17:21.212274 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:21.212246    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02bfba49-377f-4c02-b3f5-9fceddd3802c-cert\") pod \"lws-controller-manager-68884f4547-bxlqc\" (UID: \"02bfba49-377f-4c02-b3f5-9fceddd3802c\") " pod="openshift-lws-operator/lws-controller-manager-68884f4547-bxlqc"
Jul 13 09:17:21.212390 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:21.212361    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/02bfba49-377f-4c02-b3f5-9fceddd3802c-metrics-cert\") pod \"lws-controller-manager-68884f4547-bxlqc\" (UID: \"02bfba49-377f-4c02-b3f5-9fceddd3802c\") " pod="openshift-lws-operator/lws-controller-manager-68884f4547-bxlqc"
Jul 13 09:17:21.220960 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:21.220940    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn6vq\" (UniqueName: \"kubernetes.io/projected/02bfba49-377f-4c02-b3f5-9fceddd3802c-kube-api-access-sn6vq\") pod \"lws-controller-manager-68884f4547-bxlqc\" (UID: \"02bfba49-377f-4c02-b3f5-9fceddd3802c\") " pod="openshift-lws-operator/lws-controller-manager-68884f4547-bxlqc"
Jul 13 09:17:21.372099 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:21.372031    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68884f4547-bxlqc"
Jul 13 09:17:21.503357 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:21.503336    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68884f4547-bxlqc"]
Jul 13 09:17:21.505669 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:17:21.505647    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02bfba49_377f_4c02_b3f5_9fceddd3802c.slice/crio-54545740edf8d7c43689a08071a8c0bf88202c05814f96643a81ea8214b8a23a WatchSource:0}: Error finding container 54545740edf8d7c43689a08071a8c0bf88202c05814f96643a81ea8214b8a23a: Status 404 returned error can't find the container with id 54545740edf8d7c43689a08071a8c0bf88202c05814f96643a81ea8214b8a23a
Jul 13 09:17:21.582334 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:21.582304    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68884f4547-bxlqc" event={"ID":"02bfba49-377f-4c02-b3f5-9fceddd3802c","Type":"ContainerStarted","Data":"54545740edf8d7c43689a08071a8c0bf88202c05814f96643a81ea8214b8a23a"}
Jul 13 09:17:23.491360 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:23.491273    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d64b4d488-lpn8f"]
Jul 13 09:17:23.493884 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:23.493867    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d64b4d488-lpn8f"
Jul 13 09:17:23.501501 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:23.496878    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 13 09:17:23.501501 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:23.497065    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 13 09:17:23.501501 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:23.497891    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 13 09:17:23.501501 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:23.498243    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 13 09:17:23.501501 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:23.498336    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-2dxhn\""
Jul 13 09:17:23.531352 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:23.531321    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxvtx\" (UniqueName: \"kubernetes.io/projected/171fa8f1-9ca4-4ef8-b75c-d5997171c893-kube-api-access-sxvtx\") pod \"kube-auth-proxy-7d64b4d488-lpn8f\" (UID: \"171fa8f1-9ca4-4ef8-b75c-d5997171c893\") " pod="openshift-ingress/kube-auth-proxy-7d64b4d488-lpn8f"
Jul 13 09:17:23.531505 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:23.531371    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/171fa8f1-9ca4-4ef8-b75c-d5997171c893-tmp\") pod \"kube-auth-proxy-7d64b4d488-lpn8f\" (UID: \"171fa8f1-9ca4-4ef8-b75c-d5997171c893\") " pod="openshift-ingress/kube-auth-proxy-7d64b4d488-lpn8f"
Jul 13 09:17:23.531505 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:23.531423    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/171fa8f1-9ca4-4ef8-b75c-d5997171c893-tls-certs\") pod \"kube-auth-proxy-7d64b4d488-lpn8f\" (UID: \"171fa8f1-9ca4-4ef8-b75c-d5997171c893\") " pod="openshift-ingress/kube-auth-proxy-7d64b4d488-lpn8f"
Jul 13 09:17:23.552728 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:23.552677    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d64b4d488-lpn8f"]
Jul 13 09:17:23.632971 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:23.632937    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxvtx\" (UniqueName: \"kubernetes.io/projected/171fa8f1-9ca4-4ef8-b75c-d5997171c893-kube-api-access-sxvtx\") pod \"kube-auth-proxy-7d64b4d488-lpn8f\" (UID: \"171fa8f1-9ca4-4ef8-b75c-d5997171c893\") " pod="openshift-ingress/kube-auth-proxy-7d64b4d488-lpn8f"
Jul 13 09:17:23.633162 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:23.632984    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/171fa8f1-9ca4-4ef8-b75c-d5997171c893-tmp\") pod \"kube-auth-proxy-7d64b4d488-lpn8f\" (UID: \"171fa8f1-9ca4-4ef8-b75c-d5997171c893\") " pod="openshift-ingress/kube-auth-proxy-7d64b4d488-lpn8f"
Jul 13 09:17:23.633162 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:23.633024    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/171fa8f1-9ca4-4ef8-b75c-d5997171c893-tls-certs\") pod \"kube-auth-proxy-7d64b4d488-lpn8f\" (UID: \"171fa8f1-9ca4-4ef8-b75c-d5997171c893\") " pod="openshift-ingress/kube-auth-proxy-7d64b4d488-lpn8f"
Jul 13 09:17:23.633162 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:17:23.633134    2553 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 13 09:17:23.633330 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:17:23.633206    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/171fa8f1-9ca4-4ef8-b75c-d5997171c893-tls-certs podName:171fa8f1-9ca4-4ef8-b75c-d5997171c893 nodeName:}" failed. No retries permitted until 2026-07-13 09:17:24.133184925 +0000 UTC m=+533.211062184 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/171fa8f1-9ca4-4ef8-b75c-d5997171c893-tls-certs") pod "kube-auth-proxy-7d64b4d488-lpn8f" (UID: "171fa8f1-9ca4-4ef8-b75c-d5997171c893") : secret "kube-auth-proxy-tls" not found
Jul 13 09:17:23.635790 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:23.635756    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/171fa8f1-9ca4-4ef8-b75c-d5997171c893-tmp\") pod \"kube-auth-proxy-7d64b4d488-lpn8f\" (UID: \"171fa8f1-9ca4-4ef8-b75c-d5997171c893\") " pod="openshift-ingress/kube-auth-proxy-7d64b4d488-lpn8f"
Jul 13 09:17:23.670265 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:23.670234    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxvtx\" (UniqueName: \"kubernetes.io/projected/171fa8f1-9ca4-4ef8-b75c-d5997171c893-kube-api-access-sxvtx\") pod \"kube-auth-proxy-7d64b4d488-lpn8f\" (UID: \"171fa8f1-9ca4-4ef8-b75c-d5997171c893\") " pod="openshift-ingress/kube-auth-proxy-7d64b4d488-lpn8f"
Jul 13 09:17:24.138623 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:24.138592    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/171fa8f1-9ca4-4ef8-b75c-d5997171c893-tls-certs\") pod \"kube-auth-proxy-7d64b4d488-lpn8f\" (UID: \"171fa8f1-9ca4-4ef8-b75c-d5997171c893\") " pod="openshift-ingress/kube-auth-proxy-7d64b4d488-lpn8f"
Jul 13 09:17:24.140967 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:24.140943    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/171fa8f1-9ca4-4ef8-b75c-d5997171c893-tls-certs\") pod \"kube-auth-proxy-7d64b4d488-lpn8f\" (UID: \"171fa8f1-9ca4-4ef8-b75c-d5997171c893\") " pod="openshift-ingress/kube-auth-proxy-7d64b4d488-lpn8f"
Jul 13 09:17:24.407409 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:24.407332    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d64b4d488-lpn8f"
Jul 13 09:17:24.583297 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:24.583276    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d64b4d488-lpn8f"]
Jul 13 09:17:24.585843 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:17:24.585814    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod171fa8f1_9ca4_4ef8_b75c_d5997171c893.slice/crio-6aa83bfdfa640bccb8e5cb838b423ccfbf10671de545c62e014d200e722e73d4 WatchSource:0}: Error finding container 6aa83bfdfa640bccb8e5cb838b423ccfbf10671de545c62e014d200e722e73d4: Status 404 returned error can't find the container with id 6aa83bfdfa640bccb8e5cb838b423ccfbf10671de545c62e014d200e722e73d4
Jul 13 09:17:24.598196 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:24.598163    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68884f4547-bxlqc" event={"ID":"02bfba49-377f-4c02-b3f5-9fceddd3802c","Type":"ContainerStarted","Data":"8df530ded4e3f9fffacf0c1e797c129498b9199cb5e238c16abb741b21c535f1"}
Jul 13 09:17:24.598343 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:24.598327    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-68884f4547-bxlqc"
Jul 13 09:17:24.599299 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:24.599280    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d64b4d488-lpn8f" event={"ID":"171fa8f1-9ca4-4ef8-b75c-d5997171c893","Type":"ContainerStarted","Data":"6aa83bfdfa640bccb8e5cb838b423ccfbf10671de545c62e014d200e722e73d4"}
Jul 13 09:17:24.622395 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:24.622345    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-68884f4547-bxlqc" podStartSLOduration=1.326559474 podStartE2EDuration="3.622330404s" totalImagesPullingTime="2.29577093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:17:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:17:24.620626534 +0000 UTC m=+533.698503789" watchObservedRunningTime="2026-07-13 09:17:24.622330404 +0000 UTC m=+533.700207659"
Jul 13 09:17:27.617086 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:27.617008    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d64b4d488-lpn8f" event={"ID":"171fa8f1-9ca4-4ef8-b75c-d5997171c893","Type":"ContainerStarted","Data":"26a140d419d1709b84b10bf5e5f285edc9a047f5eaf4b3e7af445752ec17f388"}
Jul 13 09:17:27.635108 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:27.635061    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d64b4d488-lpn8f" podStartSLOduration=2.09072662 podStartE2EDuration="4.635045865s" totalImagesPullingTime="2.544319245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:17:27.633881162 +0000 UTC m=+536.711758408" watchObservedRunningTime="2026-07-13 09:17:27.635045865 +0000 UTC m=+536.712923120"
Jul 13 09:17:33.811380 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:33.811350    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5npln"]
Jul 13 09:17:33.815287 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:33.815270    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5npln"
Jul 13 09:17:33.823628 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:33.823609    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-6sldk\""
Jul 13 09:17:33.826294 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:33.826280    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 13 09:17:33.840764 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:33.840743    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5npln"]
Jul 13 09:17:33.921528 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:33.921500    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkxrb\" (UniqueName: \"kubernetes.io/projected/82ae27fd-3e9f-4fa9-bc94-83bd4dff36d0-kube-api-access-mkxrb\") pod \"llmisvc-controller-manager-777c6bd7d5-5npln\" (UID: \"82ae27fd-3e9f-4fa9-bc94-83bd4dff36d0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5npln"
Jul 13 09:17:33.921663 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:33.921567    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82ae27fd-3e9f-4fa9-bc94-83bd4dff36d0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5npln\" (UID: \"82ae27fd-3e9f-4fa9-bc94-83bd4dff36d0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5npln"
Jul 13 09:17:34.022844 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:34.022817    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkxrb\" (UniqueName: \"kubernetes.io/projected/82ae27fd-3e9f-4fa9-bc94-83bd4dff36d0-kube-api-access-mkxrb\") pod \"llmisvc-controller-manager-777c6bd7d5-5npln\" (UID: \"82ae27fd-3e9f-4fa9-bc94-83bd4dff36d0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5npln"
Jul 13 09:17:34.022967 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:34.022873    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82ae27fd-3e9f-4fa9-bc94-83bd4dff36d0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5npln\" (UID: \"82ae27fd-3e9f-4fa9-bc94-83bd4dff36d0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5npln"
Jul 13 09:17:34.023041 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:17:34.023009    2553 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 13 09:17:34.023092 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:17:34.023057    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82ae27fd-3e9f-4fa9-bc94-83bd4dff36d0-cert podName:82ae27fd-3e9f-4fa9-bc94-83bd4dff36d0 nodeName:}" failed. No retries permitted until 2026-07-13 09:17:34.523042093 +0000 UTC m=+543.600919325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/82ae27fd-3e9f-4fa9-bc94-83bd4dff36d0-cert") pod "llmisvc-controller-manager-777c6bd7d5-5npln" (UID: "82ae27fd-3e9f-4fa9-bc94-83bd4dff36d0") : secret "llmisvc-webhook-server-cert" not found
Jul 13 09:17:34.035343 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:34.035317    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkxrb\" (UniqueName: \"kubernetes.io/projected/82ae27fd-3e9f-4fa9-bc94-83bd4dff36d0-kube-api-access-mkxrb\") pod \"llmisvc-controller-manager-777c6bd7d5-5npln\" (UID: \"82ae27fd-3e9f-4fa9-bc94-83bd4dff36d0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5npln"
Jul 13 09:17:34.526932 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:34.526892    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82ae27fd-3e9f-4fa9-bc94-83bd4dff36d0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5npln\" (UID: \"82ae27fd-3e9f-4fa9-bc94-83bd4dff36d0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5npln"
Jul 13 09:17:34.529332 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:34.529310    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82ae27fd-3e9f-4fa9-bc94-83bd4dff36d0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5npln\" (UID: \"82ae27fd-3e9f-4fa9-bc94-83bd4dff36d0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5npln"
Jul 13 09:17:34.725240 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:34.725205    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5npln"
Jul 13 09:17:34.857324 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:34.857301    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5npln"]
Jul 13 09:17:34.859498 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:17:34.859471    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod82ae27fd_3e9f_4fa9_bc94_83bd4dff36d0.slice/crio-648531405b1293ff56b8d80552852e509841b9515217d6f94b157cd04dea7f27 WatchSource:0}: Error finding container 648531405b1293ff56b8d80552852e509841b9515217d6f94b157cd04dea7f27: Status 404 returned error can't find the container with id 648531405b1293ff56b8d80552852e509841b9515217d6f94b157cd04dea7f27
Jul 13 09:17:35.607916 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:35.607884    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-68884f4547-bxlqc"
Jul 13 09:17:35.654831 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:35.654800    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5npln" event={"ID":"82ae27fd-3e9f-4fa9-bc94-83bd4dff36d0","Type":"ContainerStarted","Data":"648531405b1293ff56b8d80552852e509841b9515217d6f94b157cd04dea7f27"}
Jul 13 09:17:38.670083 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:38.670045    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5npln" event={"ID":"82ae27fd-3e9f-4fa9-bc94-83bd4dff36d0","Type":"ContainerStarted","Data":"eee28b348b3ca7790e7dc6cdfce547e8b5158799c37321ce66ff89624228c077"}
Jul 13 09:17:38.670456 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:38.670186    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5npln"
Jul 13 09:17:38.687796 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:17:38.687740    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5npln" podStartSLOduration=2.570034217 podStartE2EDuration="5.687726823s" totalImagesPullingTime="3.117692606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:17:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:17:38.686447688 +0000 UTC m=+547.764324943" watchObservedRunningTime="2026-07-13 09:17:38.687726823 +0000 UTC m=+547.765604101"
Jul 13 09:18:09.677317 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:18:09.677287    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5npln"
Jul 13 09:18:31.470553 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:18:31.470521    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tmbbk_d1243d30-2275-43cc-b5a9-a8de5a66beed/console-operator/1.log"
Jul 13 09:18:31.473526 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:18:31.473501    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tmbbk_d1243d30-2275-43cc-b5a9-a8de5a66beed/console-operator/1.log"
Jul 13 09:18:31.480534 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:18:31.480506    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t558b_db263c9c-ef1c-4e74-968b-f8822c77dffc/ovn-acl-logging/0.log"
Jul 13 09:18:31.483081 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:18:31.483061    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t558b_db263c9c-ef1c-4e74-968b-f8822c77dffc/ovn-acl-logging/0.log"
Jul 13 09:19:25.288153 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:25.288120    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkrn"]
Jul 13 09:19:25.291146 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:25.291124    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkrn"
Jul 13 09:19:25.299553 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:25.299529    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 13 09:19:25.299993 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:25.299972    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 13 09:19:25.303551 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:25.303529    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qzhlj\""
Jul 13 09:19:25.316522 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:25.316495    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkrn"]
Jul 13 09:19:25.324834 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:25.324809    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db6ddeac-3234-48b4-ab32-0caababe07bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5tkrn\" (UID: \"db6ddeac-3234-48b4-ab32-0caababe07bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkrn"
Jul 13 09:19:25.324966 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:25.324943    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq8fb\" (UniqueName: \"kubernetes.io/projected/db6ddeac-3234-48b4-ab32-0caababe07bb-kube-api-access-tq8fb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5tkrn\" (UID: \"db6ddeac-3234-48b4-ab32-0caababe07bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkrn"
Jul 13 09:19:25.426388 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:25.426345    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq8fb\" (UniqueName: \"kubernetes.io/projected/db6ddeac-3234-48b4-ab32-0caababe07bb-kube-api-access-tq8fb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5tkrn\" (UID: \"db6ddeac-3234-48b4-ab32-0caababe07bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkrn"
Jul 13 09:19:25.426572 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:25.426418    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db6ddeac-3234-48b4-ab32-0caababe07bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5tkrn\" (UID: \"db6ddeac-3234-48b4-ab32-0caababe07bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkrn"
Jul 13 09:19:25.426843 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:25.426824    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db6ddeac-3234-48b4-ab32-0caababe07bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5tkrn\" (UID: \"db6ddeac-3234-48b4-ab32-0caababe07bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkrn"
Jul 13 09:19:25.443640 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:25.443615    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq8fb\" (UniqueName: \"kubernetes.io/projected/db6ddeac-3234-48b4-ab32-0caababe07bb-kube-api-access-tq8fb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5tkrn\" (UID: \"db6ddeac-3234-48b4-ab32-0caababe07bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkrn"
Jul 13 09:19:25.602225 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:25.602125    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkrn"
Jul 13 09:19:25.749852 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:25.749830    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkrn"]
Jul 13 09:19:25.752473 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:19:25.752446    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb6ddeac_3234_48b4_ab32_0caababe07bb.slice/crio-061793dbe11235bd6786cfed3a95afc29be5b4f332ff51517ec7f2d0a0c1cc29 WatchSource:0}: Error finding container 061793dbe11235bd6786cfed3a95afc29be5b4f332ff51517ec7f2d0a0c1cc29: Status 404 returned error can't find the container with id 061793dbe11235bd6786cfed3a95afc29be5b4f332ff51517ec7f2d0a0c1cc29
Jul 13 09:19:26.179329 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:26.179291    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkrn" event={"ID":"db6ddeac-3234-48b4-ab32-0caababe07bb","Type":"ContainerStarted","Data":"061793dbe11235bd6786cfed3a95afc29be5b4f332ff51517ec7f2d0a0c1cc29"}
Jul 13 09:19:31.211075 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:31.211039    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkrn" event={"ID":"db6ddeac-3234-48b4-ab32-0caababe07bb","Type":"ContainerStarted","Data":"0d99a8d70fbd55c812927d95509d3259b48fa31aff335119d4a204070aa0c6d6"}
Jul 13 09:19:31.211492 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:31.211192    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkrn"
Jul 13 09:19:31.238983 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:31.238938    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkrn" podStartSLOduration=1.401600288 podStartE2EDuration="6.238925065s" totalImagesPullingTime="4.837324777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:19:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:19:31.23641734 +0000 UTC m=+660.314294596" watchObservedRunningTime="2026-07-13 09:19:31.238925065 +0000 UTC m=+660.316802320"
Jul 13 09:19:42.218754 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:42.218727    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkrn"
Jul 13 09:19:50.439062 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:50.439031    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkrn"]
Jul 13 09:19:50.439461 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:50.439228    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkrn" podUID="db6ddeac-3234-48b4-ab32-0caababe07bb" containerName="manager" containerID="cri-o://0d99a8d70fbd55c812927d95509d3259b48fa31aff335119d4a204070aa0c6d6" gracePeriod=10
Jul 13 09:19:50.689671 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:50.689615    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkrn"
Jul 13 09:19:50.759857 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:50.759830    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db6ddeac-3234-48b4-ab32-0caababe07bb-extensions-socket-volume\") pod \"db6ddeac-3234-48b4-ab32-0caababe07bb\" (UID: \"db6ddeac-3234-48b4-ab32-0caababe07bb\") "
Jul 13 09:19:50.760005 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:50.759877    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tq8fb\" (UniqueName: \"kubernetes.io/projected/db6ddeac-3234-48b4-ab32-0caababe07bb-kube-api-access-tq8fb\") pod \"db6ddeac-3234-48b4-ab32-0caababe07bb\" (UID: \"db6ddeac-3234-48b4-ab32-0caababe07bb\") "
Jul 13 09:19:50.760196 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:50.760171    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db6ddeac-3234-48b4-ab32-0caababe07bb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "db6ddeac-3234-48b4-ab32-0caababe07bb" (UID: "db6ddeac-3234-48b4-ab32-0caababe07bb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 09:19:50.762103 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:50.762070    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db6ddeac-3234-48b4-ab32-0caababe07bb-kube-api-access-tq8fb" (OuterVolumeSpecName: "kube-api-access-tq8fb") pod "db6ddeac-3234-48b4-ab32-0caababe07bb" (UID: "db6ddeac-3234-48b4-ab32-0caababe07bb"). InnerVolumeSpecName "kube-api-access-tq8fb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:19:50.861122 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:50.861084    2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db6ddeac-3234-48b4-ab32-0caababe07bb-extensions-socket-volume\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:19:50.861122 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:50.861115    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tq8fb\" (UniqueName: \"kubernetes.io/projected/db6ddeac-3234-48b4-ab32-0caababe07bb-kube-api-access-tq8fb\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:19:51.305215 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:51.305184    2553 generic.go:356] "Generic (PLEG): container finished" podID="db6ddeac-3234-48b4-ab32-0caababe07bb" containerID="0d99a8d70fbd55c812927d95509d3259b48fa31aff335119d4a204070aa0c6d6" exitCode=0
Jul 13 09:19:51.305390 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:51.305224    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkrn"
Jul 13 09:19:51.305390 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:51.305237    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkrn" event={"ID":"db6ddeac-3234-48b4-ab32-0caababe07bb","Type":"ContainerDied","Data":"0d99a8d70fbd55c812927d95509d3259b48fa31aff335119d4a204070aa0c6d6"}
Jul 13 09:19:51.305390 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:51.305278    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkrn" event={"ID":"db6ddeac-3234-48b4-ab32-0caababe07bb","Type":"ContainerDied","Data":"061793dbe11235bd6786cfed3a95afc29be5b4f332ff51517ec7f2d0a0c1cc29"}
Jul 13 09:19:51.305390 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:51.305300    2553 scope.go:117] "RemoveContainer" containerID="0d99a8d70fbd55c812927d95509d3259b48fa31aff335119d4a204070aa0c6d6"
Jul 13 09:19:51.320840 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:51.320816    2553 scope.go:117] "RemoveContainer" containerID="0d99a8d70fbd55c812927d95509d3259b48fa31aff335119d4a204070aa0c6d6"
Jul 13 09:19:51.321163 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:19:51.321143    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d99a8d70fbd55c812927d95509d3259b48fa31aff335119d4a204070aa0c6d6\": container with ID starting with 0d99a8d70fbd55c812927d95509d3259b48fa31aff335119d4a204070aa0c6d6 not found: ID does not exist" containerID="0d99a8d70fbd55c812927d95509d3259b48fa31aff335119d4a204070aa0c6d6"
Jul 13 09:19:51.321244 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:51.321170    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d99a8d70fbd55c812927d95509d3259b48fa31aff335119d4a204070aa0c6d6"} err="failed to get container status \"0d99a8d70fbd55c812927d95509d3259b48fa31aff335119d4a204070aa0c6d6\": rpc error: code = NotFound desc = could not find container \"0d99a8d70fbd55c812927d95509d3259b48fa31aff335119d4a204070aa0c6d6\": container with ID starting with 0d99a8d70fbd55c812927d95509d3259b48fa31aff335119d4a204070aa0c6d6 not found: ID does not exist"
Jul 13 09:19:51.333434 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:51.333410    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkrn"]
Jul 13 09:19:51.340472 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:51.340448    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkrn"]
Jul 13 09:19:51.481657 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:19:51.481629    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db6ddeac-3234-48b4-ab32-0caababe07bb" path="/var/lib/kubelet/pods/db6ddeac-3234-48b4-ab32-0caababe07bb/volumes"
Jul 13 09:20:12.228717 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:12.228669    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4h69w"]
Jul 13 09:20:12.229187 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:12.229047    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db6ddeac-3234-48b4-ab32-0caababe07bb" containerName="manager"
Jul 13 09:20:12.229187 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:12.229059    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="db6ddeac-3234-48b4-ab32-0caababe07bb" containerName="manager"
Jul 13 09:20:12.229187 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:12.229143    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="db6ddeac-3234-48b4-ab32-0caababe07bb" containerName="manager"
Jul 13 09:20:12.233254 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:12.233238    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4h69w"
Jul 13 09:20:12.236172 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:12.236147    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 13 09:20:12.236348 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:12.236335    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mr8xt\""
Jul 13 09:20:12.237188 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:12.237173    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 13 09:20:12.237316 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:12.237240    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 13 09:20:12.241894 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:12.241867    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfgz4\" (UniqueName: \"kubernetes.io/projected/14e46a18-08a9-4636-a45b-429790b2cd57-kube-api-access-sfgz4\") pod \"limitador-limitador-64c94fd64f-4h69w\" (UID: \"14e46a18-08a9-4636-a45b-429790b2cd57\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4h69w"
Jul 13 09:20:12.242000 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:12.241928    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/14e46a18-08a9-4636-a45b-429790b2cd57-config-file\") pod \"limitador-limitador-64c94fd64f-4h69w\" (UID: \"14e46a18-08a9-4636-a45b-429790b2cd57\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4h69w"
Jul 13 09:20:12.242221 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:12.242203    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4h69w"]
Jul 13 09:20:12.326180 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:12.326153    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4h69w"]
Jul 13 09:20:12.342661 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:12.342634    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfgz4\" (UniqueName: \"kubernetes.io/projected/14e46a18-08a9-4636-a45b-429790b2cd57-kube-api-access-sfgz4\") pod \"limitador-limitador-64c94fd64f-4h69w\" (UID: \"14e46a18-08a9-4636-a45b-429790b2cd57\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4h69w"
Jul 13 09:20:12.342835 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:12.342678    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/14e46a18-08a9-4636-a45b-429790b2cd57-config-file\") pod \"limitador-limitador-64c94fd64f-4h69w\" (UID: \"14e46a18-08a9-4636-a45b-429790b2cd57\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4h69w"
Jul 13 09:20:12.343283 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:12.343266    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/14e46a18-08a9-4636-a45b-429790b2cd57-config-file\") pod \"limitador-limitador-64c94fd64f-4h69w\" (UID: \"14e46a18-08a9-4636-a45b-429790b2cd57\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4h69w"
Jul 13 09:20:12.352144 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:12.352117    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfgz4\" (UniqueName: \"kubernetes.io/projected/14e46a18-08a9-4636-a45b-429790b2cd57-kube-api-access-sfgz4\") pod \"limitador-limitador-64c94fd64f-4h69w\" (UID: \"14e46a18-08a9-4636-a45b-429790b2cd57\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4h69w"
Jul 13 09:20:12.544829 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:12.544729    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4h69w"
Jul 13 09:20:12.682080 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:12.682054    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4h69w"]
Jul 13 09:20:12.684333 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:20:12.684305    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14e46a18_08a9_4636_a45b_429790b2cd57.slice/crio-c3e6069384863f26b911406feb3058cce2019adf089272076bd14759da603a04 WatchSource:0}: Error finding container c3e6069384863f26b911406feb3058cce2019adf089272076bd14759da603a04: Status 404 returned error can't find the container with id c3e6069384863f26b911406feb3058cce2019adf089272076bd14759da603a04
Jul 13 09:20:12.686506 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:12.686489    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 09:20:13.058978 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:13.058945    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-7nhp8"]
Jul 13 09:20:13.061997 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:13.061978    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7nhp8"
Jul 13 09:20:13.065074 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:13.065053    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-575dh\""
Jul 13 09:20:13.076104 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:13.076081    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7nhp8"]
Jul 13 09:20:13.149255 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:13.149224    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdz2n\" (UniqueName: \"kubernetes.io/projected/cf8de761-1bcd-46ce-8f3e-c946443b7471-kube-api-access-qdz2n\") pod \"authorino-58cd955675-7nhp8\" (UID: \"cf8de761-1bcd-46ce-8f3e-c946443b7471\") " pod="kuadrant-system/authorino-58cd955675-7nhp8"
Jul 13 09:20:13.250189 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:13.250160    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdz2n\" (UniqueName: \"kubernetes.io/projected/cf8de761-1bcd-46ce-8f3e-c946443b7471-kube-api-access-qdz2n\") pod \"authorino-58cd955675-7nhp8\" (UID: \"cf8de761-1bcd-46ce-8f3e-c946443b7471\") " pod="kuadrant-system/authorino-58cd955675-7nhp8"
Jul 13 09:20:13.268384 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:13.262791    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdz2n\" (UniqueName: \"kubernetes.io/projected/cf8de761-1bcd-46ce-8f3e-c946443b7471-kube-api-access-qdz2n\") pod \"authorino-58cd955675-7nhp8\" (UID: \"cf8de761-1bcd-46ce-8f3e-c946443b7471\") " pod="kuadrant-system/authorino-58cd955675-7nhp8"
Jul 13 09:20:13.381190 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:13.381164    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7nhp8"
Jul 13 09:20:13.412352 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:13.412318    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4h69w" event={"ID":"14e46a18-08a9-4636-a45b-429790b2cd57","Type":"ContainerStarted","Data":"c3e6069384863f26b911406feb3058cce2019adf089272076bd14759da603a04"}
Jul 13 09:20:13.518709 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:13.518662    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7nhp8"]
Jul 13 09:20:13.521188 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:20:13.521155    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf8de761_1bcd_46ce_8f3e_c946443b7471.slice/crio-8e5933641bac8c1d7203744d47aa7e0eec343b92cbb17cab81e8106d5c384e73 WatchSource:0}: Error finding container 8e5933641bac8c1d7203744d47aa7e0eec343b92cbb17cab81e8106d5c384e73: Status 404 returned error can't find the container with id 8e5933641bac8c1d7203744d47aa7e0eec343b92cbb17cab81e8106d5c384e73
Jul 13 09:20:14.419506 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:14.419470    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7nhp8" event={"ID":"cf8de761-1bcd-46ce-8f3e-c946443b7471","Type":"ContainerStarted","Data":"8e5933641bac8c1d7203744d47aa7e0eec343b92cbb17cab81e8106d5c384e73"}
Jul 13 09:20:16.434230 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:16.434190    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4h69w" event={"ID":"14e46a18-08a9-4636-a45b-429790b2cd57","Type":"ContainerStarted","Data":"338e226dfa6087c5718eae8c6276789a0451d5c77651acabf47f255acb63eb06"}
Jul 13 09:20:16.434742 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:16.434333    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4h69w"
Jul 13 09:20:16.456418 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:16.456355    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-4h69w" podStartSLOduration=1.386453442 podStartE2EDuration="4.45633305s" totalImagesPullingTime="3.069879608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:20:16.453636002 +0000 UTC m=+705.531513256" watchObservedRunningTime="2026-07-13 09:20:16.45633305 +0000 UTC m=+705.534210306"
Jul 13 09:20:17.651041 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:17.651010    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7nhp8"]
Jul 13 09:20:18.446422 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:18.446388    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7nhp8" event={"ID":"cf8de761-1bcd-46ce-8f3e-c946443b7471","Type":"ContainerStarted","Data":"4a3985135813f0884af931d80564104fd5cee88725ba69e8280c467a41bcebc3"}
Jul 13 09:20:18.446603 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:18.446434    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-7nhp8" podUID="cf8de761-1bcd-46ce-8f3e-c946443b7471" containerName="authorino" containerID="cri-o://4a3985135813f0884af931d80564104fd5cee88725ba69e8280c467a41bcebc3" gracePeriod=30
Jul 13 09:20:18.464182 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:18.464143    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-7nhp8" podStartSLOduration=1.390318068 podStartE2EDuration="5.464128348s" totalImagesPullingTime="4.07381028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:20:18.463651035 +0000 UTC m=+707.541528291" watchObservedRunningTime="2026-07-13 09:20:18.464128348 +0000 UTC m=+707.542005603"
Jul 13 09:20:18.692956 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:18.692934    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7nhp8"
Jul 13 09:20:18.805943 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:18.805864    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdz2n\" (UniqueName: \"kubernetes.io/projected/cf8de761-1bcd-46ce-8f3e-c946443b7471-kube-api-access-qdz2n\") pod \"cf8de761-1bcd-46ce-8f3e-c946443b7471\" (UID: \"cf8de761-1bcd-46ce-8f3e-c946443b7471\") "
Jul 13 09:20:18.807908 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:18.807876    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf8de761-1bcd-46ce-8f3e-c946443b7471-kube-api-access-qdz2n" (OuterVolumeSpecName: "kube-api-access-qdz2n") pod "cf8de761-1bcd-46ce-8f3e-c946443b7471" (UID: "cf8de761-1bcd-46ce-8f3e-c946443b7471"). InnerVolumeSpecName "kube-api-access-qdz2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:20:18.906661 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:18.906632    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdz2n\" (UniqueName: \"kubernetes.io/projected/cf8de761-1bcd-46ce-8f3e-c946443b7471-kube-api-access-qdz2n\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:20:19.452565 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:19.452537    2553 generic.go:356] "Generic (PLEG): container finished" podID="cf8de761-1bcd-46ce-8f3e-c946443b7471" containerID="4a3985135813f0884af931d80564104fd5cee88725ba69e8280c467a41bcebc3" exitCode=0
Jul 13 09:20:19.452810 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:19.452575    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7nhp8"
Jul 13 09:20:19.452810 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:19.452628    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7nhp8" event={"ID":"cf8de761-1bcd-46ce-8f3e-c946443b7471","Type":"ContainerDied","Data":"4a3985135813f0884af931d80564104fd5cee88725ba69e8280c467a41bcebc3"}
Jul 13 09:20:19.452810 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:19.452673    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7nhp8" event={"ID":"cf8de761-1bcd-46ce-8f3e-c946443b7471","Type":"ContainerDied","Data":"8e5933641bac8c1d7203744d47aa7e0eec343b92cbb17cab81e8106d5c384e73"}
Jul 13 09:20:19.452810 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:19.452721    2553 scope.go:117] "RemoveContainer" containerID="4a3985135813f0884af931d80564104fd5cee88725ba69e8280c467a41bcebc3"
Jul 13 09:20:19.461311 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:19.461297    2553 scope.go:117] "RemoveContainer" containerID="4a3985135813f0884af931d80564104fd5cee88725ba69e8280c467a41bcebc3"
Jul 13 09:20:19.461548 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:20:19.461531    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a3985135813f0884af931d80564104fd5cee88725ba69e8280c467a41bcebc3\": container with ID starting with 4a3985135813f0884af931d80564104fd5cee88725ba69e8280c467a41bcebc3 not found: ID does not exist" containerID="4a3985135813f0884af931d80564104fd5cee88725ba69e8280c467a41bcebc3"
Jul 13 09:20:19.461587 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:19.461558    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a3985135813f0884af931d80564104fd5cee88725ba69e8280c467a41bcebc3"} err="failed to get container status \"4a3985135813f0884af931d80564104fd5cee88725ba69e8280c467a41bcebc3\": rpc error: code = NotFound desc = could not find container \"4a3985135813f0884af931d80564104fd5cee88725ba69e8280c467a41bcebc3\": container with ID starting with 4a3985135813f0884af931d80564104fd5cee88725ba69e8280c467a41bcebc3 not found: ID does not exist"
Jul 13 09:20:19.483992 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:19.483968    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7nhp8"]
Jul 13 09:20:19.485892 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:19.485866    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-7nhp8"]
Jul 13 09:20:21.481432 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:21.481400    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf8de761-1bcd-46ce-8f3e-c946443b7471" path="/var/lib/kubelet/pods/cf8de761-1bcd-46ce-8f3e-c946443b7471/volumes"
Jul 13 09:20:27.442155 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:27.442076    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4h69w"
Jul 13 09:20:27.534419 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:27.534386    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4h69w"]
Jul 13 09:20:27.534594 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:27.534574    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-4h69w" podUID="14e46a18-08a9-4636-a45b-429790b2cd57" containerName="limitador" containerID="cri-o://338e226dfa6087c5718eae8c6276789a0451d5c77651acabf47f255acb63eb06" gracePeriod=30
Jul 13 09:20:28.494830 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:28.494805    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4h69w"
Jul 13 09:20:28.496945 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:28.496913    2553 generic.go:356] "Generic (PLEG): container finished" podID="14e46a18-08a9-4636-a45b-429790b2cd57" containerID="338e226dfa6087c5718eae8c6276789a0451d5c77651acabf47f255acb63eb06" exitCode=0
Jul 13 09:20:28.497066 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:28.496953    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4h69w"
Jul 13 09:20:28.497066 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:28.496971    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4h69w" event={"ID":"14e46a18-08a9-4636-a45b-429790b2cd57","Type":"ContainerDied","Data":"338e226dfa6087c5718eae8c6276789a0451d5c77651acabf47f255acb63eb06"}
Jul 13 09:20:28.497066 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:28.497013    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4h69w" event={"ID":"14e46a18-08a9-4636-a45b-429790b2cd57","Type":"ContainerDied","Data":"c3e6069384863f26b911406feb3058cce2019adf089272076bd14759da603a04"}
Jul 13 09:20:28.497066 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:28.497035    2553 scope.go:117] "RemoveContainer" containerID="338e226dfa6087c5718eae8c6276789a0451d5c77651acabf47f255acb63eb06"
Jul 13 09:20:28.505130 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:28.505110    2553 scope.go:117] "RemoveContainer" containerID="338e226dfa6087c5718eae8c6276789a0451d5c77651acabf47f255acb63eb06"
Jul 13 09:20:28.505381 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:20:28.505365    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"338e226dfa6087c5718eae8c6276789a0451d5c77651acabf47f255acb63eb06\": container with ID starting with 338e226dfa6087c5718eae8c6276789a0451d5c77651acabf47f255acb63eb06 not found: ID does not exist" containerID="338e226dfa6087c5718eae8c6276789a0451d5c77651acabf47f255acb63eb06"
Jul 13 09:20:28.505421 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:28.505391    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"338e226dfa6087c5718eae8c6276789a0451d5c77651acabf47f255acb63eb06"} err="failed to get container status \"338e226dfa6087c5718eae8c6276789a0451d5c77651acabf47f255acb63eb06\": rpc error: code = NotFound desc = could not find container \"338e226dfa6087c5718eae8c6276789a0451d5c77651acabf47f255acb63eb06\": container with ID starting with 338e226dfa6087c5718eae8c6276789a0451d5c77651acabf47f255acb63eb06 not found: ID does not exist"
Jul 13 09:20:28.602956 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:28.602877    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/14e46a18-08a9-4636-a45b-429790b2cd57-config-file\") pod \"14e46a18-08a9-4636-a45b-429790b2cd57\" (UID: \"14e46a18-08a9-4636-a45b-429790b2cd57\") "
Jul 13 09:20:28.602956 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:28.602951    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfgz4\" (UniqueName: \"kubernetes.io/projected/14e46a18-08a9-4636-a45b-429790b2cd57-kube-api-access-sfgz4\") pod \"14e46a18-08a9-4636-a45b-429790b2cd57\" (UID: \"14e46a18-08a9-4636-a45b-429790b2cd57\") "
Jul 13 09:20:28.603262 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:28.603232    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14e46a18-08a9-4636-a45b-429790b2cd57-config-file" (OuterVolumeSpecName: "config-file") pod "14e46a18-08a9-4636-a45b-429790b2cd57" (UID: "14e46a18-08a9-4636-a45b-429790b2cd57"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:20:28.604968 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:28.604947    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14e46a18-08a9-4636-a45b-429790b2cd57-kube-api-access-sfgz4" (OuterVolumeSpecName: "kube-api-access-sfgz4") pod "14e46a18-08a9-4636-a45b-429790b2cd57" (UID: "14e46a18-08a9-4636-a45b-429790b2cd57"). InnerVolumeSpecName "kube-api-access-sfgz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:20:28.704179 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:28.704141    2553 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/14e46a18-08a9-4636-a45b-429790b2cd57-config-file\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:20:28.704179 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:28.704175    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfgz4\" (UniqueName: \"kubernetes.io/projected/14e46a18-08a9-4636-a45b-429790b2cd57-kube-api-access-sfgz4\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:20:28.819928 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:28.819897    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4h69w"]
Jul 13 09:20:28.823700 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:28.823664    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4h69w"]
Jul 13 09:20:29.481540 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:29.481505    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14e46a18-08a9-4636-a45b-429790b2cd57" path="/var/lib/kubelet/pods/14e46a18-08a9-4636-a45b-429790b2cd57/volumes"
Jul 13 09:20:30.214510 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:30.214472    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-49w7j"]
Jul 13 09:20:30.215093 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:30.215072    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14e46a18-08a9-4636-a45b-429790b2cd57" containerName="limitador"
Jul 13 09:20:30.215134 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:30.215098    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="14e46a18-08a9-4636-a45b-429790b2cd57" containerName="limitador"
Jul 13 09:20:30.215134 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:30.215113    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf8de761-1bcd-46ce-8f3e-c946443b7471" containerName="authorino"
Jul 13 09:20:30.215134 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:30.215122    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf8de761-1bcd-46ce-8f3e-c946443b7471" containerName="authorino"
Jul 13 09:20:30.215270 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:30.215257    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="14e46a18-08a9-4636-a45b-429790b2cd57" containerName="limitador"
Jul 13 09:20:30.215309 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:30.215274    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf8de761-1bcd-46ce-8f3e-c946443b7471" containerName="authorino"
Jul 13 09:20:30.218500 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:30.218479    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-49w7j"
Jul 13 09:20:30.221327 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:30.221306    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 09:20:30.221488 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:30.221309    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 13 09:20:30.221488 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:30.221384    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 13 09:20:30.221488 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:30.221423    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-698cw\""
Jul 13 09:20:30.226592 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:30.226571    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-49w7j"]
Jul 13 09:20:30.319812 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:30.319782    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hzbl\" (UniqueName: \"kubernetes.io/projected/1da6a10e-3821-4073-9534-5198bb65ff0c-kube-api-access-8hzbl\") pod \"postgres-69fb4594cf-49w7j\" (UID: \"1da6a10e-3821-4073-9534-5198bb65ff0c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-49w7j"
Jul 13 09:20:30.319981 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:30.319824    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1da6a10e-3821-4073-9534-5198bb65ff0c-data\") pod \"postgres-69fb4594cf-49w7j\" (UID: \"1da6a10e-3821-4073-9534-5198bb65ff0c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-49w7j"
Jul 13 09:20:30.420909 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:30.420878    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1da6a10e-3821-4073-9534-5198bb65ff0c-data\") pod \"postgres-69fb4594cf-49w7j\" (UID: \"1da6a10e-3821-4073-9534-5198bb65ff0c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-49w7j"
Jul 13 09:20:30.421065 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:30.420981    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hzbl\" (UniqueName: \"kubernetes.io/projected/1da6a10e-3821-4073-9534-5198bb65ff0c-kube-api-access-8hzbl\") pod \"postgres-69fb4594cf-49w7j\" (UID: \"1da6a10e-3821-4073-9534-5198bb65ff0c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-49w7j"
Jul 13 09:20:30.421280 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:30.421260    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1da6a10e-3821-4073-9534-5198bb65ff0c-data\") pod \"postgres-69fb4594cf-49w7j\" (UID: \"1da6a10e-3821-4073-9534-5198bb65ff0c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-49w7j"
Jul 13 09:20:30.429505 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:30.429470    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hzbl\" (UniqueName: \"kubernetes.io/projected/1da6a10e-3821-4073-9534-5198bb65ff0c-kube-api-access-8hzbl\") pod \"postgres-69fb4594cf-49w7j\" (UID: \"1da6a10e-3821-4073-9534-5198bb65ff0c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-49w7j"
Jul 13 09:20:30.529614 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:30.529535    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-49w7j"
Jul 13 09:20:30.653372 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:30.653347    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-49w7j"]
Jul 13 09:20:30.655468 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:20:30.655437    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1da6a10e_3821_4073_9534_5198bb65ff0c.slice/crio-4d953d40537cf94af67446b4092ba5b42aa135a3a80b697ebcfa55978b119d89 WatchSource:0}: Error finding container 4d953d40537cf94af67446b4092ba5b42aa135a3a80b697ebcfa55978b119d89: Status 404 returned error can't find the container with id 4d953d40537cf94af67446b4092ba5b42aa135a3a80b697ebcfa55978b119d89
Jul 13 09:20:31.511346 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:31.511311    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-49w7j" event={"ID":"1da6a10e-3821-4073-9534-5198bb65ff0c","Type":"ContainerStarted","Data":"4d953d40537cf94af67446b4092ba5b42aa135a3a80b697ebcfa55978b119d89"}
Jul 13 09:20:36.072262 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:36.072236    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 13 09:20:36.540618 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:36.540582    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-49w7j" event={"ID":"1da6a10e-3821-4073-9534-5198bb65ff0c","Type":"ContainerStarted","Data":"612852c5fef4521d5a525d4b1be695ed12bcfd2deaf8e6e0d52b4f2ac696577f"}
Jul 13 09:20:36.540816 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:36.540721    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-49w7j"
Jul 13 09:20:36.557810 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:36.557760    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-49w7j" podStartSLOduration=1.145315027 podStartE2EDuration="6.557745406s" totalImagesPullingTime="5.412430379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:20:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:20:36.556869721 +0000 UTC m=+725.634746976" watchObservedRunningTime="2026-07-13 09:20:36.557745406 +0000 UTC m=+725.635622661"
Jul 13 09:20:42.575419 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:42.575384    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-49w7j"
Jul 13 09:20:43.115262 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:43.115228    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-q4nzf"]
Jul 13 09:20:43.121394 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:43.121374    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-q4nzf"
Jul 13 09:20:43.124196 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:43.124173    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 13 09:20:43.125290 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:43.125268    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-575dh\""
Jul 13 09:20:43.125403 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:43.125322    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 13 09:20:43.126153 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:43.126136    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-q4nzf"]
Jul 13 09:20:43.242445 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:43.242410    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpgn7\" (UniqueName: \"kubernetes.io/projected/24ee6734-8a2f-45e7-beaa-69f08608770d-kube-api-access-cpgn7\") pod \"authorino-5d4b67c446-q4nzf\" (UID: \"24ee6734-8a2f-45e7-beaa-69f08608770d\") " pod="kuadrant-system/authorino-5d4b67c446-q4nzf"
Jul 13 09:20:43.343666 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:43.343634    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpgn7\" (UniqueName: \"kubernetes.io/projected/24ee6734-8a2f-45e7-beaa-69f08608770d-kube-api-access-cpgn7\") pod \"authorino-5d4b67c446-q4nzf\" (UID: \"24ee6734-8a2f-45e7-beaa-69f08608770d\") " pod="kuadrant-system/authorino-5d4b67c446-q4nzf"
Jul 13 09:20:43.353597 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:43.353568    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-q4nzf"]
Jul 13 09:20:43.353900 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:20:43.353878    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-cpgn7], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-q4nzf" podUID="24ee6734-8a2f-45e7-beaa-69f08608770d"
Jul 13 09:20:43.355714 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:43.355681    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpgn7\" (UniqueName: \"kubernetes.io/projected/24ee6734-8a2f-45e7-beaa-69f08608770d-kube-api-access-cpgn7\") pod \"authorino-5d4b67c446-q4nzf\" (UID: \"24ee6734-8a2f-45e7-beaa-69f08608770d\") " pod="kuadrant-system/authorino-5d4b67c446-q4nzf"
Jul 13 09:20:43.382957 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:43.382929    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-854749f4dd-5dflf"]
Jul 13 09:20:43.387002 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:43.386984    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-854749f4dd-5dflf"
Jul 13 09:20:43.395086 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:43.395061    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-854749f4dd-5dflf"]
Jul 13 09:20:43.545172 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:43.545138    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds6nd\" (UniqueName: \"kubernetes.io/projected/76acf7f6-c83d-441e-8580-8e6cc28e6a88-kube-api-access-ds6nd\") pod \"authorino-854749f4dd-5dflf\" (UID: \"76acf7f6-c83d-441e-8580-8e6cc28e6a88\") " pod="kuadrant-system/authorino-854749f4dd-5dflf"
Jul 13 09:20:43.573005 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:43.572974    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-q4nzf"
Jul 13 09:20:43.577117 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:43.577092    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-854749f4dd-5dflf"]
Jul 13 09:20:43.577503 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:20:43.577419    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-ds6nd], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-854749f4dd-5dflf" podUID="76acf7f6-c83d-441e-8580-8e6cc28e6a88"
Jul 13 09:20:43.593533 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:43.593508    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-q4nzf"
Jul 13 09:20:43.645826 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:43.645757    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds6nd\" (UniqueName: \"kubernetes.io/projected/76acf7f6-c83d-441e-8580-8e6cc28e6a88-kube-api-access-ds6nd\") pod \"authorino-854749f4dd-5dflf\" (UID: \"76acf7f6-c83d-441e-8580-8e6cc28e6a88\") " pod="kuadrant-system/authorino-854749f4dd-5dflf"
Jul 13 09:20:43.653902 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:43.653876    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds6nd\" (UniqueName: \"kubernetes.io/projected/76acf7f6-c83d-441e-8580-8e6cc28e6a88-kube-api-access-ds6nd\") pod \"authorino-854749f4dd-5dflf\" (UID: \"76acf7f6-c83d-441e-8580-8e6cc28e6a88\") " pod="kuadrant-system/authorino-854749f4dd-5dflf"
Jul 13 09:20:43.746641 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:43.746611    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpgn7\" (UniqueName: \"kubernetes.io/projected/24ee6734-8a2f-45e7-beaa-69f08608770d-kube-api-access-cpgn7\") pod \"24ee6734-8a2f-45e7-beaa-69f08608770d\" (UID: \"24ee6734-8a2f-45e7-beaa-69f08608770d\") "
Jul 13 09:20:43.748585 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:43.748563    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24ee6734-8a2f-45e7-beaa-69f08608770d-kube-api-access-cpgn7" (OuterVolumeSpecName: "kube-api-access-cpgn7") pod "24ee6734-8a2f-45e7-beaa-69f08608770d" (UID: "24ee6734-8a2f-45e7-beaa-69f08608770d"). InnerVolumeSpecName "kube-api-access-cpgn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:20:43.847927 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:43.847903    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpgn7\" (UniqueName: \"kubernetes.io/projected/24ee6734-8a2f-45e7-beaa-69f08608770d-kube-api-access-cpgn7\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:20:44.577627 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:44.577599    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-q4nzf"
Jul 13 09:20:44.578040 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:44.577606    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-854749f4dd-5dflf"
Jul 13 09:20:44.637573 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:44.637543    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-854749f4dd-5dflf"
Jul 13 09:20:44.666830 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:44.666803    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-q4nzf"]
Jul 13 09:20:44.674030 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:44.674002    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-q4nzf"]
Jul 13 09:20:44.755074 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:44.755039    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ds6nd\" (UniqueName: \"kubernetes.io/projected/76acf7f6-c83d-441e-8580-8e6cc28e6a88-kube-api-access-ds6nd\") pod \"76acf7f6-c83d-441e-8580-8e6cc28e6a88\" (UID: \"76acf7f6-c83d-441e-8580-8e6cc28e6a88\") "
Jul 13 09:20:44.757134 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:44.757101    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76acf7f6-c83d-441e-8580-8e6cc28e6a88-kube-api-access-ds6nd" (OuterVolumeSpecName: "kube-api-access-ds6nd") pod "76acf7f6-c83d-441e-8580-8e6cc28e6a88" (UID: "76acf7f6-c83d-441e-8580-8e6cc28e6a88"). InnerVolumeSpecName "kube-api-access-ds6nd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:20:44.856014 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:44.855943    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ds6nd\" (UniqueName: \"kubernetes.io/projected/76acf7f6-c83d-441e-8580-8e6cc28e6a88-kube-api-access-ds6nd\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:20:45.482002 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:45.481968    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24ee6734-8a2f-45e7-beaa-69f08608770d" path="/var/lib/kubelet/pods/24ee6734-8a2f-45e7-beaa-69f08608770d/volumes"
Jul 13 09:20:45.581649 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:45.581621    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-854749f4dd-5dflf"
Jul 13 09:20:45.640707 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:45.640660    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-854749f4dd-5dflf"]
Jul 13 09:20:45.646809 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:45.646783    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-854749f4dd-5dflf"]
Jul 13 09:20:47.481336 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:47.481302    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76acf7f6-c83d-441e-8580-8e6cc28e6a88" path="/var/lib/kubelet/pods/76acf7f6-c83d-441e-8580-8e6cc28e6a88/volumes"
Jul 13 09:20:49.326130 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:49.326096    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8476d89dc8-frzdr"]
Jul 13 09:20:49.343528 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:49.343507    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8476d89dc8-frzdr"
Jul 13 09:20:49.348170 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:49.348146    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8476d89dc8-frzdr"]
Jul 13 09:20:49.351329 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:49.351305    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 13 09:20:49.352390 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:49.352367    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 13 09:20:49.352568 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:49.352468    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-d9jl7\""
Jul 13 09:20:49.497702 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:49.497661    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrr64\" (UniqueName: \"kubernetes.io/projected/46915e1b-9e12-4b54-a97a-b93f2179ee52-kube-api-access-vrr64\") pod \"maas-controller-8476d89dc8-frzdr\" (UID: \"46915e1b-9e12-4b54-a97a-b93f2179ee52\") " pod="opendatahub/maas-controller-8476d89dc8-frzdr"
Jul 13 09:20:49.497849 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:49.497753    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46915e1b-9e12-4b54-a97a-b93f2179ee52-webhook-cert\") pod \"maas-controller-8476d89dc8-frzdr\" (UID: \"46915e1b-9e12-4b54-a97a-b93f2179ee52\") " pod="opendatahub/maas-controller-8476d89dc8-frzdr"
Jul 13 09:20:49.542620 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:49.542589    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f896dbf74-9fkwj"]
Jul 13 09:20:49.545280 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:49.545262    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f896dbf74-9fkwj"
Jul 13 09:20:49.561393 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:49.561371    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f896dbf74-9fkwj"]
Jul 13 09:20:49.598778 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:49.598716    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrr64\" (UniqueName: \"kubernetes.io/projected/46915e1b-9e12-4b54-a97a-b93f2179ee52-kube-api-access-vrr64\") pod \"maas-controller-8476d89dc8-frzdr\" (UID: \"46915e1b-9e12-4b54-a97a-b93f2179ee52\") " pod="opendatahub/maas-controller-8476d89dc8-frzdr"
Jul 13 09:20:49.598778 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:49.598769    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46915e1b-9e12-4b54-a97a-b93f2179ee52-webhook-cert\") pod \"maas-controller-8476d89dc8-frzdr\" (UID: \"46915e1b-9e12-4b54-a97a-b93f2179ee52\") " pod="opendatahub/maas-controller-8476d89dc8-frzdr"
Jul 13 09:20:49.598945 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:20:49.598920    2553 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 13 09:20:49.599020 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:20:49.598997    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46915e1b-9e12-4b54-a97a-b93f2179ee52-webhook-cert podName:46915e1b-9e12-4b54-a97a-b93f2179ee52 nodeName:}" failed. No retries permitted until 2026-07-13 09:20:50.098975076 +0000 UTC m=+739.176852310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/46915e1b-9e12-4b54-a97a-b93f2179ee52-webhook-cert") pod "maas-controller-8476d89dc8-frzdr" (UID: "46915e1b-9e12-4b54-a97a-b93f2179ee52") : secret "maas-controller-webhook-cert" not found
Jul 13 09:20:49.608346 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:49.608326    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrr64\" (UniqueName: \"kubernetes.io/projected/46915e1b-9e12-4b54-a97a-b93f2179ee52-kube-api-access-vrr64\") pod \"maas-controller-8476d89dc8-frzdr\" (UID: \"46915e1b-9e12-4b54-a97a-b93f2179ee52\") " pod="opendatahub/maas-controller-8476d89dc8-frzdr"
Jul 13 09:20:49.699859 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:49.699830    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/beab5da2-884e-4482-a3fb-feefe18f0c8c-webhook-cert\") pod \"maas-controller-7f896dbf74-9fkwj\" (UID: \"beab5da2-884e-4482-a3fb-feefe18f0c8c\") " pod="opendatahub/maas-controller-7f896dbf74-9fkwj"
Jul 13 09:20:49.699993 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:49.699882    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st4lq\" (UniqueName: \"kubernetes.io/projected/beab5da2-884e-4482-a3fb-feefe18f0c8c-kube-api-access-st4lq\") pod \"maas-controller-7f896dbf74-9fkwj\" (UID: \"beab5da2-884e-4482-a3fb-feefe18f0c8c\") " pod="opendatahub/maas-controller-7f896dbf74-9fkwj"
Jul 13 09:20:49.801046 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:49.801019    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/beab5da2-884e-4482-a3fb-feefe18f0c8c-webhook-cert\") pod \"maas-controller-7f896dbf74-9fkwj\" (UID: \"beab5da2-884e-4482-a3fb-feefe18f0c8c\") " pod="opendatahub/maas-controller-7f896dbf74-9fkwj"
Jul 13 09:20:49.801195 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:49.801089    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st4lq\" (UniqueName: \"kubernetes.io/projected/beab5da2-884e-4482-a3fb-feefe18f0c8c-kube-api-access-st4lq\") pod \"maas-controller-7f896dbf74-9fkwj\" (UID: \"beab5da2-884e-4482-a3fb-feefe18f0c8c\") " pod="opendatahub/maas-controller-7f896dbf74-9fkwj"
Jul 13 09:20:49.803598 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:49.803572    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/beab5da2-884e-4482-a3fb-feefe18f0c8c-webhook-cert\") pod \"maas-controller-7f896dbf74-9fkwj\" (UID: \"beab5da2-884e-4482-a3fb-feefe18f0c8c\") " pod="opendatahub/maas-controller-7f896dbf74-9fkwj"
Jul 13 09:20:49.810911 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:49.810886    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st4lq\" (UniqueName: \"kubernetes.io/projected/beab5da2-884e-4482-a3fb-feefe18f0c8c-kube-api-access-st4lq\") pod \"maas-controller-7f896dbf74-9fkwj\" (UID: \"beab5da2-884e-4482-a3fb-feefe18f0c8c\") " pod="opendatahub/maas-controller-7f896dbf74-9fkwj"
Jul 13 09:20:49.855259 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:49.855185    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f896dbf74-9fkwj"
Jul 13 09:20:49.984518 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:49.984494    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f896dbf74-9fkwj"]
Jul 13 09:20:49.986287 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:20:49.986265    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeab5da2_884e_4482_a3fb_feefe18f0c8c.slice/crio-88589a771b9c6d6691f7619b2cf1b2cd284d0c04c83c9d5e03ed1247b996fbcb WatchSource:0}: Error finding container 88589a771b9c6d6691f7619b2cf1b2cd284d0c04c83c9d5e03ed1247b996fbcb: Status 404 returned error can't find the container with id 88589a771b9c6d6691f7619b2cf1b2cd284d0c04c83c9d5e03ed1247b996fbcb
Jul 13 09:20:50.105234 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:50.105204    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46915e1b-9e12-4b54-a97a-b93f2179ee52-webhook-cert\") pod \"maas-controller-8476d89dc8-frzdr\" (UID: \"46915e1b-9e12-4b54-a97a-b93f2179ee52\") " pod="opendatahub/maas-controller-8476d89dc8-frzdr"
Jul 13 09:20:50.107532 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:50.107478    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46915e1b-9e12-4b54-a97a-b93f2179ee52-webhook-cert\") pod \"maas-controller-8476d89dc8-frzdr\" (UID: \"46915e1b-9e12-4b54-a97a-b93f2179ee52\") " pod="opendatahub/maas-controller-8476d89dc8-frzdr"
Jul 13 09:20:50.255162 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:50.255133    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8476d89dc8-frzdr"
Jul 13 09:20:50.386274 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:50.386255    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8476d89dc8-frzdr"]
Jul 13 09:20:50.388418 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:20:50.388394    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46915e1b_9e12_4b54_a97a_b93f2179ee52.slice/crio-8909f99704cc90c321746bb27a33ba33834e0c88ac807139d2a267c1e7f67c38 WatchSource:0}: Error finding container 8909f99704cc90c321746bb27a33ba33834e0c88ac807139d2a267c1e7f67c38: Status 404 returned error can't find the container with id 8909f99704cc90c321746bb27a33ba33834e0c88ac807139d2a267c1e7f67c38
Jul 13 09:20:50.606589 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:50.606549    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8476d89dc8-frzdr" event={"ID":"46915e1b-9e12-4b54-a97a-b93f2179ee52","Type":"ContainerStarted","Data":"8909f99704cc90c321746bb27a33ba33834e0c88ac807139d2a267c1e7f67c38"}
Jul 13 09:20:50.607727 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:50.607706    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f896dbf74-9fkwj" event={"ID":"beab5da2-884e-4482-a3fb-feefe18f0c8c","Type":"ContainerStarted","Data":"88589a771b9c6d6691f7619b2cf1b2cd284d0c04c83c9d5e03ed1247b996fbcb"}
Jul 13 09:20:53.628311 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:53.628276    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8476d89dc8-frzdr" event={"ID":"46915e1b-9e12-4b54-a97a-b93f2179ee52","Type":"ContainerStarted","Data":"9db9dc0654ec6a680f8571ac3e54b8934d92360b29b68b3f2ad072bf9d11fcaf"}
Jul 13 09:20:53.628798 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:53.628432    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8476d89dc8-frzdr"
Jul 13 09:20:53.629799 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:53.629778    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f896dbf74-9fkwj" event={"ID":"beab5da2-884e-4482-a3fb-feefe18f0c8c","Type":"ContainerStarted","Data":"4b12b75845b2c115dac2115515a6e7638478d83b76c19f1cb3d462c55fba75fb"}
Jul 13 09:20:53.629918 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:53.629902    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f896dbf74-9fkwj"
Jul 13 09:20:53.650676 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:53.650638    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8476d89dc8-frzdr" podStartSLOduration=2.140824761 podStartE2EDuration="4.650626157s" totalImagesPullingTime="2.509801396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:20:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:20:53.648571622 +0000 UTC m=+742.726448877" watchObservedRunningTime="2026-07-13 09:20:53.650626157 +0000 UTC m=+742.728503447"
Jul 13 09:20:53.669662 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:20:53.669625    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f896dbf74-9fkwj" podStartSLOduration=1.7620950949999998 podStartE2EDuration="4.669616189s" totalImagesPullingTime="2.907521094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:20:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:20:53.668033634 +0000 UTC m=+742.745910910" watchObservedRunningTime="2026-07-13 09:20:53.669616189 +0000 UTC m=+742.747493484"
Jul 13 09:21:04.641210 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:04.641179    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8476d89dc8-frzdr"
Jul 13 09:21:04.641644 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:04.641340    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f896dbf74-9fkwj"
Jul 13 09:21:04.705819 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:04.705786    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8476d89dc8-frzdr"]
Jul 13 09:21:04.706027 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:04.705999    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-8476d89dc8-frzdr" podUID="46915e1b-9e12-4b54-a97a-b93f2179ee52" containerName="manager" containerID="cri-o://9db9dc0654ec6a680f8571ac3e54b8934d92360b29b68b3f2ad072bf9d11fcaf" gracePeriod=30
Jul 13 09:21:04.953274 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:04.953251    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8476d89dc8-frzdr"
Jul 13 09:21:05.040291 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:05.040254    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrr64\" (UniqueName: \"kubernetes.io/projected/46915e1b-9e12-4b54-a97a-b93f2179ee52-kube-api-access-vrr64\") pod \"46915e1b-9e12-4b54-a97a-b93f2179ee52\" (UID: \"46915e1b-9e12-4b54-a97a-b93f2179ee52\") "
Jul 13 09:21:05.040465 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:05.040305    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46915e1b-9e12-4b54-a97a-b93f2179ee52-webhook-cert\") pod \"46915e1b-9e12-4b54-a97a-b93f2179ee52\" (UID: \"46915e1b-9e12-4b54-a97a-b93f2179ee52\") "
Jul 13 09:21:05.042499 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:05.042471    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46915e1b-9e12-4b54-a97a-b93f2179ee52-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "46915e1b-9e12-4b54-a97a-b93f2179ee52" (UID: "46915e1b-9e12-4b54-a97a-b93f2179ee52"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:21:05.042623 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:05.042511    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46915e1b-9e12-4b54-a97a-b93f2179ee52-kube-api-access-vrr64" (OuterVolumeSpecName: "kube-api-access-vrr64") pod "46915e1b-9e12-4b54-a97a-b93f2179ee52" (UID: "46915e1b-9e12-4b54-a97a-b93f2179ee52"). InnerVolumeSpecName "kube-api-access-vrr64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:21:05.141057 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:05.141029    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrr64\" (UniqueName: \"kubernetes.io/projected/46915e1b-9e12-4b54-a97a-b93f2179ee52-kube-api-access-vrr64\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:21:05.141057 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:05.141052    2553 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46915e1b-9e12-4b54-a97a-b93f2179ee52-webhook-cert\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:21:05.692446 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:05.692409    2553 generic.go:356] "Generic (PLEG): container finished" podID="46915e1b-9e12-4b54-a97a-b93f2179ee52" containerID="9db9dc0654ec6a680f8571ac3e54b8934d92360b29b68b3f2ad072bf9d11fcaf" exitCode=0
Jul 13 09:21:05.692918 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:05.692455    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8476d89dc8-frzdr"
Jul 13 09:21:05.692918 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:05.692497    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8476d89dc8-frzdr" event={"ID":"46915e1b-9e12-4b54-a97a-b93f2179ee52","Type":"ContainerDied","Data":"9db9dc0654ec6a680f8571ac3e54b8934d92360b29b68b3f2ad072bf9d11fcaf"}
Jul 13 09:21:05.692918 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:05.692561    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8476d89dc8-frzdr" event={"ID":"46915e1b-9e12-4b54-a97a-b93f2179ee52","Type":"ContainerDied","Data":"8909f99704cc90c321746bb27a33ba33834e0c88ac807139d2a267c1e7f67c38"}
Jul 13 09:21:05.692918 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:05.692596    2553 scope.go:117] "RemoveContainer" containerID="9db9dc0654ec6a680f8571ac3e54b8934d92360b29b68b3f2ad072bf9d11fcaf"
Jul 13 09:21:05.701163 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:05.701147    2553 scope.go:117] "RemoveContainer" containerID="9db9dc0654ec6a680f8571ac3e54b8934d92360b29b68b3f2ad072bf9d11fcaf"
Jul 13 09:21:05.701450 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:21:05.701434    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9db9dc0654ec6a680f8571ac3e54b8934d92360b29b68b3f2ad072bf9d11fcaf\": container with ID starting with 9db9dc0654ec6a680f8571ac3e54b8934d92360b29b68b3f2ad072bf9d11fcaf not found: ID does not exist" containerID="9db9dc0654ec6a680f8571ac3e54b8934d92360b29b68b3f2ad072bf9d11fcaf"
Jul 13 09:21:05.701510 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:05.701458    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9db9dc0654ec6a680f8571ac3e54b8934d92360b29b68b3f2ad072bf9d11fcaf"} err="failed to get container status \"9db9dc0654ec6a680f8571ac3e54b8934d92360b29b68b3f2ad072bf9d11fcaf\": rpc error: code = NotFound desc = could not find container \"9db9dc0654ec6a680f8571ac3e54b8934d92360b29b68b3f2ad072bf9d11fcaf\": container with ID starting with 9db9dc0654ec6a680f8571ac3e54b8934d92360b29b68b3f2ad072bf9d11fcaf not found: ID does not exist"
Jul 13 09:21:05.711069 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:05.711048    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8476d89dc8-frzdr"]
Jul 13 09:21:05.717149 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:05.717131    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8476d89dc8-frzdr"]
Jul 13 09:21:07.481043 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:07.481014    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46915e1b-9e12-4b54-a97a-b93f2179ee52" path="/var/lib/kubelet/pods/46915e1b-9e12-4b54-a97a-b93f2179ee52/volumes"
Jul 13 09:21:26.069113 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.069079    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-b9ccf5cf-v5lgg"]
Jul 13 09:21:26.069606 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.069492    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46915e1b-9e12-4b54-a97a-b93f2179ee52" containerName="manager"
Jul 13 09:21:26.069606 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.069505    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="46915e1b-9e12-4b54-a97a-b93f2179ee52" containerName="manager"
Jul 13 09:21:26.069606 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.069576    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="46915e1b-9e12-4b54-a97a-b93f2179ee52" containerName="manager"
Jul 13 09:21:26.074449 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.074425    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-v5lgg"
Jul 13 09:21:26.077996 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.077979    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 13 09:21:26.078928 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.078909    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-f8w49\""
Jul 13 09:21:26.092823 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.092802    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b9ccf5cf-v5lgg"]
Jul 13 09:21:26.225103 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.225076    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cnpg\" (UniqueName: \"kubernetes.io/projected/4525e48a-3940-4d2b-b35c-9840188bc544-kube-api-access-5cnpg\") pod \"maas-api-b9ccf5cf-v5lgg\" (UID: \"4525e48a-3940-4d2b-b35c-9840188bc544\") " pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-v5lgg"
Jul 13 09:21:26.225271 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.225117    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4525e48a-3940-4d2b-b35c-9840188bc544-openshift-service-ca\") pod \"maas-api-b9ccf5cf-v5lgg\" (UID: \"4525e48a-3940-4d2b-b35c-9840188bc544\") " pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-v5lgg"
Jul 13 09:21:26.225271 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.225221    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4525e48a-3940-4d2b-b35c-9840188bc544-maas-api-tls\") pod \"maas-api-b9ccf5cf-v5lgg\" (UID: \"4525e48a-3940-4d2b-b35c-9840188bc544\") " pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-v5lgg"
Jul 13 09:21:26.325842 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.325769    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4525e48a-3940-4d2b-b35c-9840188bc544-maas-api-tls\") pod \"maas-api-b9ccf5cf-v5lgg\" (UID: \"4525e48a-3940-4d2b-b35c-9840188bc544\") " pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-v5lgg"
Jul 13 09:21:26.325972 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.325848    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cnpg\" (UniqueName: \"kubernetes.io/projected/4525e48a-3940-4d2b-b35c-9840188bc544-kube-api-access-5cnpg\") pod \"maas-api-b9ccf5cf-v5lgg\" (UID: \"4525e48a-3940-4d2b-b35c-9840188bc544\") " pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-v5lgg"
Jul 13 09:21:26.325972 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.325889    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4525e48a-3940-4d2b-b35c-9840188bc544-openshift-service-ca\") pod \"maas-api-b9ccf5cf-v5lgg\" (UID: \"4525e48a-3940-4d2b-b35c-9840188bc544\") " pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-v5lgg"
Jul 13 09:21:26.325972 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:21:26.325923    2553 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 13 09:21:26.326079 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:21:26.325986    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4525e48a-3940-4d2b-b35c-9840188bc544-maas-api-tls podName:4525e48a-3940-4d2b-b35c-9840188bc544 nodeName:}" failed. No retries permitted until 2026-07-13 09:21:26.825966844 +0000 UTC m=+775.903844082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4525e48a-3940-4d2b-b35c-9840188bc544-maas-api-tls") pod "maas-api-b9ccf5cf-v5lgg" (UID: "4525e48a-3940-4d2b-b35c-9840188bc544") : secret "maas-api-serving-cert" not found
Jul 13 09:21:26.326452 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.326436    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4525e48a-3940-4d2b-b35c-9840188bc544-openshift-service-ca\") pod \"maas-api-b9ccf5cf-v5lgg\" (UID: \"4525e48a-3940-4d2b-b35c-9840188bc544\") " pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-v5lgg"
Jul 13 09:21:26.335651 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.335624    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cnpg\" (UniqueName: \"kubernetes.io/projected/4525e48a-3940-4d2b-b35c-9840188bc544-kube-api-access-5cnpg\") pod \"maas-api-b9ccf5cf-v5lgg\" (UID: \"4525e48a-3940-4d2b-b35c-9840188bc544\") " pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-v5lgg"
Jul 13 09:21:26.662875 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.662843    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-cvclt"]
Jul 13 09:21:26.674452 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.674424    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-cvclt"
Jul 13 09:21:26.676115 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.676073    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-cvclt"]
Jul 13 09:21:26.677372 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.677350    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-lw2cf\""
Jul 13 09:21:26.677493 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.677400    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 13 09:21:26.692388 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.692366    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-4whx5"]
Jul 13 09:21:26.694755 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.694741    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-4whx5"
Jul 13 09:21:26.709597 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.709573    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-4whx5"]
Jul 13 09:21:26.829995 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.829963    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-884md\" (UniqueName: \"kubernetes.io/projected/e44fc8bf-2e78-4fa2-a24b-180b6c802e33-kube-api-access-884md\") pod \"payload-pre-processing-7964457696-cvclt\" (UID: \"e44fc8bf-2e78-4fa2-a24b-180b6c802e33\") " pod="openshift-ingress/payload-pre-processing-7964457696-cvclt"
Jul 13 09:21:26.830167 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.830019    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4525e48a-3940-4d2b-b35c-9840188bc544-maas-api-tls\") pod \"maas-api-b9ccf5cf-v5lgg\" (UID: \"4525e48a-3940-4d2b-b35c-9840188bc544\") " pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-v5lgg"
Jul 13 09:21:26.830167 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.830050    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qd4h\" (UniqueName: \"kubernetes.io/projected/27008fcf-4b88-4933-a51a-819d575679d0-kube-api-access-7qd4h\") pod \"payload-processing-58f86c7798-4whx5\" (UID: \"27008fcf-4b88-4933-a51a-819d575679d0\") " pod="openshift-ingress/payload-processing-58f86c7798-4whx5"
Jul 13 09:21:26.830167 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.830100    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27008fcf-4b88-4933-a51a-819d575679d0-plugins-config-volume\") pod \"payload-processing-58f86c7798-4whx5\" (UID: \"27008fcf-4b88-4933-a51a-819d575679d0\") " pod="openshift-ingress/payload-processing-58f86c7798-4whx5"
Jul 13 09:21:26.830167 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.830148    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e44fc8bf-2e78-4fa2-a24b-180b6c802e33-plugins-config-volume\") pod \"payload-pre-processing-7964457696-cvclt\" (UID: \"e44fc8bf-2e78-4fa2-a24b-180b6c802e33\") " pod="openshift-ingress/payload-pre-processing-7964457696-cvclt"
Jul 13 09:21:26.832392 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.832369    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4525e48a-3940-4d2b-b35c-9840188bc544-maas-api-tls\") pod \"maas-api-b9ccf5cf-v5lgg\" (UID: \"4525e48a-3940-4d2b-b35c-9840188bc544\") " pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-v5lgg"
Jul 13 09:21:26.931520 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.931447    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-884md\" (UniqueName: \"kubernetes.io/projected/e44fc8bf-2e78-4fa2-a24b-180b6c802e33-kube-api-access-884md\") pod \"payload-pre-processing-7964457696-cvclt\" (UID: \"e44fc8bf-2e78-4fa2-a24b-180b6c802e33\") " pod="openshift-ingress/payload-pre-processing-7964457696-cvclt"
Jul 13 09:21:26.931520 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.931495    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qd4h\" (UniqueName: \"kubernetes.io/projected/27008fcf-4b88-4933-a51a-819d575679d0-kube-api-access-7qd4h\") pod \"payload-processing-58f86c7798-4whx5\" (UID: \"27008fcf-4b88-4933-a51a-819d575679d0\") " pod="openshift-ingress/payload-processing-58f86c7798-4whx5"
Jul 13 09:21:26.931520 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.931513    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27008fcf-4b88-4933-a51a-819d575679d0-plugins-config-volume\") pod \"payload-processing-58f86c7798-4whx5\" (UID: \"27008fcf-4b88-4933-a51a-819d575679d0\") " pod="openshift-ingress/payload-processing-58f86c7798-4whx5"
Jul 13 09:21:26.931749 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.931724    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e44fc8bf-2e78-4fa2-a24b-180b6c802e33-plugins-config-volume\") pod \"payload-pre-processing-7964457696-cvclt\" (UID: \"e44fc8bf-2e78-4fa2-a24b-180b6c802e33\") " pod="openshift-ingress/payload-pre-processing-7964457696-cvclt"
Jul 13 09:21:26.932227 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.932202    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27008fcf-4b88-4933-a51a-819d575679d0-plugins-config-volume\") pod \"payload-processing-58f86c7798-4whx5\" (UID: \"27008fcf-4b88-4933-a51a-819d575679d0\") " pod="openshift-ingress/payload-processing-58f86c7798-4whx5"
Jul 13 09:21:26.932383 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.932364    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e44fc8bf-2e78-4fa2-a24b-180b6c802e33-plugins-config-volume\") pod \"payload-pre-processing-7964457696-cvclt\" (UID: \"e44fc8bf-2e78-4fa2-a24b-180b6c802e33\") " pod="openshift-ingress/payload-pre-processing-7964457696-cvclt"
Jul 13 09:21:26.941347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.941320    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-884md\" (UniqueName: \"kubernetes.io/projected/e44fc8bf-2e78-4fa2-a24b-180b6c802e33-kube-api-access-884md\") pod \"payload-pre-processing-7964457696-cvclt\" (UID: \"e44fc8bf-2e78-4fa2-a24b-180b6c802e33\") " pod="openshift-ingress/payload-pre-processing-7964457696-cvclt"
Jul 13 09:21:26.941947 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.941929    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qd4h\" (UniqueName: \"kubernetes.io/projected/27008fcf-4b88-4933-a51a-819d575679d0-kube-api-access-7qd4h\") pod \"payload-processing-58f86c7798-4whx5\" (UID: \"27008fcf-4b88-4933-a51a-819d575679d0\") " pod="openshift-ingress/payload-processing-58f86c7798-4whx5"
Jul 13 09:21:26.984889 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.984867    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-v5lgg"
Jul 13 09:21:26.985934 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:26.985911    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-cvclt"
Jul 13 09:21:27.003704 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:27.003649    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-4whx5"
Jul 13 09:21:27.148591 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:27.148564    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b9ccf5cf-v5lgg"]
Jul 13 09:21:27.151241 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:21:27.151213    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4525e48a_3940_4d2b_b35c_9840188bc544.slice/crio-3af1159d66efd9fe03f34ee6c48af03d8040a2807f00ba4f8736cda49d3032ea WatchSource:0}: Error finding container 3af1159d66efd9fe03f34ee6c48af03d8040a2807f00ba4f8736cda49d3032ea: Status 404 returned error can't find the container with id 3af1159d66efd9fe03f34ee6c48af03d8040a2807f00ba4f8736cda49d3032ea
Jul 13 09:21:27.162936 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:27.162894    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-cvclt"]
Jul 13 09:21:27.166019 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:21:27.165959    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode44fc8bf_2e78_4fa2_a24b_180b6c802e33.slice/crio-56454ab59c76798bd135e782672264b72926da4efefb59a1fff64e0a7a76eef4 WatchSource:0}: Error finding container 56454ab59c76798bd135e782672264b72926da4efefb59a1fff64e0a7a76eef4: Status 404 returned error can't find the container with id 56454ab59c76798bd135e782672264b72926da4efefb59a1fff64e0a7a76eef4
Jul 13 09:21:27.193155 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:27.193132    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-4whx5"]
Jul 13 09:21:27.194418 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:21:27.194398    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27008fcf_4b88_4933_a51a_819d575679d0.slice/crio-8dd2a6472d0c522856b86b71863739d17d994b5b02e6cd3c4515b2e7f043c29d WatchSource:0}: Error finding container 8dd2a6472d0c522856b86b71863739d17d994b5b02e6cd3c4515b2e7f043c29d: Status 404 returned error can't find the container with id 8dd2a6472d0c522856b86b71863739d17d994b5b02e6cd3c4515b2e7f043c29d
Jul 13 09:21:27.809278 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:27.809242    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-cvclt" event={"ID":"e44fc8bf-2e78-4fa2-a24b-180b6c802e33","Type":"ContainerStarted","Data":"56454ab59c76798bd135e782672264b72926da4efefb59a1fff64e0a7a76eef4"}
Jul 13 09:21:27.810500 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:27.810474    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-v5lgg" event={"ID":"4525e48a-3940-4d2b-b35c-9840188bc544","Type":"ContainerStarted","Data":"3af1159d66efd9fe03f34ee6c48af03d8040a2807f00ba4f8736cda49d3032ea"}
Jul 13 09:21:27.811599 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:27.811576    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-4whx5" event={"ID":"27008fcf-4b88-4933-a51a-819d575679d0","Type":"ContainerStarted","Data":"8dd2a6472d0c522856b86b71863739d17d994b5b02e6cd3c4515b2e7f043c29d"}
Jul 13 09:21:28.817925 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:28.817888    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-4whx5" event={"ID":"27008fcf-4b88-4933-a51a-819d575679d0","Type":"ContainerStarted","Data":"4e02f5f8bbb82ebd95835f3816017152b02f2683aa28a18d98f2163225c7f055"}
Jul 13 09:21:28.818300 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:28.818032    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-4whx5"
Jul 13 09:21:28.819565 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:28.819531    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-cvclt" event={"ID":"e44fc8bf-2e78-4fa2-a24b-180b6c802e33","Type":"ContainerStarted","Data":"8f62bee759c7dc0e5f4a37a15c02ca3c10718805f50eac37939cd0c4e6097056"}
Jul 13 09:21:28.819719 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:28.819677    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-cvclt"
Jul 13 09:21:28.836674 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:28.836630    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-4whx5" podStartSLOduration=1.320557299 podStartE2EDuration="2.83661723s" totalImagesPullingTime="1.516059931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:21:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:21:28.835879914 +0000 UTC m=+777.913757171" watchObservedRunningTime="2026-07-13 09:21:28.83661723 +0000 UTC m=+777.914494485"
Jul 13 09:21:28.856427 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:28.856374    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-cvclt" podStartSLOduration=1.3149438629999999 podStartE2EDuration="2.856353532s" totalImagesPullingTime="1.541409669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:21:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:21:28.853562552 +0000 UTC m=+777.931439829" watchObservedRunningTime="2026-07-13 09:21:28.856353532 +0000 UTC m=+777.934230788"
Jul 13 09:21:29.826465 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:29.826353    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-v5lgg" event={"ID":"4525e48a-3940-4d2b-b35c-9840188bc544","Type":"ContainerStarted","Data":"f3e4e4fcd3c723fbac1903546630ef1730058567a7ec6a07bad01a21d2403eac"}
Jul 13 09:21:29.826465 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:29.826424    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-v5lgg"
Jul 13 09:21:29.848453 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:29.848409    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-v5lgg" podStartSLOduration=1.841413883 podStartE2EDuration="3.848392815s" totalImagesPullingTime="2.006978932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:21:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:21:29.847578051 +0000 UTC m=+778.925455307" watchObservedRunningTime="2026-07-13 09:21:29.848392815 +0000 UTC m=+778.926270070"
Jul 13 09:21:35.840707 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:35.840667    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-v5lgg"
Jul 13 09:21:39.828319 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:39.828288    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-4whx5"
Jul 13 09:21:39.828770 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:39.828367    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-cvclt"
Jul 13 09:21:44.751347 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:44.748354    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"]
Jul 13 09:21:44.754970 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:44.754872    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"
Jul 13 09:21:44.759624 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:44.759596    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 13 09:21:44.759624 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:44.759597    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 13 09:21:44.759860 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:44.759630    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 13 09:21:44.759860 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:44.759638    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-96d22\""
Jul 13 09:21:44.763348 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:44.763000    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"]
Jul 13 09:21:44.798094 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:44.798067    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm\" (UID: \"a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"
Jul 13 09:21:44.798233 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:44.798113    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm\" (UID: \"a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"
Jul 13 09:21:44.798233 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:44.798142    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm\" (UID: \"a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"
Jul 13 09:21:44.798233 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:44.798198    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm\" (UID: \"a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"
Jul 13 09:21:44.798233 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:44.798221    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5q2g\" (UniqueName: \"kubernetes.io/projected/a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6-kube-api-access-h5q2g\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm\" (UID: \"a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"
Jul 13 09:21:44.798399 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:44.798313    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm\" (UID: \"a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"
Jul 13 09:21:44.899758 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:44.899722    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm\" (UID: \"a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"
Jul 13 09:21:44.899758 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:44.899763    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm\" (UID: \"a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"
Jul 13 09:21:44.899962 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:44.899789    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm\" (UID: \"a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"
Jul 13 09:21:44.899962 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:44.899940    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm\" (UID: \"a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"
Jul 13 09:21:44.900064 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:44.900001    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm\" (UID: \"a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"
Jul 13 09:21:44.900064 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:44.900035    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5q2g\" (UniqueName: \"kubernetes.io/projected/a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6-kube-api-access-h5q2g\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm\" (UID: \"a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"
Jul 13 09:21:44.900195 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:44.900172    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm\" (UID: \"a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"
Jul 13 09:21:44.900440 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:44.900406    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm\" (UID: \"a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"
Jul 13 09:21:44.900578 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:44.900559    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm\" (UID: \"a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"
Jul 13 09:21:44.902124 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:44.902101    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm\" (UID: \"a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"
Jul 13 09:21:44.902595 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:44.902580    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm\" (UID: \"a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"
Jul 13 09:21:44.908514 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:44.908489    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5q2g\" (UniqueName: \"kubernetes.io/projected/a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6-kube-api-access-h5q2g\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm\" (UID: \"a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"
Jul 13 09:21:45.067267 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:45.067185    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"
Jul 13 09:21:45.200433 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:45.200407    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"]
Jul 13 09:21:45.203093 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:21:45.203066    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda428fb3d_c0d1_4bb9_ba0b_8ff9aaaf85b6.slice/crio-4fd7e22d9fe8f9927b111b83253384811550ad21dd6eacf9654938ec4937b2f5 WatchSource:0}: Error finding container 4fd7e22d9fe8f9927b111b83253384811550ad21dd6eacf9654938ec4937b2f5: Status 404 returned error can't find the container with id 4fd7e22d9fe8f9927b111b83253384811550ad21dd6eacf9654938ec4937b2f5
Jul 13 09:21:45.912302 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:45.912261    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm" event={"ID":"a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6","Type":"ContainerStarted","Data":"4fd7e22d9fe8f9927b111b83253384811550ad21dd6eacf9654938ec4937b2f5"}
Jul 13 09:21:46.919498 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:46.919459    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm" event={"ID":"a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6","Type":"ContainerStarted","Data":"5f01179dca5bc8f621703eab3e33b2cba07a212eb38cec105ef8d906f55432d1"}
Jul 13 09:21:46.939530 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:46.939481    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm" podStartSLOduration=1.814085578 podStartE2EDuration="2.939465793s" totalImagesPullingTime="1.125380215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:21:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:21:46.937214897 +0000 UTC m=+796.015092161" watchObservedRunningTime="2026-07-13 09:21:46.939465793 +0000 UTC m=+796.017343046"
Jul 13 09:21:55.067916 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:55.067833    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"
Jul 13 09:21:55.067916 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:55.067891    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"
Jul 13 09:21:55.079660 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:55.079636    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"
Jul 13 09:21:55.973042 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:21:55.973011    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm"
Jul 13 09:22:14.958138 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:14.958109    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"]
Jul 13 09:22:14.963881 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:14.963862    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"
Jul 13 09:22:14.966565 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:14.966545    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 13 09:22:14.973334 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:14.973306    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"]
Jul 13 09:22:15.061267 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:15.061241    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c53eef8-7905-4d31-aba2-e7178a9799d5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qzdmm\" (UID: \"3c53eef8-7905-4d31-aba2-e7178a9799d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"
Jul 13 09:22:15.061395 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:15.061275    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gtzr\" (UniqueName: \"kubernetes.io/projected/3c53eef8-7905-4d31-aba2-e7178a9799d5-kube-api-access-9gtzr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qzdmm\" (UID: \"3c53eef8-7905-4d31-aba2-e7178a9799d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"
Jul 13 09:22:15.061395 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:15.061299    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c53eef8-7905-4d31-aba2-e7178a9799d5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qzdmm\" (UID: \"3c53eef8-7905-4d31-aba2-e7178a9799d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"
Jul 13 09:22:15.061395 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:15.061379    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c53eef8-7905-4d31-aba2-e7178a9799d5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qzdmm\" (UID: \"3c53eef8-7905-4d31-aba2-e7178a9799d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"
Jul 13 09:22:15.061501 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:15.061396    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c53eef8-7905-4d31-aba2-e7178a9799d5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qzdmm\" (UID: \"3c53eef8-7905-4d31-aba2-e7178a9799d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"
Jul 13 09:22:15.061501 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:15.061414    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c53eef8-7905-4d31-aba2-e7178a9799d5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qzdmm\" (UID: \"3c53eef8-7905-4d31-aba2-e7178a9799d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"
Jul 13 09:22:15.162180 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:15.162146    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c53eef8-7905-4d31-aba2-e7178a9799d5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qzdmm\" (UID: \"3c53eef8-7905-4d31-aba2-e7178a9799d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"
Jul 13 09:22:15.162180 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:15.162182    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c53eef8-7905-4d31-aba2-e7178a9799d5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qzdmm\" (UID: \"3c53eef8-7905-4d31-aba2-e7178a9799d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"
Jul 13 09:22:15.162388 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:15.162203    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c53eef8-7905-4d31-aba2-e7178a9799d5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qzdmm\" (UID: \"3c53eef8-7905-4d31-aba2-e7178a9799d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"
Jul 13 09:22:15.162388 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:15.162236    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c53eef8-7905-4d31-aba2-e7178a9799d5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qzdmm\" (UID: \"3c53eef8-7905-4d31-aba2-e7178a9799d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"
Jul 13 09:22:15.162388 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:15.162270    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gtzr\" (UniqueName: \"kubernetes.io/projected/3c53eef8-7905-4d31-aba2-e7178a9799d5-kube-api-access-9gtzr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qzdmm\" (UID: \"3c53eef8-7905-4d31-aba2-e7178a9799d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"
Jul 13 09:22:15.162388 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:15.162297    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c53eef8-7905-4d31-aba2-e7178a9799d5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qzdmm\" (UID: \"3c53eef8-7905-4d31-aba2-e7178a9799d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"
Jul 13 09:22:15.162635 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:15.162601    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c53eef8-7905-4d31-aba2-e7178a9799d5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qzdmm\" (UID: \"3c53eef8-7905-4d31-aba2-e7178a9799d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"
Jul 13 09:22:15.162786 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:15.162662    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c53eef8-7905-4d31-aba2-e7178a9799d5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qzdmm\" (UID: \"3c53eef8-7905-4d31-aba2-e7178a9799d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"
Jul 13 09:22:15.162786 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:15.162721    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c53eef8-7905-4d31-aba2-e7178a9799d5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qzdmm\" (UID: \"3c53eef8-7905-4d31-aba2-e7178a9799d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"
Jul 13 09:22:15.164455 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:15.164439    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c53eef8-7905-4d31-aba2-e7178a9799d5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qzdmm\" (UID: \"3c53eef8-7905-4d31-aba2-e7178a9799d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"
Jul 13 09:22:15.164568 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:15.164550    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c53eef8-7905-4d31-aba2-e7178a9799d5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qzdmm\" (UID: \"3c53eef8-7905-4d31-aba2-e7178a9799d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"
Jul 13 09:22:15.171680 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:15.171657    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gtzr\" (UniqueName: \"kubernetes.io/projected/3c53eef8-7905-4d31-aba2-e7178a9799d5-kube-api-access-9gtzr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qzdmm\" (UID: \"3c53eef8-7905-4d31-aba2-e7178a9799d5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"
Jul 13 09:22:15.274373 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:15.274280    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"
Jul 13 09:22:15.405568 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:15.405546    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"]
Jul 13 09:22:15.407448 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:22:15.407422    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c53eef8_7905_4d31_aba2_e7178a9799d5.slice/crio-a75c994bd324e21b2fd2b3e78c4863bb76359ed453b9153e124968a4150c9a2d WatchSource:0}: Error finding container a75c994bd324e21b2fd2b3e78c4863bb76359ed453b9153e124968a4150c9a2d: Status 404 returned error can't find the container with id a75c994bd324e21b2fd2b3e78c4863bb76359ed453b9153e124968a4150c9a2d
Jul 13 09:22:16.063205 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:16.063171    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm" event={"ID":"3c53eef8-7905-4d31-aba2-e7178a9799d5","Type":"ContainerStarted","Data":"5f450bd17303c7b214c40d803aaa599da77b6eb35a47e24e7c8cc9c7c75698e3"}
Jul 13 09:22:16.063598 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:16.063221    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm" event={"ID":"3c53eef8-7905-4d31-aba2-e7178a9799d5","Type":"ContainerStarted","Data":"a75c994bd324e21b2fd2b3e78c4863bb76359ed453b9153e124968a4150c9a2d"}
Jul 13 09:22:16.082348 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:16.082299    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm" podStartSLOduration=1.911199026 podStartE2EDuration="2.082281957s" totalImagesPullingTime="171.082931ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:22:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:22:16.081186247 +0000 UTC m=+825.159063519" watchObservedRunningTime="2026-07-13 09:22:16.082281957 +0000 UTC m=+825.160159248"
Jul 13 09:22:25.275473 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:25.275438    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"
Jul 13 09:22:25.275969 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:25.275500    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"
Jul 13 09:22:25.287698 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:25.287664    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"
Jul 13 09:22:26.125460 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:22:26.125426    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qzdmm"
Jul 13 09:23:31.509390 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:23:31.509363    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tmbbk_d1243d30-2275-43cc-b5a9-a8de5a66beed/console-operator/1.log"
Jul 13 09:23:31.513593 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:23:31.513570    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tmbbk_d1243d30-2275-43cc-b5a9-a8de5a66beed/console-operator/1.log"
Jul 13 09:23:31.519448 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:23:31.519425    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t558b_db263c9c-ef1c-4e74-968b-f8822c77dffc/ovn-acl-logging/0.log"
Jul 13 09:23:31.523607 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:23:31.523530    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t558b_db263c9c-ef1c-4e74-968b-f8822c77dffc/ovn-acl-logging/0.log"
Jul 13 09:24:43.893211 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:43.893174    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f896dbf74-9fkwj"]
Jul 13 09:24:43.893776 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:43.893413    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7f896dbf74-9fkwj" podUID="beab5da2-884e-4482-a3fb-feefe18f0c8c" containerName="manager" containerID="cri-o://4b12b75845b2c115dac2115515a6e7638478d83b76c19f1cb3d462c55fba75fb" gracePeriod=30
Jul 13 09:24:44.138108 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:44.138084    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f896dbf74-9fkwj"
Jul 13 09:24:44.271991 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:44.271915    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-st4lq\" (UniqueName: \"kubernetes.io/projected/beab5da2-884e-4482-a3fb-feefe18f0c8c-kube-api-access-st4lq\") pod \"beab5da2-884e-4482-a3fb-feefe18f0c8c\" (UID: \"beab5da2-884e-4482-a3fb-feefe18f0c8c\") "
Jul 13 09:24:44.271991 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:44.271968    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/beab5da2-884e-4482-a3fb-feefe18f0c8c-webhook-cert\") pod \"beab5da2-884e-4482-a3fb-feefe18f0c8c\" (UID: \"beab5da2-884e-4482-a3fb-feefe18f0c8c\") "
Jul 13 09:24:44.273940 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:44.273904    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/beab5da2-884e-4482-a3fb-feefe18f0c8c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "beab5da2-884e-4482-a3fb-feefe18f0c8c" (UID: "beab5da2-884e-4482-a3fb-feefe18f0c8c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:24:44.274082 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:44.273994    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beab5da2-884e-4482-a3fb-feefe18f0c8c-kube-api-access-st4lq" (OuterVolumeSpecName: "kube-api-access-st4lq") pod "beab5da2-884e-4482-a3fb-feefe18f0c8c" (UID: "beab5da2-884e-4482-a3fb-feefe18f0c8c"). InnerVolumeSpecName "kube-api-access-st4lq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:24:44.373008 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:44.372976    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-st4lq\" (UniqueName: \"kubernetes.io/projected/beab5da2-884e-4482-a3fb-feefe18f0c8c-kube-api-access-st4lq\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:24:44.373008 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:44.373002    2553 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/beab5da2-884e-4482-a3fb-feefe18f0c8c-webhook-cert\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:24:44.796923 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:44.796882    2553 generic.go:356] "Generic (PLEG): container finished" podID="beab5da2-884e-4482-a3fb-feefe18f0c8c" containerID="4b12b75845b2c115dac2115515a6e7638478d83b76c19f1cb3d462c55fba75fb" exitCode=0
Jul 13 09:24:44.797098 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:44.796945    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f896dbf74-9fkwj"
Jul 13 09:24:44.797098 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:44.796949    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f896dbf74-9fkwj" event={"ID":"beab5da2-884e-4482-a3fb-feefe18f0c8c","Type":"ContainerDied","Data":"4b12b75845b2c115dac2115515a6e7638478d83b76c19f1cb3d462c55fba75fb"}
Jul 13 09:24:44.797098 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:44.797002    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f896dbf74-9fkwj" event={"ID":"beab5da2-884e-4482-a3fb-feefe18f0c8c","Type":"ContainerDied","Data":"88589a771b9c6d6691f7619b2cf1b2cd284d0c04c83c9d5e03ed1247b996fbcb"}
Jul 13 09:24:44.797098 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:44.797033    2553 scope.go:117] "RemoveContainer" containerID="4b12b75845b2c115dac2115515a6e7638478d83b76c19f1cb3d462c55fba75fb"
Jul 13 09:24:44.806607 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:44.806589    2553 scope.go:117] "RemoveContainer" containerID="4b12b75845b2c115dac2115515a6e7638478d83b76c19f1cb3d462c55fba75fb"
Jul 13 09:24:44.806888 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:24:44.806866    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b12b75845b2c115dac2115515a6e7638478d83b76c19f1cb3d462c55fba75fb\": container with ID starting with 4b12b75845b2c115dac2115515a6e7638478d83b76c19f1cb3d462c55fba75fb not found: ID does not exist" containerID="4b12b75845b2c115dac2115515a6e7638478d83b76c19f1cb3d462c55fba75fb"
Jul 13 09:24:44.806943 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:44.806897    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b12b75845b2c115dac2115515a6e7638478d83b76c19f1cb3d462c55fba75fb"} err="failed to get container status \"4b12b75845b2c115dac2115515a6e7638478d83b76c19f1cb3d462c55fba75fb\": rpc error: code = NotFound desc = could not find container \"4b12b75845b2c115dac2115515a6e7638478d83b76c19f1cb3d462c55fba75fb\": container with ID starting with 4b12b75845b2c115dac2115515a6e7638478d83b76c19f1cb3d462c55fba75fb not found: ID does not exist"
Jul 13 09:24:44.824209 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:44.824182    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f896dbf74-9fkwj"]
Jul 13 09:24:44.826963 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:44.826942    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f896dbf74-9fkwj"]
Jul 13 09:24:45.481897 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:45.481866    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="beab5da2-884e-4482-a3fb-feefe18f0c8c" path="/var/lib/kubelet/pods/beab5da2-884e-4482-a3fb-feefe18f0c8c/volumes"
Jul 13 09:24:45.689752 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:45.689709    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f896dbf74-84666"]
Jul 13 09:24:45.690205 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:45.690187    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beab5da2-884e-4482-a3fb-feefe18f0c8c" containerName="manager"
Jul 13 09:24:45.690304 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:45.690208    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="beab5da2-884e-4482-a3fb-feefe18f0c8c" containerName="manager"
Jul 13 09:24:45.690362 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:45.690352    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="beab5da2-884e-4482-a3fb-feefe18f0c8c" containerName="manager"
Jul 13 09:24:45.693281 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:45.693259    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f896dbf74-84666"
Jul 13 09:24:45.697097 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:45.697077    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 13 09:24:45.697191 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:45.697077    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 13 09:24:45.697191 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:45.697084    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-d9jl7\""
Jul 13 09:24:45.705312 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:45.705291    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f896dbf74-84666"]
Jul 13 09:24:45.785741 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:45.785631    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2874d41a-520f-44c4-80b3-2e049b5414dd-webhook-cert\") pod \"maas-controller-7f896dbf74-84666\" (UID: \"2874d41a-520f-44c4-80b3-2e049b5414dd\") " pod="opendatahub/maas-controller-7f896dbf74-84666"
Jul 13 09:24:45.785893 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:45.785768    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsghg\" (UniqueName: \"kubernetes.io/projected/2874d41a-520f-44c4-80b3-2e049b5414dd-kube-api-access-fsghg\") pod \"maas-controller-7f896dbf74-84666\" (UID: \"2874d41a-520f-44c4-80b3-2e049b5414dd\") " pod="opendatahub/maas-controller-7f896dbf74-84666"
Jul 13 09:24:45.887093 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:45.887063    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2874d41a-520f-44c4-80b3-2e049b5414dd-webhook-cert\") pod \"maas-controller-7f896dbf74-84666\" (UID: \"2874d41a-520f-44c4-80b3-2e049b5414dd\") " pod="opendatahub/maas-controller-7f896dbf74-84666"
Jul 13 09:24:45.887275 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:45.887121    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsghg\" (UniqueName: \"kubernetes.io/projected/2874d41a-520f-44c4-80b3-2e049b5414dd-kube-api-access-fsghg\") pod \"maas-controller-7f896dbf74-84666\" (UID: \"2874d41a-520f-44c4-80b3-2e049b5414dd\") " pod="opendatahub/maas-controller-7f896dbf74-84666"
Jul 13 09:24:45.889455 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:45.889437    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2874d41a-520f-44c4-80b3-2e049b5414dd-webhook-cert\") pod \"maas-controller-7f896dbf74-84666\" (UID: \"2874d41a-520f-44c4-80b3-2e049b5414dd\") " pod="opendatahub/maas-controller-7f896dbf74-84666"
Jul 13 09:24:45.896601 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:45.896573    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsghg\" (UniqueName: \"kubernetes.io/projected/2874d41a-520f-44c4-80b3-2e049b5414dd-kube-api-access-fsghg\") pod \"maas-controller-7f896dbf74-84666\" (UID: \"2874d41a-520f-44c4-80b3-2e049b5414dd\") " pod="opendatahub/maas-controller-7f896dbf74-84666"
Jul 13 09:24:46.004937 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:46.004902    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f896dbf74-84666"
Jul 13 09:24:46.140999 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:46.140973    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f896dbf74-84666"]
Jul 13 09:24:46.143467 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:24:46.143441    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2874d41a_520f_44c4_80b3_2e049b5414dd.slice/crio-fac6197456f509207725fd67913e02b288221a6c7f273b467659b74f57978406 WatchSource:0}: Error finding container fac6197456f509207725fd67913e02b288221a6c7f273b467659b74f57978406: Status 404 returned error can't find the container with id fac6197456f509207725fd67913e02b288221a6c7f273b467659b74f57978406
Jul 13 09:24:46.809608 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:46.809579    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f896dbf74-84666" event={"ID":"2874d41a-520f-44c4-80b3-2e049b5414dd","Type":"ContainerStarted","Data":"fac6197456f509207725fd67913e02b288221a6c7f273b467659b74f57978406"}
Jul 13 09:24:47.815990 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:47.815955    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f896dbf74-84666" event={"ID":"2874d41a-520f-44c4-80b3-2e049b5414dd","Type":"ContainerStarted","Data":"ff728e9513beb1f22ce527ebf18e4a74e71611e015dbe3da98d90c7a05417a2e"}
Jul 13 09:24:47.816395 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:47.816026    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f896dbf74-84666"
Jul 13 09:24:47.835543 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:47.835492    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f896dbf74-84666" podStartSLOduration=2.2272237759999998 podStartE2EDuration="2.835476269s" totalImagesPullingTime="608.252493ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:24:47.834868196 +0000 UTC m=+976.912745451" watchObservedRunningTime="2026-07-13 09:24:47.835476269 +0000 UTC m=+976.913353523"
Jul 13 09:24:58.834710 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:24:58.834624    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f896dbf74-84666"
Jul 13 09:28:31.547137 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:28:31.547110    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tmbbk_d1243d30-2275-43cc-b5a9-a8de5a66beed/console-operator/1.log"
Jul 13 09:28:31.552968 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:28:31.552947    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tmbbk_d1243d30-2275-43cc-b5a9-a8de5a66beed/console-operator/1.log"
Jul 13 09:28:31.555228 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:28:31.555207    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t558b_db263c9c-ef1c-4e74-968b-f8822c77dffc/ovn-acl-logging/0.log"
Jul 13 09:28:31.560445 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:28:31.560423    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t558b_db263c9c-ef1c-4e74-968b-f8822c77dffc/ovn-acl-logging/0.log"
Jul 13 09:33:31.580180 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:33:31.580145    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tmbbk_d1243d30-2275-43cc-b5a9-a8de5a66beed/console-operator/1.log"
Jul 13 09:33:31.586219 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:33:31.586197    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tmbbk_d1243d30-2275-43cc-b5a9-a8de5a66beed/console-operator/1.log"
Jul 13 09:33:31.587832 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:33:31.587811    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t558b_db263c9c-ef1c-4e74-968b-f8822c77dffc/ovn-acl-logging/0.log"
Jul 13 09:33:31.593887 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:33:31.593867    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t558b_db263c9c-ef1c-4e74-968b-f8822c77dffc/ovn-acl-logging/0.log"
Jul 13 09:36:38.496612 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:38.496576    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p"]
Jul 13 09:36:38.500196 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:38.500178    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p"
Jul 13 09:36:38.502680 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:38.502655    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-f09dcdea-serving-cert\""
Jul 13 09:36:38.513389 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:38.513365    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p"]
Jul 13 09:36:38.615960 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:38.615927    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgbml\" (UniqueName: \"kubernetes.io/projected/5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47-kube-api-access-jgbml\") pod \"maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p\" (UID: \"5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p"
Jul 13 09:36:38.615960 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:38.615964    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47-maas-api-tls\") pod \"maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p\" (UID: \"5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p"
Jul 13 09:36:38.616145 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:38.616015    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47-openshift-service-ca\") pod \"maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p\" (UID: \"5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p"
Jul 13 09:36:38.716767 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:38.716732    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgbml\" (UniqueName: \"kubernetes.io/projected/5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47-kube-api-access-jgbml\") pod \"maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p\" (UID: \"5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p"
Jul 13 09:36:38.716944 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:38.716777    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47-maas-api-tls\") pod \"maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p\" (UID: \"5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p"
Jul 13 09:36:38.716944 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:38.716808    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47-openshift-service-ca\") pod \"maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p\" (UID: \"5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p"
Jul 13 09:36:38.717115 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:36:38.716967    2553 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-serving-cert: secret "maas-api-e2e-ait-f09dcdea-serving-cert" not found
Jul 13 09:36:38.717115 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:36:38.717056    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47-maas-api-tls podName:5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47 nodeName:}" failed. No retries permitted until 2026-07-13 09:36:39.21703268 +0000 UTC m=+1688.294909946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47-maas-api-tls") pod "maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p" (UID: "5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47") : secret "maas-api-e2e-ait-f09dcdea-serving-cert" not found
Jul 13 09:36:38.717425 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:38.717407    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47-openshift-service-ca\") pod \"maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p\" (UID: \"5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p"
Jul 13 09:36:38.728141 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:38.728114    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgbml\" (UniqueName: \"kubernetes.io/projected/5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47-kube-api-access-jgbml\") pod \"maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p\" (UID: \"5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p"
Jul 13 09:36:39.224803 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:39.224768    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47-maas-api-tls\") pod \"maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p\" (UID: \"5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p"
Jul 13 09:36:39.227469 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:39.227438    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47-maas-api-tls\") pod \"maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p\" (UID: \"5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p"
Jul 13 09:36:39.411065 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:39.411031    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p"
Jul 13 09:36:39.558714 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:39.558674    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p"]
Jul 13 09:36:39.561175 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:36:39.561146    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ebbe3c3_5c7c_49ab_bcf0_8beae0d74b47.slice/crio-e3a6ff0154f3f50e763a02cc832fa7df59c28c960db8d7f09fa8b60a06d9fd53 WatchSource:0}: Error finding container e3a6ff0154f3f50e763a02cc832fa7df59c28c960db8d7f09fa8b60a06d9fd53: Status 404 returned error can't find the container with id e3a6ff0154f3f50e763a02cc832fa7df59c28c960db8d7f09fa8b60a06d9fd53
Jul 13 09:36:39.562672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:39.562655    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 09:36:40.360476 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:40.360436    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p" event={"ID":"5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47","Type":"ContainerStarted","Data":"189a1c685925b7987c5a0451453e2085026ac6316409e6ea2347eab5171eb57e"}
Jul 13 09:36:40.360633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:40.360495    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p" event={"ID":"5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47","Type":"ContainerStarted","Data":"e3a6ff0154f3f50e763a02cc832fa7df59c28c960db8d7f09fa8b60a06d9fd53"}
Jul 13 09:36:40.360633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:40.360546    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p"
Jul 13 09:36:40.381153 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:40.381108    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p" podStartSLOduration=1.7847014620000001 podStartE2EDuration="2.381095831s" totalImagesPullingTime="596.394369ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:36:40.379618945 +0000 UTC m=+1689.457496258" watchObservedRunningTime="2026-07-13 09:36:40.381095831 +0000 UTC m=+1689.458973086"
Jul 13 09:36:43.673737 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:43.673676    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p"]
Jul 13 09:36:43.674208 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:43.673925    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p" podUID="5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47" containerName="maas-api" containerID="cri-o://189a1c685925b7987c5a0451453e2085026ac6316409e6ea2347eab5171eb57e" gracePeriod=30
Jul 13 09:36:43.923469 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:43.923447    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p"
Jul 13 09:36:44.072504 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:44.072424    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgbml\" (UniqueName: \"kubernetes.io/projected/5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47-kube-api-access-jgbml\") pod \"5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47\" (UID: \"5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47\") "
Jul 13 09:36:44.072504 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:44.072456    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47-openshift-service-ca\") pod \"5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47\" (UID: \"5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47\") "
Jul 13 09:36:44.072504 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:44.072485    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47-maas-api-tls\") pod \"5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47\" (UID: \"5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47\") "
Jul 13 09:36:44.072873 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:44.072842    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47" (UID: "5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:36:44.072984 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:44.072907    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47-openshift-service-ca\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:36:44.074611 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:44.074587    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47" (UID: "5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:36:44.074747 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:44.074725    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47-kube-api-access-jgbml" (OuterVolumeSpecName: "kube-api-access-jgbml") pod "5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47" (UID: "5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47"). InnerVolumeSpecName "kube-api-access-jgbml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:36:44.174368 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:44.174339    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47-maas-api-tls\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:36:44.174368 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:44.174364    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgbml\" (UniqueName: \"kubernetes.io/projected/5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47-kube-api-access-jgbml\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:36:44.383917 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:44.383884    2553 generic.go:356] "Generic (PLEG): container finished" podID="5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47" containerID="189a1c685925b7987c5a0451453e2085026ac6316409e6ea2347eab5171eb57e" exitCode=0
Jul 13 09:36:44.384084 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:44.383936    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p"
Jul 13 09:36:44.384084 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:44.383970    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p" event={"ID":"5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47","Type":"ContainerDied","Data":"189a1c685925b7987c5a0451453e2085026ac6316409e6ea2347eab5171eb57e"}
Jul 13 09:36:44.384084 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:44.384027    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p" event={"ID":"5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47","Type":"ContainerDied","Data":"e3a6ff0154f3f50e763a02cc832fa7df59c28c960db8d7f09fa8b60a06d9fd53"}
Jul 13 09:36:44.384084 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:44.384056    2553 scope.go:117] "RemoveContainer" containerID="189a1c685925b7987c5a0451453e2085026ac6316409e6ea2347eab5171eb57e"
Jul 13 09:36:44.396431 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:44.396393    2553 scope.go:117] "RemoveContainer" containerID="189a1c685925b7987c5a0451453e2085026ac6316409e6ea2347eab5171eb57e"
Jul 13 09:36:44.396869 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:36:44.396850    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"189a1c685925b7987c5a0451453e2085026ac6316409e6ea2347eab5171eb57e\": container with ID starting with 189a1c685925b7987c5a0451453e2085026ac6316409e6ea2347eab5171eb57e not found: ID does not exist" containerID="189a1c685925b7987c5a0451453e2085026ac6316409e6ea2347eab5171eb57e"
Jul 13 09:36:44.396931 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:44.396878    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"189a1c685925b7987c5a0451453e2085026ac6316409e6ea2347eab5171eb57e"} err="failed to get container status \"189a1c685925b7987c5a0451453e2085026ac6316409e6ea2347eab5171eb57e\": rpc error: code = NotFound desc = could not find container \"189a1c685925b7987c5a0451453e2085026ac6316409e6ea2347eab5171eb57e\": container with ID starting with 189a1c685925b7987c5a0451453e2085026ac6316409e6ea2347eab5171eb57e not found: ID does not exist"
Jul 13 09:36:44.408868 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:44.408838    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p"]
Jul 13 09:36:44.411244 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:44.411222    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f09dcdea-67bfd4d9f6-b568p"]
Jul 13 09:36:45.481368 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:45.481340    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47" path="/var/lib/kubelet/pods/5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47/volumes"
Jul 13 09:36:51.255201 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:51.255162    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg"]
Jul 13 09:36:51.255871 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:51.255851    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47" containerName="maas-api"
Jul 13 09:36:51.255926 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:51.255875    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47" containerName="maas-api"
Jul 13 09:36:51.256015 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:51.256003    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ebbe3c3-5c7c-49ab-bcf0-8beae0d74b47" containerName="maas-api"
Jul 13 09:36:51.261181 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:51.261161    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg"
Jul 13 09:36:51.264026 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:51.264003    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-f7615a16-serving-cert\""
Jul 13 09:36:51.269773 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:51.269749    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg"]
Jul 13 09:36:51.437872 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:51.437837    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb7ab81-89cd-4883-a0c8-810976044610-openshift-service-ca\") pod \"maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg\" (UID: \"abb7ab81-89cd-4883-a0c8-810976044610\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg"
Jul 13 09:36:51.438050 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:51.437967    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abb7ab81-89cd-4883-a0c8-810976044610-maas-api-tls\") pod \"maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg\" (UID: \"abb7ab81-89cd-4883-a0c8-810976044610\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg"
Jul 13 09:36:51.438050 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:51.437994    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxb7v\" (UniqueName: \"kubernetes.io/projected/abb7ab81-89cd-4883-a0c8-810976044610-kube-api-access-qxb7v\") pod \"maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg\" (UID: \"abb7ab81-89cd-4883-a0c8-810976044610\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg"
Jul 13 09:36:51.539211 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:51.539113    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb7ab81-89cd-4883-a0c8-810976044610-openshift-service-ca\") pod \"maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg\" (UID: \"abb7ab81-89cd-4883-a0c8-810976044610\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg"
Jul 13 09:36:51.539211 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:51.539196    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abb7ab81-89cd-4883-a0c8-810976044610-maas-api-tls\") pod \"maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg\" (UID: \"abb7ab81-89cd-4883-a0c8-810976044610\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg"
Jul 13 09:36:51.539442 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:51.539217    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxb7v\" (UniqueName: \"kubernetes.io/projected/abb7ab81-89cd-4883-a0c8-810976044610-kube-api-access-qxb7v\") pod \"maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg\" (UID: \"abb7ab81-89cd-4883-a0c8-810976044610\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg"
Jul 13 09:36:51.539442 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:36:51.539364    2553 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-serving-cert: secret "maas-api-e2e-ait-f7615a16-serving-cert" not found
Jul 13 09:36:51.539547 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:36:51.539447    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abb7ab81-89cd-4883-a0c8-810976044610-maas-api-tls podName:abb7ab81-89cd-4883-a0c8-810976044610 nodeName:}" failed. No retries permitted until 2026-07-13 09:36:52.039423911 +0000 UTC m=+1701.117301158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/abb7ab81-89cd-4883-a0c8-810976044610-maas-api-tls") pod "maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg" (UID: "abb7ab81-89cd-4883-a0c8-810976044610") : secret "maas-api-e2e-ait-f7615a16-serving-cert" not found
Jul 13 09:36:51.539813 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:51.539794    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb7ab81-89cd-4883-a0c8-810976044610-openshift-service-ca\") pod \"maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg\" (UID: \"abb7ab81-89cd-4883-a0c8-810976044610\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg"
Jul 13 09:36:51.548526 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:51.548501    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxb7v\" (UniqueName: \"kubernetes.io/projected/abb7ab81-89cd-4883-a0c8-810976044610-kube-api-access-qxb7v\") pod \"maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg\" (UID: \"abb7ab81-89cd-4883-a0c8-810976044610\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg"
Jul 13 09:36:52.043802 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:52.043769    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abb7ab81-89cd-4883-a0c8-810976044610-maas-api-tls\") pod \"maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg\" (UID: \"abb7ab81-89cd-4883-a0c8-810976044610\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg"
Jul 13 09:36:52.046193 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:52.046172    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abb7ab81-89cd-4883-a0c8-810976044610-maas-api-tls\") pod \"maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg\" (UID: \"abb7ab81-89cd-4883-a0c8-810976044610\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg"
Jul 13 09:36:52.172325 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:52.172290    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg"
Jul 13 09:36:52.313005 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:52.312921    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg"]
Jul 13 09:36:52.316822 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:36:52.316793    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb7ab81_89cd_4883_a0c8_810976044610.slice/crio-38e8346b1eb1df880282b4c3e032f2fa777267371e2e6911a2d51d8001050495 WatchSource:0}: Error finding container 38e8346b1eb1df880282b4c3e032f2fa777267371e2e6911a2d51d8001050495: Status 404 returned error can't find the container with id 38e8346b1eb1df880282b4c3e032f2fa777267371e2e6911a2d51d8001050495
Jul 13 09:36:52.425358 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:52.425325    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg" event={"ID":"abb7ab81-89cd-4883-a0c8-810976044610","Type":"ContainerStarted","Data":"38e8346b1eb1df880282b4c3e032f2fa777267371e2e6911a2d51d8001050495"}
Jul 13 09:36:53.431581 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:53.431546    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg" event={"ID":"abb7ab81-89cd-4883-a0c8-810976044610","Type":"ContainerStarted","Data":"582e85a0e48133887688f4d923b39896d5c74d171e58d5329731d487a85407d0"}
Jul 13 09:36:53.431990 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:53.431628    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg"
Jul 13 09:36:53.453699 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:53.453646    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg" podStartSLOduration=1.750010138 podStartE2EDuration="2.453631378s" totalImagesPullingTime="703.62124ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:36:53.451523477 +0000 UTC m=+1702.529400731" watchObservedRunningTime="2026-07-13 09:36:53.453631378 +0000 UTC m=+1702.531508632"
Jul 13 09:36:56.487042 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:56.487011    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg"]
Jul 13 09:36:56.487407 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:56.487213    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg" podUID="abb7ab81-89cd-4883-a0c8-810976044610" containerName="maas-api" containerID="cri-o://582e85a0e48133887688f4d923b39896d5c74d171e58d5329731d487a85407d0" gracePeriod=30
Jul 13 09:36:56.745400 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:56.745342    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg"
Jul 13 09:36:56.786385 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:56.786358    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxb7v\" (UniqueName: \"kubernetes.io/projected/abb7ab81-89cd-4883-a0c8-810976044610-kube-api-access-qxb7v\") pod \"abb7ab81-89cd-4883-a0c8-810976044610\" (UID: \"abb7ab81-89cd-4883-a0c8-810976044610\") "
Jul 13 09:36:56.786506 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:56.786420    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb7ab81-89cd-4883-a0c8-810976044610-openshift-service-ca\") pod \"abb7ab81-89cd-4883-a0c8-810976044610\" (UID: \"abb7ab81-89cd-4883-a0c8-810976044610\") "
Jul 13 09:36:56.786506 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:56.786449    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abb7ab81-89cd-4883-a0c8-810976044610-maas-api-tls\") pod \"abb7ab81-89cd-4883-a0c8-810976044610\" (UID: \"abb7ab81-89cd-4883-a0c8-810976044610\") "
Jul 13 09:36:56.786812 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:56.786779    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abb7ab81-89cd-4883-a0c8-810976044610-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "abb7ab81-89cd-4883-a0c8-810976044610" (UID: "abb7ab81-89cd-4883-a0c8-810976044610"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:36:56.788960 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:56.788932    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abb7ab81-89cd-4883-a0c8-810976044610-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "abb7ab81-89cd-4883-a0c8-810976044610" (UID: "abb7ab81-89cd-4883-a0c8-810976044610"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:36:56.789046 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:56.788941    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abb7ab81-89cd-4883-a0c8-810976044610-kube-api-access-qxb7v" (OuterVolumeSpecName: "kube-api-access-qxb7v") pod "abb7ab81-89cd-4883-a0c8-810976044610" (UID: "abb7ab81-89cd-4883-a0c8-810976044610"). InnerVolumeSpecName "kube-api-access-qxb7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:36:56.887107 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:56.887078    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxb7v\" (UniqueName: \"kubernetes.io/projected/abb7ab81-89cd-4883-a0c8-810976044610-kube-api-access-qxb7v\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:36:56.887107 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:56.887102    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb7ab81-89cd-4883-a0c8-810976044610-openshift-service-ca\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:36:56.887245 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:56.887112    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abb7ab81-89cd-4883-a0c8-810976044610-maas-api-tls\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:36:57.451629 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:57.451594    2553 generic.go:356] "Generic (PLEG): container finished" podID="abb7ab81-89cd-4883-a0c8-810976044610" containerID="582e85a0e48133887688f4d923b39896d5c74d171e58d5329731d487a85407d0" exitCode=0
Jul 13 09:36:57.451834 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:57.451645    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg"
Jul 13 09:36:57.451834 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:57.451680    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg" event={"ID":"abb7ab81-89cd-4883-a0c8-810976044610","Type":"ContainerDied","Data":"582e85a0e48133887688f4d923b39896d5c74d171e58d5329731d487a85407d0"}
Jul 13 09:36:57.451834 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:57.451756    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg" event={"ID":"abb7ab81-89cd-4883-a0c8-810976044610","Type":"ContainerDied","Data":"38e8346b1eb1df880282b4c3e032f2fa777267371e2e6911a2d51d8001050495"}
Jul 13 09:36:57.451834 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:57.451770    2553 scope.go:117] "RemoveContainer" containerID="582e85a0e48133887688f4d923b39896d5c74d171e58d5329731d487a85407d0"
Jul 13 09:36:57.461225 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:57.461209    2553 scope.go:117] "RemoveContainer" containerID="582e85a0e48133887688f4d923b39896d5c74d171e58d5329731d487a85407d0"
Jul 13 09:36:57.461447 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:36:57.461431    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"582e85a0e48133887688f4d923b39896d5c74d171e58d5329731d487a85407d0\": container with ID starting with 582e85a0e48133887688f4d923b39896d5c74d171e58d5329731d487a85407d0 not found: ID does not exist" containerID="582e85a0e48133887688f4d923b39896d5c74d171e58d5329731d487a85407d0"
Jul 13 09:36:57.461492 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:57.461456    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"582e85a0e48133887688f4d923b39896d5c74d171e58d5329731d487a85407d0"} err="failed to get container status \"582e85a0e48133887688f4d923b39896d5c74d171e58d5329731d487a85407d0\": rpc error: code = NotFound desc = could not find container \"582e85a0e48133887688f4d923b39896d5c74d171e58d5329731d487a85407d0\": container with ID starting with 582e85a0e48133887688f4d923b39896d5c74d171e58d5329731d487a85407d0 not found: ID does not exist"
Jul 13 09:36:57.474600 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:57.474581    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg"]
Jul 13 09:36:57.481636 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:57.481614    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f7615a16-7b5dbdbb9f-bpbhg"]
Jul 13 09:36:59.481540 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:36:59.481508    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abb7ab81-89cd-4883-a0c8-810976044610" path="/var/lib/kubelet/pods/abb7ab81-89cd-4883-a0c8-810976044610/volumes"
Jul 13 09:37:09.583201 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:09.583168    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g"]
Jul 13 09:37:09.583676 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:09.583656    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abb7ab81-89cd-4883-a0c8-810976044610" containerName="maas-api"
Jul 13 09:37:09.583764 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:09.583680    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="abb7ab81-89cd-4883-a0c8-810976044610" containerName="maas-api"
Jul 13 09:37:09.583887 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:09.583874    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="abb7ab81-89cd-4883-a0c8-810976044610" containerName="maas-api"
Jul 13 09:37:09.587018 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:09.587002    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g"
Jul 13 09:37:09.590804 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:09.590784    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-591d4b92-serving-cert\""
Jul 13 09:37:09.605029 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:09.605007    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g"]
Jul 13 09:37:09.701912 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:09.701880    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljkhg\" (UniqueName: \"kubernetes.io/projected/1823ca9d-61b8-4003-982d-959c6822929a-kube-api-access-ljkhg\") pod \"maas-api-e2e-derive-591d4b92-fc6778787-lv87g\" (UID: \"1823ca9d-61b8-4003-982d-959c6822929a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g"
Jul 13 09:37:09.702086 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:09.702015    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1823ca9d-61b8-4003-982d-959c6822929a-maas-api-tls\") pod \"maas-api-e2e-derive-591d4b92-fc6778787-lv87g\" (UID: \"1823ca9d-61b8-4003-982d-959c6822929a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g"
Jul 13 09:37:09.702086 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:09.702076    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1823ca9d-61b8-4003-982d-959c6822929a-openshift-service-ca\") pod \"maas-api-e2e-derive-591d4b92-fc6778787-lv87g\" (UID: \"1823ca9d-61b8-4003-982d-959c6822929a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g"
Jul 13 09:37:09.802875 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:09.802842    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1823ca9d-61b8-4003-982d-959c6822929a-maas-api-tls\") pod \"maas-api-e2e-derive-591d4b92-fc6778787-lv87g\" (UID: \"1823ca9d-61b8-4003-982d-959c6822929a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g"
Jul 13 09:37:09.803068 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:09.802910    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1823ca9d-61b8-4003-982d-959c6822929a-openshift-service-ca\") pod \"maas-api-e2e-derive-591d4b92-fc6778787-lv87g\" (UID: \"1823ca9d-61b8-4003-982d-959c6822929a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g"
Jul 13 09:37:09.803068 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:09.802974    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljkhg\" (UniqueName: \"kubernetes.io/projected/1823ca9d-61b8-4003-982d-959c6822929a-kube-api-access-ljkhg\") pod \"maas-api-e2e-derive-591d4b92-fc6778787-lv87g\" (UID: \"1823ca9d-61b8-4003-982d-959c6822929a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g"
Jul 13 09:37:09.803068 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:37:09.803001    2553 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-serving-cert: secret "maas-api-e2e-derive-591d4b92-serving-cert" not found
Jul 13 09:37:09.803239 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:37:09.803078    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1823ca9d-61b8-4003-982d-959c6822929a-maas-api-tls podName:1823ca9d-61b8-4003-982d-959c6822929a nodeName:}" failed. No retries permitted until 2026-07-13 09:37:10.303056073 +0000 UTC m=+1719.380933325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1823ca9d-61b8-4003-982d-959c6822929a-maas-api-tls") pod "maas-api-e2e-derive-591d4b92-fc6778787-lv87g" (UID: "1823ca9d-61b8-4003-982d-959c6822929a") : secret "maas-api-e2e-derive-591d4b92-serving-cert" not found
Jul 13 09:37:09.803681 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:09.803657    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1823ca9d-61b8-4003-982d-959c6822929a-openshift-service-ca\") pod \"maas-api-e2e-derive-591d4b92-fc6778787-lv87g\" (UID: \"1823ca9d-61b8-4003-982d-959c6822929a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g"
Jul 13 09:37:09.813272 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:09.813250    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljkhg\" (UniqueName: \"kubernetes.io/projected/1823ca9d-61b8-4003-982d-959c6822929a-kube-api-access-ljkhg\") pod \"maas-api-e2e-derive-591d4b92-fc6778787-lv87g\" (UID: \"1823ca9d-61b8-4003-982d-959c6822929a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g"
Jul 13 09:37:10.307865 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:10.307832    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1823ca9d-61b8-4003-982d-959c6822929a-maas-api-tls\") pod \"maas-api-e2e-derive-591d4b92-fc6778787-lv87g\" (UID: \"1823ca9d-61b8-4003-982d-959c6822929a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g"
Jul 13 09:37:10.310235 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:10.310210    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1823ca9d-61b8-4003-982d-959c6822929a-maas-api-tls\") pod \"maas-api-e2e-derive-591d4b92-fc6778787-lv87g\" (UID: \"1823ca9d-61b8-4003-982d-959c6822929a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g"
Jul 13 09:37:10.498025 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:10.497991    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g"
Jul 13 09:37:10.638175 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:10.638148    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g"]
Jul 13 09:37:10.641081 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:37:10.641040    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1823ca9d_61b8_4003_982d_959c6822929a.slice/crio-1f1fcb91fa8ee79febf811a38cca084b3f5c7a25475bd7da9c5087b9908b48b3 WatchSource:0}: Error finding container 1f1fcb91fa8ee79febf811a38cca084b3f5c7a25475bd7da9c5087b9908b48b3: Status 404 returned error can't find the container with id 1f1fcb91fa8ee79febf811a38cca084b3f5c7a25475bd7da9c5087b9908b48b3
Jul 13 09:37:11.524470 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:11.524394    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g" event={"ID":"1823ca9d-61b8-4003-982d-959c6822929a","Type":"ContainerStarted","Data":"9818144a84ad4e62aaf9936c1f8aeaf1ec1a17cfc6b313a731b9a42fe0223886"}
Jul 13 09:37:11.524470 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:11.524442    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g" event={"ID":"1823ca9d-61b8-4003-982d-959c6822929a","Type":"ContainerStarted","Data":"1f1fcb91fa8ee79febf811a38cca084b3f5c7a25475bd7da9c5087b9908b48b3"}
Jul 13 09:37:11.524654 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:11.524523    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g"
Jul 13 09:37:11.544604 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:11.544560    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g" podStartSLOduration=1.935282849 podStartE2EDuration="2.54454604s" totalImagesPullingTime="609.263191ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:37:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:37:11.54340013 +0000 UTC m=+1720.621277385" watchObservedRunningTime="2026-07-13 09:37:11.54454604 +0000 UTC m=+1720.622423294"
Jul 13 09:37:14.199503 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:14.199469    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g"]
Jul 13 09:37:14.199943 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:14.199908    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g" podUID="1823ca9d-61b8-4003-982d-959c6822929a" containerName="maas-api" containerID="cri-o://9818144a84ad4e62aaf9936c1f8aeaf1ec1a17cfc6b313a731b9a42fe0223886" gracePeriod=30
Jul 13 09:37:14.446696 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:14.446668    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g"
Jul 13 09:37:14.539904 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:14.539829    2553 generic.go:356] "Generic (PLEG): container finished" podID="1823ca9d-61b8-4003-982d-959c6822929a" containerID="9818144a84ad4e62aaf9936c1f8aeaf1ec1a17cfc6b313a731b9a42fe0223886" exitCode=0
Jul 13 09:37:14.539904 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:14.539873    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g"
Jul 13 09:37:14.539904 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:14.539891    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g" event={"ID":"1823ca9d-61b8-4003-982d-959c6822929a","Type":"ContainerDied","Data":"9818144a84ad4e62aaf9936c1f8aeaf1ec1a17cfc6b313a731b9a42fe0223886"}
Jul 13 09:37:14.540142 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:14.539931    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g" event={"ID":"1823ca9d-61b8-4003-982d-959c6822929a","Type":"ContainerDied","Data":"1f1fcb91fa8ee79febf811a38cca084b3f5c7a25475bd7da9c5087b9908b48b3"}
Jul 13 09:37:14.540142 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:14.539962    2553 scope.go:117] "RemoveContainer" containerID="9818144a84ad4e62aaf9936c1f8aeaf1ec1a17cfc6b313a731b9a42fe0223886"
Jul 13 09:37:14.548244 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:14.548217    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljkhg\" (UniqueName: \"kubernetes.io/projected/1823ca9d-61b8-4003-982d-959c6822929a-kube-api-access-ljkhg\") pod \"1823ca9d-61b8-4003-982d-959c6822929a\" (UID: \"1823ca9d-61b8-4003-982d-959c6822929a\") "
Jul 13 09:37:14.548378 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:14.548251    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1823ca9d-61b8-4003-982d-959c6822929a-maas-api-tls\") pod \"1823ca9d-61b8-4003-982d-959c6822929a\" (UID: \"1823ca9d-61b8-4003-982d-959c6822929a\") "
Jul 13 09:37:14.548378 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:14.548285    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1823ca9d-61b8-4003-982d-959c6822929a-openshift-service-ca\") pod \"1823ca9d-61b8-4003-982d-959c6822929a\" (UID: \"1823ca9d-61b8-4003-982d-959c6822929a\") "
Jul 13 09:37:14.548795 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:14.548764    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1823ca9d-61b8-4003-982d-959c6822929a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1823ca9d-61b8-4003-982d-959c6822929a" (UID: "1823ca9d-61b8-4003-982d-959c6822929a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:37:14.549098 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:14.549070    2553 scope.go:117] "RemoveContainer" containerID="9818144a84ad4e62aaf9936c1f8aeaf1ec1a17cfc6b313a731b9a42fe0223886"
Jul 13 09:37:14.549346 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:37:14.549326    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9818144a84ad4e62aaf9936c1f8aeaf1ec1a17cfc6b313a731b9a42fe0223886\": container with ID starting with 9818144a84ad4e62aaf9936c1f8aeaf1ec1a17cfc6b313a731b9a42fe0223886 not found: ID does not exist" containerID="9818144a84ad4e62aaf9936c1f8aeaf1ec1a17cfc6b313a731b9a42fe0223886"
Jul 13 09:37:14.549417 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:14.549353    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9818144a84ad4e62aaf9936c1f8aeaf1ec1a17cfc6b313a731b9a42fe0223886"} err="failed to get container status \"9818144a84ad4e62aaf9936c1f8aeaf1ec1a17cfc6b313a731b9a42fe0223886\": rpc error: code = NotFound desc = could not find container \"9818144a84ad4e62aaf9936c1f8aeaf1ec1a17cfc6b313a731b9a42fe0223886\": container with ID starting with 9818144a84ad4e62aaf9936c1f8aeaf1ec1a17cfc6b313a731b9a42fe0223886 not found: ID does not exist"
Jul 13 09:37:14.550264 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:14.550244    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1823ca9d-61b8-4003-982d-959c6822929a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1823ca9d-61b8-4003-982d-959c6822929a" (UID: "1823ca9d-61b8-4003-982d-959c6822929a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:37:14.550440 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:14.550427    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1823ca9d-61b8-4003-982d-959c6822929a-kube-api-access-ljkhg" (OuterVolumeSpecName: "kube-api-access-ljkhg") pod "1823ca9d-61b8-4003-982d-959c6822929a" (UID: "1823ca9d-61b8-4003-982d-959c6822929a"). InnerVolumeSpecName "kube-api-access-ljkhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:37:14.649745 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:14.649714    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljkhg\" (UniqueName: \"kubernetes.io/projected/1823ca9d-61b8-4003-982d-959c6822929a-kube-api-access-ljkhg\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:37:14.649745 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:14.649743    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1823ca9d-61b8-4003-982d-959c6822929a-maas-api-tls\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:37:14.649885 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:14.649754    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1823ca9d-61b8-4003-982d-959c6822929a-openshift-service-ca\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:37:14.867824 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:14.867794    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g"]
Jul 13 09:37:14.872663 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:14.872634    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-591d4b92-fc6778787-lv87g"]
Jul 13 09:37:15.483008 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:37:15.482972    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1823ca9d-61b8-4003-982d-959c6822929a" path="/var/lib/kubelet/pods/1823ca9d-61b8-4003-982d-959c6822929a/volumes"
Jul 13 09:38:31.613570 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:38:31.613533    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tmbbk_d1243d30-2275-43cc-b5a9-a8de5a66beed/console-operator/1.log"
Jul 13 09:38:31.621403 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:38:31.621369    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tmbbk_d1243d30-2275-43cc-b5a9-a8de5a66beed/console-operator/1.log"
Jul 13 09:38:31.621842 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:38:31.621824    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t558b_db263c9c-ef1c-4e74-968b-f8822c77dffc/ovn-acl-logging/0.log"
Jul 13 09:38:31.628984 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:38:31.628968    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t558b_db263c9c-ef1c-4e74-968b-f8822c77dffc/ovn-acl-logging/0.log"
Jul 13 09:39:00.195404 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:00.195372    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j"]
Jul 13 09:39:00.195968 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:00.195822    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1823ca9d-61b8-4003-982d-959c6822929a" containerName="maas-api"
Jul 13 09:39:00.195968 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:00.195834    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1823ca9d-61b8-4003-982d-959c6822929a" containerName="maas-api"
Jul 13 09:39:00.195968 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:00.195912    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="1823ca9d-61b8-4003-982d-959c6822929a" containerName="maas-api"
Jul 13 09:39:00.199079 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:00.199059    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j"
Jul 13 09:39:00.202519 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:00.202499    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-9e060cc5-serving-cert\""
Jul 13 09:39:00.212102 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:00.212080    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j"]
Jul 13 09:39:00.253436 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:00.253410    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cbm8\" (UniqueName: \"kubernetes.io/projected/ba59b8db-fa20-45c6-8efb-6d33b51b57e7-kube-api-access-9cbm8\") pod \"maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j\" (UID: \"ba59b8db-fa20-45c6-8efb-6d33b51b57e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j"
Jul 13 09:39:00.253568 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:00.253453    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba59b8db-fa20-45c6-8efb-6d33b51b57e7-maas-api-tls\") pod \"maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j\" (UID: \"ba59b8db-fa20-45c6-8efb-6d33b51b57e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j"
Jul 13 09:39:00.253568 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:00.253478    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba59b8db-fa20-45c6-8efb-6d33b51b57e7-openshift-service-ca\") pod \"maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j\" (UID: \"ba59b8db-fa20-45c6-8efb-6d33b51b57e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j"
Jul 13 09:39:00.354062 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:00.354035    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba59b8db-fa20-45c6-8efb-6d33b51b57e7-openshift-service-ca\") pod \"maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j\" (UID: \"ba59b8db-fa20-45c6-8efb-6d33b51b57e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j"
Jul 13 09:39:00.354232 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:00.354119    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cbm8\" (UniqueName: \"kubernetes.io/projected/ba59b8db-fa20-45c6-8efb-6d33b51b57e7-kube-api-access-9cbm8\") pod \"maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j\" (UID: \"ba59b8db-fa20-45c6-8efb-6d33b51b57e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j"
Jul 13 09:39:00.354232 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:00.354160    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba59b8db-fa20-45c6-8efb-6d33b51b57e7-maas-api-tls\") pod \"maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j\" (UID: \"ba59b8db-fa20-45c6-8efb-6d33b51b57e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j"
Jul 13 09:39:00.354363 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:39:00.354251    2553 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-serving-cert: secret "maas-api-e2e-mt-9e060cc5-serving-cert" not found
Jul 13 09:39:00.354363 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:39:00.354302    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba59b8db-fa20-45c6-8efb-6d33b51b57e7-maas-api-tls podName:ba59b8db-fa20-45c6-8efb-6d33b51b57e7 nodeName:}" failed. No retries permitted until 2026-07-13 09:39:00.854287345 +0000 UTC m=+1829.932164577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ba59b8db-fa20-45c6-8efb-6d33b51b57e7-maas-api-tls") pod "maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j" (UID: "ba59b8db-fa20-45c6-8efb-6d33b51b57e7") : secret "maas-api-e2e-mt-9e060cc5-serving-cert" not found
Jul 13 09:39:00.354815 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:00.354793    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba59b8db-fa20-45c6-8efb-6d33b51b57e7-openshift-service-ca\") pod \"maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j\" (UID: \"ba59b8db-fa20-45c6-8efb-6d33b51b57e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j"
Jul 13 09:39:00.365324 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:00.365301    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cbm8\" (UniqueName: \"kubernetes.io/projected/ba59b8db-fa20-45c6-8efb-6d33b51b57e7-kube-api-access-9cbm8\") pod \"maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j\" (UID: \"ba59b8db-fa20-45c6-8efb-6d33b51b57e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j"
Jul 13 09:39:00.859101 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:00.859069    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba59b8db-fa20-45c6-8efb-6d33b51b57e7-maas-api-tls\") pod \"maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j\" (UID: \"ba59b8db-fa20-45c6-8efb-6d33b51b57e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j"
Jul 13 09:39:00.861389 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:00.861361    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba59b8db-fa20-45c6-8efb-6d33b51b57e7-maas-api-tls\") pod \"maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j\" (UID: \"ba59b8db-fa20-45c6-8efb-6d33b51b57e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j"
Jul 13 09:39:01.111199 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:01.111121    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j"
Jul 13 09:39:01.250497 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:01.249997    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j"]
Jul 13 09:39:01.258614 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:39:01.258588    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba59b8db_fa20_45c6_8efb_6d33b51b57e7.slice/crio-bda9f15dbfa4c5860271e4dc74bbd4de99f749452f3a0470e7e48ebe76371403 WatchSource:0}: Error finding container bda9f15dbfa4c5860271e4dc74bbd4de99f749452f3a0470e7e48ebe76371403: Status 404 returned error can't find the container with id bda9f15dbfa4c5860271e4dc74bbd4de99f749452f3a0470e7e48ebe76371403
Jul 13 09:39:02.086638 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:02.086551    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j" event={"ID":"ba59b8db-fa20-45c6-8efb-6d33b51b57e7","Type":"ContainerStarted","Data":"63f715298ee8dbd5738b75427eec319e547c6bc9864ddbf069ea4e0c79351a38"}
Jul 13 09:39:02.086638 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:02.086616    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j" event={"ID":"ba59b8db-fa20-45c6-8efb-6d33b51b57e7","Type":"ContainerStarted","Data":"bda9f15dbfa4c5860271e4dc74bbd4de99f749452f3a0470e7e48ebe76371403"}
Jul 13 09:39:02.086859 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:02.086747    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j"
Jul 13 09:39:02.105197 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:02.105153    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j" podStartSLOduration=1.710768431 podStartE2EDuration="2.105138428s" totalImagesPullingTime="394.369997ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:39:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:39:02.102898712 +0000 UTC m=+1831.180775999" watchObservedRunningTime="2026-07-13 09:39:02.105138428 +0000 UTC m=+1831.183015683"
Jul 13 09:39:08.097273 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:08.097242    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j"
Jul 13 09:39:12.380076 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:12.380038    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j"]
Jul 13 09:39:12.380573 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:12.380277    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j" podUID="ba59b8db-fa20-45c6-8efb-6d33b51b57e7" containerName="maas-api" containerID="cri-o://63f715298ee8dbd5738b75427eec319e547c6bc9864ddbf069ea4e0c79351a38" gracePeriod=30
Jul 13 09:39:12.628019 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:12.627990    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j"
Jul 13 09:39:12.768155 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:12.768040    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba59b8db-fa20-45c6-8efb-6d33b51b57e7-maas-api-tls\") pod \"ba59b8db-fa20-45c6-8efb-6d33b51b57e7\" (UID: \"ba59b8db-fa20-45c6-8efb-6d33b51b57e7\") "
Jul 13 09:39:12.768155 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:12.768114    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cbm8\" (UniqueName: \"kubernetes.io/projected/ba59b8db-fa20-45c6-8efb-6d33b51b57e7-kube-api-access-9cbm8\") pod \"ba59b8db-fa20-45c6-8efb-6d33b51b57e7\" (UID: \"ba59b8db-fa20-45c6-8efb-6d33b51b57e7\") "
Jul 13 09:39:12.768155 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:12.768136    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba59b8db-fa20-45c6-8efb-6d33b51b57e7-openshift-service-ca\") pod \"ba59b8db-fa20-45c6-8efb-6d33b51b57e7\" (UID: \"ba59b8db-fa20-45c6-8efb-6d33b51b57e7\") "
Jul 13 09:39:12.768575 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:12.768539    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba59b8db-fa20-45c6-8efb-6d33b51b57e7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ba59b8db-fa20-45c6-8efb-6d33b51b57e7" (UID: "ba59b8db-fa20-45c6-8efb-6d33b51b57e7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:39:12.770307 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:12.770280    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba59b8db-fa20-45c6-8efb-6d33b51b57e7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ba59b8db-fa20-45c6-8efb-6d33b51b57e7" (UID: "ba59b8db-fa20-45c6-8efb-6d33b51b57e7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:39:12.770419 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:12.770315    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba59b8db-fa20-45c6-8efb-6d33b51b57e7-kube-api-access-9cbm8" (OuterVolumeSpecName: "kube-api-access-9cbm8") pod "ba59b8db-fa20-45c6-8efb-6d33b51b57e7" (UID: "ba59b8db-fa20-45c6-8efb-6d33b51b57e7"). InnerVolumeSpecName "kube-api-access-9cbm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:39:12.869676 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:12.869625    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cbm8\" (UniqueName: \"kubernetes.io/projected/ba59b8db-fa20-45c6-8efb-6d33b51b57e7-kube-api-access-9cbm8\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:39:12.869676 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:12.869669    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba59b8db-fa20-45c6-8efb-6d33b51b57e7-openshift-service-ca\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:39:12.869676 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:12.869680    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba59b8db-fa20-45c6-8efb-6d33b51b57e7-maas-api-tls\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:39:13.141701 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:13.141650    2553 generic.go:356] "Generic (PLEG): container finished" podID="ba59b8db-fa20-45c6-8efb-6d33b51b57e7" containerID="63f715298ee8dbd5738b75427eec319e547c6bc9864ddbf069ea4e0c79351a38" exitCode=0
Jul 13 09:39:13.141881 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:13.141733    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j" event={"ID":"ba59b8db-fa20-45c6-8efb-6d33b51b57e7","Type":"ContainerDied","Data":"63f715298ee8dbd5738b75427eec319e547c6bc9864ddbf069ea4e0c79351a38"}
Jul 13 09:39:13.141881 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:13.141816    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j" event={"ID":"ba59b8db-fa20-45c6-8efb-6d33b51b57e7","Type":"ContainerDied","Data":"bda9f15dbfa4c5860271e4dc74bbd4de99f749452f3a0470e7e48ebe76371403"}
Jul 13 09:39:13.141881 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:13.141749    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j"
Jul 13 09:39:13.141881 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:13.141839    2553 scope.go:117] "RemoveContainer" containerID="63f715298ee8dbd5738b75427eec319e547c6bc9864ddbf069ea4e0c79351a38"
Jul 13 09:39:13.150973 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:13.150950    2553 scope.go:117] "RemoveContainer" containerID="63f715298ee8dbd5738b75427eec319e547c6bc9864ddbf069ea4e0c79351a38"
Jul 13 09:39:13.151252 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:39:13.151233    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63f715298ee8dbd5738b75427eec319e547c6bc9864ddbf069ea4e0c79351a38\": container with ID starting with 63f715298ee8dbd5738b75427eec319e547c6bc9864ddbf069ea4e0c79351a38 not found: ID does not exist" containerID="63f715298ee8dbd5738b75427eec319e547c6bc9864ddbf069ea4e0c79351a38"
Jul 13 09:39:13.151296 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:13.151262    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63f715298ee8dbd5738b75427eec319e547c6bc9864ddbf069ea4e0c79351a38"} err="failed to get container status \"63f715298ee8dbd5738b75427eec319e547c6bc9864ddbf069ea4e0c79351a38\": rpc error: code = NotFound desc = could not find container \"63f715298ee8dbd5738b75427eec319e547c6bc9864ddbf069ea4e0c79351a38\": container with ID starting with 63f715298ee8dbd5738b75427eec319e547c6bc9864ddbf069ea4e0c79351a38 not found: ID does not exist"
Jul 13 09:39:13.163516 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:13.163485    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j"]
Jul 13 09:39:13.168105 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:13.168079    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9e060cc5-7855b974fb-4wz4j"]
Jul 13 09:39:13.481671 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:13.481594    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba59b8db-fa20-45c6-8efb-6d33b51b57e7" path="/var/lib/kubelet/pods/ba59b8db-fa20-45c6-8efb-6d33b51b57e7/volumes"
Jul 13 09:39:41.235199 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:41.235169    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6"]
Jul 13 09:39:41.235704 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:41.235594    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba59b8db-fa20-45c6-8efb-6d33b51b57e7" containerName="maas-api"
Jul 13 09:39:41.235704 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:41.235605    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba59b8db-fa20-45c6-8efb-6d33b51b57e7" containerName="maas-api"
Jul 13 09:39:41.235704 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:41.235674    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba59b8db-fa20-45c6-8efb-6d33b51b57e7" containerName="maas-api"
Jul 13 09:39:41.238775 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:41.238755    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6"
Jul 13 09:39:41.241317 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:41.241299    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-7694df9c-serving-cert\""
Jul 13 09:39:41.249218 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:41.249197    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6"]
Jul 13 09:39:41.334717 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:41.334672    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a-maas-api-tls\") pod \"maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6\" (UID: \"6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6"
Jul 13 09:39:41.334891 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:41.334728    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knq4d\" (UniqueName: \"kubernetes.io/projected/6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a-kube-api-access-knq4d\") pod \"maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6\" (UID: \"6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6"
Jul 13 09:39:41.334891 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:41.334788    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a-openshift-service-ca\") pod \"maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6\" (UID: \"6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6"
Jul 13 09:39:41.435460 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:41.435420    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a-maas-api-tls\") pod \"maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6\" (UID: \"6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6"
Jul 13 09:39:41.435627 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:41.435470    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knq4d\" (UniqueName: \"kubernetes.io/projected/6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a-kube-api-access-knq4d\") pod \"maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6\" (UID: \"6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6"
Jul 13 09:39:41.435627 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:41.435533    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a-openshift-service-ca\") pod \"maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6\" (UID: \"6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6"
Jul 13 09:39:41.436193 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:41.436173    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a-openshift-service-ca\") pod \"maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6\" (UID: \"6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6"
Jul 13 09:39:41.437800 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:41.437783    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a-maas-api-tls\") pod \"maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6\" (UID: \"6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6"
Jul 13 09:39:41.444383 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:41.444358    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knq4d\" (UniqueName: \"kubernetes.io/projected/6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a-kube-api-access-knq4d\") pod \"maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6\" (UID: \"6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6"
Jul 13 09:39:41.550714 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:41.550617    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6"
Jul 13 09:39:41.692623 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:41.692549    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6"]
Jul 13 09:39:41.694912 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:39:41.694882    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d1eaa31_1ea9_4bdb_a5f4_94954bb7282a.slice/crio-86e77155cbaf8fe4642c07a540855b2cf4f9a2fa4655cc8f960b8a66d4a57e77 WatchSource:0}: Error finding container 86e77155cbaf8fe4642c07a540855b2cf4f9a2fa4655cc8f960b8a66d4a57e77: Status 404 returned error can't find the container with id 86e77155cbaf8fe4642c07a540855b2cf4f9a2fa4655cc8f960b8a66d4a57e77
Jul 13 09:39:42.301390 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:42.301361    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6" event={"ID":"6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a","Type":"ContainerStarted","Data":"e5a6848a5d5dfa562a017dd413f5601e58b5b55122b61aa5416c7d09820ec2a4"}
Jul 13 09:39:42.301824 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:42.301412    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6" event={"ID":"6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a","Type":"ContainerStarted","Data":"86e77155cbaf8fe4642c07a540855b2cf4f9a2fa4655cc8f960b8a66d4a57e77"}
Jul 13 09:39:42.301824 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:42.301456    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6"
Jul 13 09:39:42.321530 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:42.321486    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6" podStartSLOduration=0.817458688 podStartE2EDuration="1.321470067s" totalImagesPullingTime="504.011379ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:39:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:39:42.319311126 +0000 UTC m=+1871.397188408" watchObservedRunningTime="2026-07-13 09:39:42.321470067 +0000 UTC m=+1871.399347323"
Jul 13 09:39:48.313281 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:48.313247    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6"
Jul 13 09:39:51.852385 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:51.852349    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"]
Jul 13 09:39:51.856918 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:51.856895    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:39:51.860897 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:51.860873    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-7694df9c\"/\"kube-root-ca.crt\""
Jul 13 09:39:51.860897 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:51.860885    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-7694df9c\"/\"default-dockercfg-hqclj\""
Jul 13 09:39:51.860897 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:51.860875    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-7694df9c\"/\"e2e-lifecycle-model-7694df9c-kserve-self-signed-certs\""
Jul 13 09:39:51.861151 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:51.860893    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-7694df9c\"/\"openshift-service-ca.crt\""
Jul 13 09:39:51.869266 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:51.869238    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"]
Jul 13 09:39:51.938033 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:51.938002    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97skp\" (UniqueName: \"kubernetes.io/projected/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-kube-api-access-97skp\") pod \"e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv\" (UID: \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\") " pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:39:51.938217 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:51.938058    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-tls-certs\") pod \"e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv\" (UID: \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\") " pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:39:51.938217 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:51.938119    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-dshm\") pod \"e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv\" (UID: \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\") " pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:39:51.938217 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:51.938194    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-home\") pod \"e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv\" (UID: \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\") " pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:39:51.938343 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:51.938242    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-tmp-dir\") pod \"e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv\" (UID: \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\") " pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:39:51.938343 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:51.938263    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-model-cache\") pod \"e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv\" (UID: \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\") " pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:39:52.039483 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:52.039447    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-home\") pod \"e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv\" (UID: \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\") " pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:39:52.039663 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:52.039496    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-tmp-dir\") pod \"e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv\" (UID: \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\") " pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:39:52.039663 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:52.039515    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-model-cache\") pod \"e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv\" (UID: \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\") " pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:39:52.039663 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:52.039559    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97skp\" (UniqueName: \"kubernetes.io/projected/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-kube-api-access-97skp\") pod \"e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv\" (UID: \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\") " pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:39:52.039663 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:52.039609    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-tls-certs\") pod \"e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv\" (UID: \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\") " pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:39:52.039663 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:52.039641    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-dshm\") pod \"e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv\" (UID: \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\") " pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:39:52.039959 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:52.039934    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-home\") pod \"e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv\" (UID: \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\") " pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:39:52.040007 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:52.039967    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-tmp-dir\") pod \"e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv\" (UID: \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\") " pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:39:52.040007 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:52.039996    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-model-cache\") pod \"e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv\" (UID: \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\") " pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:39:52.041863 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:52.041837    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-dshm\") pod \"e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv\" (UID: \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\") " pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:39:52.042172 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:52.042154    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-tls-certs\") pod \"e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv\" (UID: \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\") " pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:39:52.048410 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:52.048391    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97skp\" (UniqueName: \"kubernetes.io/projected/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-kube-api-access-97skp\") pod \"e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv\" (UID: \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\") " pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:39:52.196697 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:52.196639    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:39:52.332798 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:52.332768    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"]
Jul 13 09:39:52.335548 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:39:52.335514    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6e43ce1_049a_4ba0_aa03_5a6166d8cb9d.slice/crio-a56ec5f9e763dc5a1efde0811fae4f3b29aa9a05c188044494a232f9ea14fab3 WatchSource:0}: Error finding container a56ec5f9e763dc5a1efde0811fae4f3b29aa9a05c188044494a232f9ea14fab3: Status 404 returned error can't find the container with id a56ec5f9e763dc5a1efde0811fae4f3b29aa9a05c188044494a232f9ea14fab3
Jul 13 09:39:52.350739 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:52.350705    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv" event={"ID":"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d","Type":"ContainerStarted","Data":"a56ec5f9e763dc5a1efde0811fae4f3b29aa9a05c188044494a232f9ea14fab3"}
Jul 13 09:39:53.357442 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:53.357356    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv" event={"ID":"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d","Type":"ContainerStarted","Data":"abdb8a6b8fee43d4495149877767718e7cbb3414783d0bd6e6cbe83924d06d65"}
Jul 13 09:39:53.375006 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:39:53.374958    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv" podStartSLOduration=2.374936881 podStartE2EDuration="2.374936881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:39:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:39:53.374888989 +0000 UTC m=+1882.452766247" watchObservedRunningTime="2026-07-13 09:39:53.374936881 +0000 UTC m=+1882.452814137"
Jul 13 09:40:02.197828 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:02.197770    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:40:02.197828 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:02.197840    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:40:02.210481 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:02.210451    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:40:02.413592 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:02.413565    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:40:18.879551 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:18.879519    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6"]
Jul 13 09:40:18.880120 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:18.879790    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6" podUID="6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a" containerName="maas-api" containerID="cri-o://e5a6848a5d5dfa562a017dd413f5601e58b5b55122b61aa5416c7d09820ec2a4" gracePeriod=30
Jul 13 09:40:19.138306 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:19.138240    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6"
Jul 13 09:40:19.199641 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:19.199614    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a-maas-api-tls\") pod \"6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a\" (UID: \"6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a\") "
Jul 13 09:40:19.199824 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:19.199670    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knq4d\" (UniqueName: \"kubernetes.io/projected/6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a-kube-api-access-knq4d\") pod \"6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a\" (UID: \"6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a\") "
Jul 13 09:40:19.199824 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:19.199774    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a-openshift-service-ca\") pod \"6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a\" (UID: \"6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a\") "
Jul 13 09:40:19.200079 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:19.200057    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a" (UID: "6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:40:19.201797 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:19.201775    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a" (UID: "6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:40:19.201936 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:19.201913    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a-kube-api-access-knq4d" (OuterVolumeSpecName: "kube-api-access-knq4d") pod "6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a" (UID: "6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a"). InnerVolumeSpecName "kube-api-access-knq4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:40:19.301196 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:19.301168    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a-openshift-service-ca\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:40:19.301196 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:19.301189    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a-maas-api-tls\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:40:19.301196 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:19.301198    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knq4d\" (UniqueName: \"kubernetes.io/projected/6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a-kube-api-access-knq4d\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:40:19.486808 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:19.486726    2553 generic.go:356] "Generic (PLEG): container finished" podID="6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a" containerID="e5a6848a5d5dfa562a017dd413f5601e58b5b55122b61aa5416c7d09820ec2a4" exitCode=0
Jul 13 09:40:19.486808 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:19.486778    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6" event={"ID":"6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a","Type":"ContainerDied","Data":"e5a6848a5d5dfa562a017dd413f5601e58b5b55122b61aa5416c7d09820ec2a4"}
Jul 13 09:40:19.486808 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:19.486781    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6"
Jul 13 09:40:19.487027 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:19.486819    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6" event={"ID":"6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a","Type":"ContainerDied","Data":"86e77155cbaf8fe4642c07a540855b2cf4f9a2fa4655cc8f960b8a66d4a57e77"}
Jul 13 09:40:19.487027 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:19.486843    2553 scope.go:117] "RemoveContainer" containerID="e5a6848a5d5dfa562a017dd413f5601e58b5b55122b61aa5416c7d09820ec2a4"
Jul 13 09:40:19.496752 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:19.496732    2553 scope.go:117] "RemoveContainer" containerID="e5a6848a5d5dfa562a017dd413f5601e58b5b55122b61aa5416c7d09820ec2a4"
Jul 13 09:40:19.497034 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:40:19.497014    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5a6848a5d5dfa562a017dd413f5601e58b5b55122b61aa5416c7d09820ec2a4\": container with ID starting with e5a6848a5d5dfa562a017dd413f5601e58b5b55122b61aa5416c7d09820ec2a4 not found: ID does not exist" containerID="e5a6848a5d5dfa562a017dd413f5601e58b5b55122b61aa5416c7d09820ec2a4"
Jul 13 09:40:19.497105 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:19.497042    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5a6848a5d5dfa562a017dd413f5601e58b5b55122b61aa5416c7d09820ec2a4"} err="failed to get container status \"e5a6848a5d5dfa562a017dd413f5601e58b5b55122b61aa5416c7d09820ec2a4\": rpc error: code = NotFound desc = could not find container \"e5a6848a5d5dfa562a017dd413f5601e58b5b55122b61aa5416c7d09820ec2a4\": container with ID starting with e5a6848a5d5dfa562a017dd413f5601e58b5b55122b61aa5416c7d09820ec2a4 not found: ID does not exist"
Jul 13 09:40:19.508788 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:19.508765    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6"]
Jul 13 09:40:19.514799 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:19.514777    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7694df9c-74bcdbdffc-xrxx6"]
Jul 13 09:40:21.481515 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:21.481480    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a" path="/var/lib/kubelet/pods/6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a/volumes"
Jul 13 09:40:29.484906 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:29.484880    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"]
Jul 13 09:40:44.508238 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:44.508176    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv" podUID="a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d" containerName="main" containerID="cri-o://abdb8a6b8fee43d4495149877767718e7cbb3414783d0bd6e6cbe83924d06d65" gracePeriod=45
Jul 13 09:40:44.765815 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:44.765755    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:40:44.945807 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:44.945769    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-dshm\") pod \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\" (UID: \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\") "
Jul 13 09:40:44.946008 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:44.945830    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97skp\" (UniqueName: \"kubernetes.io/projected/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-kube-api-access-97skp\") pod \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\" (UID: \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\") "
Jul 13 09:40:44.946008 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:44.945867    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-tmp-dir\") pod \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\" (UID: \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\") "
Jul 13 09:40:44.946008 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:44.945901    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-tls-certs\") pod \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\" (UID: \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\") "
Jul 13 09:40:44.946008 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:44.945937    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-model-cache\") pod \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\" (UID: \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\") "
Jul 13 09:40:44.946008 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:44.946005    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-home\") pod \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\" (UID: \"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d\") "
Jul 13 09:40:44.946299 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:44.946182    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d" (UID: "a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 09:40:44.946299 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:44.946216    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-model-cache" (OuterVolumeSpecName: "model-cache") pod "a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d" (UID: "a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 09:40:44.946398 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:44.946296    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-home" (OuterVolumeSpecName: "home") pod "a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d" (UID: "a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 09:40:44.946450 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:44.946431    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-home\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:40:44.946487 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:44.946452    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-tmp-dir\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:40:44.946487 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:44.946467    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-model-cache\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:40:44.948204 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:44.948179    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-dshm" (OuterVolumeSpecName: "dshm") pod "a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d" (UID: "a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 09:40:44.948204 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:44.948187    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-kube-api-access-97skp" (OuterVolumeSpecName: "kube-api-access-97skp") pod "a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d" (UID: "a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d"). InnerVolumeSpecName "kube-api-access-97skp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:40:44.948308 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:44.948246    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d" (UID: "a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:40:45.047925 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:45.047827    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-dshm\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:40:45.047925 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:45.047873    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97skp\" (UniqueName: \"kubernetes.io/projected/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-kube-api-access-97skp\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:40:45.047925 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:45.047886    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d-tls-certs\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:40:45.613125 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:45.613086    2553 generic.go:356] "Generic (PLEG): container finished" podID="a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d" containerID="abdb8a6b8fee43d4495149877767718e7cbb3414783d0bd6e6cbe83924d06d65" exitCode=0
Jul 13 09:40:45.613538 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:45.613133    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"
Jul 13 09:40:45.613538 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:45.613176    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv" event={"ID":"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d","Type":"ContainerDied","Data":"abdb8a6b8fee43d4495149877767718e7cbb3414783d0bd6e6cbe83924d06d65"}
Jul 13 09:40:45.613538 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:45.613223    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv" event={"ID":"a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d","Type":"ContainerDied","Data":"a56ec5f9e763dc5a1efde0811fae4f3b29aa9a05c188044494a232f9ea14fab3"}
Jul 13 09:40:45.613538 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:45.613239    2553 scope.go:117] "RemoveContainer" containerID="abdb8a6b8fee43d4495149877767718e7cbb3414783d0bd6e6cbe83924d06d65"
Jul 13 09:40:45.622018 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:45.621995    2553 scope.go:117] "RemoveContainer" containerID="abdb8a6b8fee43d4495149877767718e7cbb3414783d0bd6e6cbe83924d06d65"
Jul 13 09:40:45.622293 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:40:45.622274    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abdb8a6b8fee43d4495149877767718e7cbb3414783d0bd6e6cbe83924d06d65\": container with ID starting with abdb8a6b8fee43d4495149877767718e7cbb3414783d0bd6e6cbe83924d06d65 not found: ID does not exist" containerID="abdb8a6b8fee43d4495149877767718e7cbb3414783d0bd6e6cbe83924d06d65"
Jul 13 09:40:45.622360 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:45.622303    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abdb8a6b8fee43d4495149877767718e7cbb3414783d0bd6e6cbe83924d06d65"} err="failed to get container status \"abdb8a6b8fee43d4495149877767718e7cbb3414783d0bd6e6cbe83924d06d65\": rpc error: code = NotFound desc = could not find container \"abdb8a6b8fee43d4495149877767718e7cbb3414783d0bd6e6cbe83924d06d65\": container with ID starting with abdb8a6b8fee43d4495149877767718e7cbb3414783d0bd6e6cbe83924d06d65 not found: ID does not exist"
Jul 13 09:40:45.630446 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:45.630419    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"]
Jul 13 09:40:45.634840 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:45.634816    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-7694df9c/e2e-lifecycle-model-7694df9c-kserve-5987f87799-qb7wv"]
Jul 13 09:40:47.482838 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:40:47.482803    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d" path="/var/lib/kubelet/pods/a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d/volumes"
Jul 13 09:42:16.295551 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:16.295516    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg"]
Jul 13 09:42:16.296055 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:16.295942    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a" containerName="maas-api"
Jul 13 09:42:16.296055 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:16.295955    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a" containerName="maas-api"
Jul 13 09:42:16.296055 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:16.295973    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d" containerName="main"
Jul 13 09:42:16.296055 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:16.295979    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d" containerName="main"
Jul 13 09:42:16.296055 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:16.296036    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d1eaa31-1ea9-4bdb-a5f4-94954bb7282a" containerName="maas-api"
Jul 13 09:42:16.296055 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:16.296047    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6e43ce1-049a-4ba0-aa03-5a6166d8cb9d" containerName="main"
Jul 13 09:42:16.299190 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:16.299171    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg"
Jul 13 09:42:16.301884 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:16.301858    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-c47dc5-serving-cert\""
Jul 13 09:42:16.309067 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:16.309038    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg"]
Jul 13 09:42:16.393112 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:16.393080    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f38d199-1487-4530-8848-670ecd96c1c7-maas-api-tls\") pod \"maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg\" (UID: \"3f38d199-1487-4530-8848-670ecd96c1c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg"
Jul 13 09:42:16.393289 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:16.393205    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg66l\" (UniqueName: \"kubernetes.io/projected/3f38d199-1487-4530-8848-670ecd96c1c7-kube-api-access-kg66l\") pod \"maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg\" (UID: \"3f38d199-1487-4530-8848-670ecd96c1c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg"
Jul 13 09:42:16.393289 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:16.393234    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f38d199-1487-4530-8848-670ecd96c1c7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg\" (UID: \"3f38d199-1487-4530-8848-670ecd96c1c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg"
Jul 13 09:42:16.494403 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:16.494368    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg66l\" (UniqueName: \"kubernetes.io/projected/3f38d199-1487-4530-8848-670ecd96c1c7-kube-api-access-kg66l\") pod \"maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg\" (UID: \"3f38d199-1487-4530-8848-670ecd96c1c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg"
Jul 13 09:42:16.494595 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:16.494424    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f38d199-1487-4530-8848-670ecd96c1c7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg\" (UID: \"3f38d199-1487-4530-8848-670ecd96c1c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg"
Jul 13 09:42:16.494595 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:16.494476    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f38d199-1487-4530-8848-670ecd96c1c7-maas-api-tls\") pod \"maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg\" (UID: \"3f38d199-1487-4530-8848-670ecd96c1c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg"
Jul 13 09:42:16.494751 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:42:16.494653    2553 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-serving-cert: secret "maas-api-e2e-inf-a-c47dc5-serving-cert" not found
Jul 13 09:42:16.494827 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:42:16.494754    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f38d199-1487-4530-8848-670ecd96c1c7-maas-api-tls podName:3f38d199-1487-4530-8848-670ecd96c1c7 nodeName:}" failed. No retries permitted until 2026-07-13 09:42:16.99473189 +0000 UTC m=+2026.072609156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3f38d199-1487-4530-8848-670ecd96c1c7-maas-api-tls") pod "maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg" (UID: "3f38d199-1487-4530-8848-670ecd96c1c7") : secret "maas-api-e2e-inf-a-c47dc5-serving-cert" not found
Jul 13 09:42:16.495190 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:16.495166    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f38d199-1487-4530-8848-670ecd96c1c7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg\" (UID: \"3f38d199-1487-4530-8848-670ecd96c1c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg"
Jul 13 09:42:16.507580 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:16.507555    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg66l\" (UniqueName: \"kubernetes.io/projected/3f38d199-1487-4530-8848-670ecd96c1c7-kube-api-access-kg66l\") pod \"maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg\" (UID: \"3f38d199-1487-4530-8848-670ecd96c1c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg"
Jul 13 09:42:16.999331 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:16.999291    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f38d199-1487-4530-8848-670ecd96c1c7-maas-api-tls\") pod \"maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg\" (UID: \"3f38d199-1487-4530-8848-670ecd96c1c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg"
Jul 13 09:42:17.002051 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:17.002023    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f38d199-1487-4530-8848-670ecd96c1c7-maas-api-tls\") pod \"maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg\" (UID: \"3f38d199-1487-4530-8848-670ecd96c1c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg"
Jul 13 09:42:17.211205 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:17.211166    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg"
Jul 13 09:42:17.356280 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:17.356252    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg"]
Jul 13 09:42:17.358664 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:42:17.358634    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f38d199_1487_4530_8848_670ecd96c1c7.slice/crio-3e9b1a9ab7642a3feb7c2b6240bb112a9442450f7afe7812dc2e3555472bca9b WatchSource:0}: Error finding container 3e9b1a9ab7642a3feb7c2b6240bb112a9442450f7afe7812dc2e3555472bca9b: Status 404 returned error can't find the container with id 3e9b1a9ab7642a3feb7c2b6240bb112a9442450f7afe7812dc2e3555472bca9b
Jul 13 09:42:17.360438 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:17.360419    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 09:42:18.079891 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:18.079852    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg" event={"ID":"3f38d199-1487-4530-8848-670ecd96c1c7","Type":"ContainerStarted","Data":"3e9b1a9ab7642a3feb7c2b6240bb112a9442450f7afe7812dc2e3555472bca9b"}
Jul 13 09:42:19.086885 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:19.086849    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg" event={"ID":"3f38d199-1487-4530-8848-670ecd96c1c7","Type":"ContainerStarted","Data":"377ab9adbe8ecd7204f5d6099060a8dc9ca9bbe9292e3f7cbe198fa2b73613b4"}
Jul 13 09:42:19.087285 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:19.086924    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg"
Jul 13 09:42:19.117401 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:19.117351    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg" podStartSLOduration=2.125824933 podStartE2EDuration="3.117330683s" totalImagesPullingTime="991.50575ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:42:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:42:19.116402962 +0000 UTC m=+2028.194280239" watchObservedRunningTime="2026-07-13 09:42:19.117330683 +0000 UTC m=+2028.195207939"
Jul 13 09:42:24.298645 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:24.298612    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7"]
Jul 13 09:42:24.302436 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:24.302412    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7"
Jul 13 09:42:24.305603 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:24.305573    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-6f7934-serving-cert\""
Jul 13 09:42:24.315931 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:24.315910    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7"]
Jul 13 09:42:24.369646 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:24.369609    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/373c5e98-fe9d-425d-a3ea-67d3893d2509-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6f7934-7897478445-rwvw7\" (UID: \"373c5e98-fe9d-425d-a3ea-67d3893d2509\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7"
Jul 13 09:42:24.369831 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:24.369728    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/373c5e98-fe9d-425d-a3ea-67d3893d2509-maas-api-tls\") pod \"maas-api-e2e-inf-b-6f7934-7897478445-rwvw7\" (UID: \"373c5e98-fe9d-425d-a3ea-67d3893d2509\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7"
Jul 13 09:42:24.369831 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:24.369812    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wztfk\" (UniqueName: \"kubernetes.io/projected/373c5e98-fe9d-425d-a3ea-67d3893d2509-kube-api-access-wztfk\") pod \"maas-api-e2e-inf-b-6f7934-7897478445-rwvw7\" (UID: \"373c5e98-fe9d-425d-a3ea-67d3893d2509\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7"
Jul 13 09:42:24.471098 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:24.471065    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/373c5e98-fe9d-425d-a3ea-67d3893d2509-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6f7934-7897478445-rwvw7\" (UID: \"373c5e98-fe9d-425d-a3ea-67d3893d2509\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7"
Jul 13 09:42:24.471283 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:24.471123    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/373c5e98-fe9d-425d-a3ea-67d3893d2509-maas-api-tls\") pod \"maas-api-e2e-inf-b-6f7934-7897478445-rwvw7\" (UID: \"373c5e98-fe9d-425d-a3ea-67d3893d2509\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7"
Jul 13 09:42:24.471283 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:24.471170    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wztfk\" (UniqueName: \"kubernetes.io/projected/373c5e98-fe9d-425d-a3ea-67d3893d2509-kube-api-access-wztfk\") pod \"maas-api-e2e-inf-b-6f7934-7897478445-rwvw7\" (UID: \"373c5e98-fe9d-425d-a3ea-67d3893d2509\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7"
Jul 13 09:42:24.471784 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:24.471759    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/373c5e98-fe9d-425d-a3ea-67d3893d2509-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6f7934-7897478445-rwvw7\" (UID: \"373c5e98-fe9d-425d-a3ea-67d3893d2509\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7"
Jul 13 09:42:24.473526 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:24.473506    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/373c5e98-fe9d-425d-a3ea-67d3893d2509-maas-api-tls\") pod \"maas-api-e2e-inf-b-6f7934-7897478445-rwvw7\" (UID: \"373c5e98-fe9d-425d-a3ea-67d3893d2509\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7"
Jul 13 09:42:24.481581 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:24.481562    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wztfk\" (UniqueName: \"kubernetes.io/projected/373c5e98-fe9d-425d-a3ea-67d3893d2509-kube-api-access-wztfk\") pod \"maas-api-e2e-inf-b-6f7934-7897478445-rwvw7\" (UID: \"373c5e98-fe9d-425d-a3ea-67d3893d2509\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7"
Jul 13 09:42:24.614634 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:24.614557    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7"
Jul 13 09:42:24.756881 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:24.756851    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7"]
Jul 13 09:42:24.758461 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:42:24.758429    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod373c5e98_fe9d_425d_a3ea_67d3893d2509.slice/crio-78d7bf76988074869baf34fb8a1049cc49f0a521b752815869a54fc9f64bfb66 WatchSource:0}: Error finding container 78d7bf76988074869baf34fb8a1049cc49f0a521b752815869a54fc9f64bfb66: Status 404 returned error can't find the container with id 78d7bf76988074869baf34fb8a1049cc49f0a521b752815869a54fc9f64bfb66
Jul 13 09:42:25.098878 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:25.098843    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg"
Jul 13 09:42:25.126112 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:25.126081    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7" event={"ID":"373c5e98-fe9d-425d-a3ea-67d3893d2509","Type":"ContainerStarted","Data":"78d7bf76988074869baf34fb8a1049cc49f0a521b752815869a54fc9f64bfb66"}
Jul 13 09:42:26.132608 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:26.132563    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7" event={"ID":"373c5e98-fe9d-425d-a3ea-67d3893d2509","Type":"ContainerStarted","Data":"ea46a4126002742e5da350d7dddb46d7a61f0d19e1928c62e16569baf8c2690d"}
Jul 13 09:42:26.132997 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:26.132718    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7"
Jul 13 09:42:26.153406 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:26.153363    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7" podStartSLOduration=1.618449853 podStartE2EDuration="2.153348611s" totalImagesPullingTime="534.898758ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:42:26.152575142 +0000 UTC m=+2035.230452417" watchObservedRunningTime="2026-07-13 09:42:26.153348611 +0000 UTC m=+2035.231225899"
Jul 13 09:42:32.143906 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:32.143874    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7"
Jul 13 09:42:40.364512 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.364478    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"]
Jul 13 09:42:40.368388 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.368364    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:42:40.370995 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.370970    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c47dc5\"/\"openshift-service-ca.crt\""
Jul 13 09:42:40.372043 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.372025    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c47dc5\"/\"kube-root-ca.crt\""
Jul 13 09:42:40.372147 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.372078    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c47dc5\"/\"default-dockercfg-g849w\""
Jul 13 09:42:40.372147 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.372024    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c47dc5\"/\"test-model-c47dc5-kserve-self-signed-certs\""
Jul 13 09:42:40.377183 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.377161    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"]
Jul 13 09:42:40.525412 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.525374    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d843214d-92b9-4ff6-b564-2ea759e59066-model-cache\") pod \"test-model-c47dc5-kserve-7545bcbf7c-jjw6w\" (UID: \"d843214d-92b9-4ff6-b564-2ea759e59066\") " pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:42:40.525613 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.525421    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d843214d-92b9-4ff6-b564-2ea759e59066-home\") pod \"test-model-c47dc5-kserve-7545bcbf7c-jjw6w\" (UID: \"d843214d-92b9-4ff6-b564-2ea759e59066\") " pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:42:40.525613 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.525441    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfxkc\" (UniqueName: \"kubernetes.io/projected/d843214d-92b9-4ff6-b564-2ea759e59066-kube-api-access-nfxkc\") pod \"test-model-c47dc5-kserve-7545bcbf7c-jjw6w\" (UID: \"d843214d-92b9-4ff6-b564-2ea759e59066\") " pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:42:40.525613 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.525548    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d843214d-92b9-4ff6-b564-2ea759e59066-tmp-dir\") pod \"test-model-c47dc5-kserve-7545bcbf7c-jjw6w\" (UID: \"d843214d-92b9-4ff6-b564-2ea759e59066\") " pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:42:40.525836 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.525639    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d843214d-92b9-4ff6-b564-2ea759e59066-tls-certs\") pod \"test-model-c47dc5-kserve-7545bcbf7c-jjw6w\" (UID: \"d843214d-92b9-4ff6-b564-2ea759e59066\") " pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:42:40.525836 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.525749    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d843214d-92b9-4ff6-b564-2ea759e59066-dshm\") pod \"test-model-c47dc5-kserve-7545bcbf7c-jjw6w\" (UID: \"d843214d-92b9-4ff6-b564-2ea759e59066\") " pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:42:40.626791 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.626764    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d843214d-92b9-4ff6-b564-2ea759e59066-tls-certs\") pod \"test-model-c47dc5-kserve-7545bcbf7c-jjw6w\" (UID: \"d843214d-92b9-4ff6-b564-2ea759e59066\") " pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:42:40.626936 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.626812    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d843214d-92b9-4ff6-b564-2ea759e59066-dshm\") pod \"test-model-c47dc5-kserve-7545bcbf7c-jjw6w\" (UID: \"d843214d-92b9-4ff6-b564-2ea759e59066\") " pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:42:40.626936 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.626862    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d843214d-92b9-4ff6-b564-2ea759e59066-model-cache\") pod \"test-model-c47dc5-kserve-7545bcbf7c-jjw6w\" (UID: \"d843214d-92b9-4ff6-b564-2ea759e59066\") " pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:42:40.626936 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.626884    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d843214d-92b9-4ff6-b564-2ea759e59066-home\") pod \"test-model-c47dc5-kserve-7545bcbf7c-jjw6w\" (UID: \"d843214d-92b9-4ff6-b564-2ea759e59066\") " pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:42:40.626936 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.626901    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfxkc\" (UniqueName: \"kubernetes.io/projected/d843214d-92b9-4ff6-b564-2ea759e59066-kube-api-access-nfxkc\") pod \"test-model-c47dc5-kserve-7545bcbf7c-jjw6w\" (UID: \"d843214d-92b9-4ff6-b564-2ea759e59066\") " pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:42:40.626936 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.626937    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d843214d-92b9-4ff6-b564-2ea759e59066-tmp-dir\") pod \"test-model-c47dc5-kserve-7545bcbf7c-jjw6w\" (UID: \"d843214d-92b9-4ff6-b564-2ea759e59066\") " pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:42:40.627316 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.627290    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d843214d-92b9-4ff6-b564-2ea759e59066-home\") pod \"test-model-c47dc5-kserve-7545bcbf7c-jjw6w\" (UID: \"d843214d-92b9-4ff6-b564-2ea759e59066\") " pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:42:40.627316 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.627305    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d843214d-92b9-4ff6-b564-2ea759e59066-tmp-dir\") pod \"test-model-c47dc5-kserve-7545bcbf7c-jjw6w\" (UID: \"d843214d-92b9-4ff6-b564-2ea759e59066\") " pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:42:40.627473 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.627384    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d843214d-92b9-4ff6-b564-2ea759e59066-model-cache\") pod \"test-model-c47dc5-kserve-7545bcbf7c-jjw6w\" (UID: \"d843214d-92b9-4ff6-b564-2ea759e59066\") " pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:42:40.629200 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.629182    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d843214d-92b9-4ff6-b564-2ea759e59066-dshm\") pod \"test-model-c47dc5-kserve-7545bcbf7c-jjw6w\" (UID: \"d843214d-92b9-4ff6-b564-2ea759e59066\") " pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:42:40.629330 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.629313    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d843214d-92b9-4ff6-b564-2ea759e59066-tls-certs\") pod \"test-model-c47dc5-kserve-7545bcbf7c-jjw6w\" (UID: \"d843214d-92b9-4ff6-b564-2ea759e59066\") " pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:42:40.636590 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.636572    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfxkc\" (UniqueName: \"kubernetes.io/projected/d843214d-92b9-4ff6-b564-2ea759e59066-kube-api-access-nfxkc\") pod \"test-model-c47dc5-kserve-7545bcbf7c-jjw6w\" (UID: \"d843214d-92b9-4ff6-b564-2ea759e59066\") " pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:42:40.689846 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.689824    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:42:40.829635 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:40.829614    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"]
Jul 13 09:42:40.831489 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:42:40.831456    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd843214d_92b9_4ff6_b564_2ea759e59066.slice/crio-c23c093f6c5909604adc699cf17a8e1aa422ca8d2136170bc5f7020fb79f4172 WatchSource:0}: Error finding container c23c093f6c5909604adc699cf17a8e1aa422ca8d2136170bc5f7020fb79f4172: Status 404 returned error can't find the container with id c23c093f6c5909604adc699cf17a8e1aa422ca8d2136170bc5f7020fb79f4172
Jul 13 09:42:41.210661 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:41.210569    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w" event={"ID":"d843214d-92b9-4ff6-b564-2ea759e59066","Type":"ContainerStarted","Data":"0d3f160024e6c60bb73111516713ed0629aaae6eca7fb50cb987a7ba42445d41"}
Jul 13 09:42:41.210661 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:41.210626    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w" event={"ID":"d843214d-92b9-4ff6-b564-2ea759e59066","Type":"ContainerStarted","Data":"c23c093f6c5909604adc699cf17a8e1aa422ca8d2136170bc5f7020fb79f4172"}
Jul 13 09:42:41.238446 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:41.238405    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w" podStartSLOduration=1.2383910519999999 podStartE2EDuration="1.238391052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:42:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:42:41.237856433 +0000 UTC m=+2050.315733688" watchObservedRunningTime="2026-07-13 09:42:41.238391052 +0000 UTC m=+2050.316268307"
Jul 13 09:42:50.690795 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:50.690761    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:42:50.691235 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:50.690836    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:42:50.703114 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:50.703091    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:42:51.270300 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:51.270272    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:42:59.465113 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.465037    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"]
Jul 13 09:42:59.469933 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.469909    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:42:59.472971 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.472950    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6f7934\"/\"kube-root-ca.crt\""
Jul 13 09:42:59.474026 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.474008    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6f7934\"/\"openshift-service-ca.crt\""
Jul 13 09:42:59.474134 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.474045    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6f7934\"/\"default-dockercfg-5bw7t\""
Jul 13 09:42:59.474315 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.474298    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6f7934\"/\"test-model-6f7934-kserve-self-signed-certs\""
Jul 13 09:42:59.489641 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.489616    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"]
Jul 13 09:42:59.504984 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.504960    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1269855c-b520-439c-9c13-0c7e963d98fd-tls-certs\") pod \"test-model-6f7934-kserve-68cffbb9f-4b8r6\" (UID: \"1269855c-b520-439c-9c13-0c7e963d98fd\") " pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:42:59.505119 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.505007    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1269855c-b520-439c-9c13-0c7e963d98fd-home\") pod \"test-model-6f7934-kserve-68cffbb9f-4b8r6\" (UID: \"1269855c-b520-439c-9c13-0c7e963d98fd\") " pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:42:59.505119 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.505090    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1269855c-b520-439c-9c13-0c7e963d98fd-dshm\") pod \"test-model-6f7934-kserve-68cffbb9f-4b8r6\" (UID: \"1269855c-b520-439c-9c13-0c7e963d98fd\") " pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:42:59.505235 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.505180    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1269855c-b520-439c-9c13-0c7e963d98fd-tmp-dir\") pod \"test-model-6f7934-kserve-68cffbb9f-4b8r6\" (UID: \"1269855c-b520-439c-9c13-0c7e963d98fd\") " pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:42:59.505235 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.505218    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwwvj\" (UniqueName: \"kubernetes.io/projected/1269855c-b520-439c-9c13-0c7e963d98fd-kube-api-access-zwwvj\") pod \"test-model-6f7934-kserve-68cffbb9f-4b8r6\" (UID: \"1269855c-b520-439c-9c13-0c7e963d98fd\") " pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:42:59.505342 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.505282    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1269855c-b520-439c-9c13-0c7e963d98fd-model-cache\") pod \"test-model-6f7934-kserve-68cffbb9f-4b8r6\" (UID: \"1269855c-b520-439c-9c13-0c7e963d98fd\") " pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:42:59.606455 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.606430    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1269855c-b520-439c-9c13-0c7e963d98fd-dshm\") pod \"test-model-6f7934-kserve-68cffbb9f-4b8r6\" (UID: \"1269855c-b520-439c-9c13-0c7e963d98fd\") " pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:42:59.606588 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.606490    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1269855c-b520-439c-9c13-0c7e963d98fd-tmp-dir\") pod \"test-model-6f7934-kserve-68cffbb9f-4b8r6\" (UID: \"1269855c-b520-439c-9c13-0c7e963d98fd\") " pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:42:59.606588 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.606524    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwwvj\" (UniqueName: \"kubernetes.io/projected/1269855c-b520-439c-9c13-0c7e963d98fd-kube-api-access-zwwvj\") pod \"test-model-6f7934-kserve-68cffbb9f-4b8r6\" (UID: \"1269855c-b520-439c-9c13-0c7e963d98fd\") " pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:42:59.606588 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.606565    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1269855c-b520-439c-9c13-0c7e963d98fd-model-cache\") pod \"test-model-6f7934-kserve-68cffbb9f-4b8r6\" (UID: \"1269855c-b520-439c-9c13-0c7e963d98fd\") " pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:42:59.606797 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.606607    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1269855c-b520-439c-9c13-0c7e963d98fd-tls-certs\") pod \"test-model-6f7934-kserve-68cffbb9f-4b8r6\" (UID: \"1269855c-b520-439c-9c13-0c7e963d98fd\") " pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:42:59.606797 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.606640    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1269855c-b520-439c-9c13-0c7e963d98fd-home\") pod \"test-model-6f7934-kserve-68cffbb9f-4b8r6\" (UID: \"1269855c-b520-439c-9c13-0c7e963d98fd\") " pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:42:59.606984 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.606962    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1269855c-b520-439c-9c13-0c7e963d98fd-tmp-dir\") pod \"test-model-6f7934-kserve-68cffbb9f-4b8r6\" (UID: \"1269855c-b520-439c-9c13-0c7e963d98fd\") " pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:42:59.607049 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.607026    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1269855c-b520-439c-9c13-0c7e963d98fd-home\") pod \"test-model-6f7934-kserve-68cffbb9f-4b8r6\" (UID: \"1269855c-b520-439c-9c13-0c7e963d98fd\") " pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:42:59.607104 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.607060    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1269855c-b520-439c-9c13-0c7e963d98fd-model-cache\") pod \"test-model-6f7934-kserve-68cffbb9f-4b8r6\" (UID: \"1269855c-b520-439c-9c13-0c7e963d98fd\") " pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:42:59.608798 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.608778    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1269855c-b520-439c-9c13-0c7e963d98fd-dshm\") pod \"test-model-6f7934-kserve-68cffbb9f-4b8r6\" (UID: \"1269855c-b520-439c-9c13-0c7e963d98fd\") " pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:42:59.609041 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.609025    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1269855c-b520-439c-9c13-0c7e963d98fd-tls-certs\") pod \"test-model-6f7934-kserve-68cffbb9f-4b8r6\" (UID: \"1269855c-b520-439c-9c13-0c7e963d98fd\") " pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:42:59.615708 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.615661    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwwvj\" (UniqueName: \"kubernetes.io/projected/1269855c-b520-439c-9c13-0c7e963d98fd-kube-api-access-zwwvj\") pod \"test-model-6f7934-kserve-68cffbb9f-4b8r6\" (UID: \"1269855c-b520-439c-9c13-0c7e963d98fd\") " pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:42:59.780546 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.780486    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:42:59.932600 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:42:59.932570    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"]
Jul 13 09:42:59.936158 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:42:59.936122    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1269855c_b520_439c_9c13_0c7e963d98fd.slice/crio-f1097d364fa7bf65151153c8d47b02603308b1a98fa9003bd0acdb4f317053a9 WatchSource:0}: Error finding container f1097d364fa7bf65151153c8d47b02603308b1a98fa9003bd0acdb4f317053a9: Status 404 returned error can't find the container with id f1097d364fa7bf65151153c8d47b02603308b1a98fa9003bd0acdb4f317053a9
Jul 13 09:43:00.307262 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:00.307220    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6" event={"ID":"1269855c-b520-439c-9c13-0c7e963d98fd","Type":"ContainerStarted","Data":"104b2a93aaf64afa4b6ec801d4d4682226bca257e7e056919a49702b8fbd75c4"}
Jul 13 09:43:00.307262 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:00.307264    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6" event={"ID":"1269855c-b520-439c-9c13-0c7e963d98fd","Type":"ContainerStarted","Data":"f1097d364fa7bf65151153c8d47b02603308b1a98fa9003bd0acdb4f317053a9"}
Jul 13 09:43:00.326606 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:00.326561    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6" podStartSLOduration=1.326545745 podStartE2EDuration="1.326545745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:42:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:43:00.325586775 +0000 UTC m=+2069.403464030" watchObservedRunningTime="2026-07-13 09:43:00.326545745 +0000 UTC m=+2069.404422999"
Jul 13 09:43:09.780946 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:09.780907    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:43:09.781423 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:09.780966    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:43:09.793423 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:09.793399    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:43:10.369555 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:10.369527    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:43:17.500969 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:17.500933    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"]
Jul 13 09:43:18.370835 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:18.370804    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"]
Jul 13 09:43:19.305887 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:19.305854    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg"]
Jul 13 09:43:19.306306 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:19.306103    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg" podUID="3f38d199-1487-4530-8848-670ecd96c1c7" containerName="maas-api" containerID="cri-o://377ab9adbe8ecd7204f5d6099060a8dc9ca9bbe9292e3f7cbe198fa2b73613b4" gracePeriod=30
Jul 13 09:43:19.560571 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:19.560507    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg"
Jul 13 09:43:19.700551 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:19.700515    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f38d199-1487-4530-8848-670ecd96c1c7-maas-api-tls\") pod \"3f38d199-1487-4530-8848-670ecd96c1c7\" (UID: \"3f38d199-1487-4530-8848-670ecd96c1c7\") "
Jul 13 09:43:19.700770 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:19.700595    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kg66l\" (UniqueName: \"kubernetes.io/projected/3f38d199-1487-4530-8848-670ecd96c1c7-kube-api-access-kg66l\") pod \"3f38d199-1487-4530-8848-670ecd96c1c7\" (UID: \"3f38d199-1487-4530-8848-670ecd96c1c7\") "
Jul 13 09:43:19.700770 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:19.700650    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f38d199-1487-4530-8848-670ecd96c1c7-openshift-service-ca\") pod \"3f38d199-1487-4530-8848-670ecd96c1c7\" (UID: \"3f38d199-1487-4530-8848-670ecd96c1c7\") "
Jul 13 09:43:19.701087 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:19.701062    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f38d199-1487-4530-8848-670ecd96c1c7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3f38d199-1487-4530-8848-670ecd96c1c7" (UID: "3f38d199-1487-4530-8848-670ecd96c1c7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:43:19.702746 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:19.702658    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f38d199-1487-4530-8848-670ecd96c1c7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3f38d199-1487-4530-8848-670ecd96c1c7" (UID: "3f38d199-1487-4530-8848-670ecd96c1c7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:43:19.702746 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:19.702680    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f38d199-1487-4530-8848-670ecd96c1c7-kube-api-access-kg66l" (OuterVolumeSpecName: "kube-api-access-kg66l") pod "3f38d199-1487-4530-8848-670ecd96c1c7" (UID: "3f38d199-1487-4530-8848-670ecd96c1c7"). InnerVolumeSpecName "kube-api-access-kg66l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:43:19.801759 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:19.801725    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f38d199-1487-4530-8848-670ecd96c1c7-maas-api-tls\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:43:19.801759 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:19.801759    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg66l\" (UniqueName: \"kubernetes.io/projected/3f38d199-1487-4530-8848-670ecd96c1c7-kube-api-access-kg66l\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:43:19.801934 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:19.801775    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f38d199-1487-4530-8848-670ecd96c1c7-openshift-service-ca\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:43:20.411369 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:20.411335    2553 generic.go:356] "Generic (PLEG): container finished" podID="3f38d199-1487-4530-8848-670ecd96c1c7" containerID="377ab9adbe8ecd7204f5d6099060a8dc9ca9bbe9292e3f7cbe198fa2b73613b4" exitCode=0
Jul 13 09:43:20.411816 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:20.411377    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg"
Jul 13 09:43:20.411816 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:20.411388    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg" event={"ID":"3f38d199-1487-4530-8848-670ecd96c1c7","Type":"ContainerDied","Data":"377ab9adbe8ecd7204f5d6099060a8dc9ca9bbe9292e3f7cbe198fa2b73613b4"}
Jul 13 09:43:20.411816 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:20.411431    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg" event={"ID":"3f38d199-1487-4530-8848-670ecd96c1c7","Type":"ContainerDied","Data":"3e9b1a9ab7642a3feb7c2b6240bb112a9442450f7afe7812dc2e3555472bca9b"}
Jul 13 09:43:20.411816 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:20.411456    2553 scope.go:117] "RemoveContainer" containerID="377ab9adbe8ecd7204f5d6099060a8dc9ca9bbe9292e3f7cbe198fa2b73613b4"
Jul 13 09:43:20.421181 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:20.421162    2553 scope.go:117] "RemoveContainer" containerID="377ab9adbe8ecd7204f5d6099060a8dc9ca9bbe9292e3f7cbe198fa2b73613b4"
Jul 13 09:43:20.421415 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:43:20.421398    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"377ab9adbe8ecd7204f5d6099060a8dc9ca9bbe9292e3f7cbe198fa2b73613b4\": container with ID starting with 377ab9adbe8ecd7204f5d6099060a8dc9ca9bbe9292e3f7cbe198fa2b73613b4 not found: ID does not exist" containerID="377ab9adbe8ecd7204f5d6099060a8dc9ca9bbe9292e3f7cbe198fa2b73613b4"
Jul 13 09:43:20.421486 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:20.421422    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"377ab9adbe8ecd7204f5d6099060a8dc9ca9bbe9292e3f7cbe198fa2b73613b4"} err="failed to get container status \"377ab9adbe8ecd7204f5d6099060a8dc9ca9bbe9292e3f7cbe198fa2b73613b4\": rpc error: code = NotFound desc = could not find container \"377ab9adbe8ecd7204f5d6099060a8dc9ca9bbe9292e3f7cbe198fa2b73613b4\": container with ID starting with 377ab9adbe8ecd7204f5d6099060a8dc9ca9bbe9292e3f7cbe198fa2b73613b4 not found: ID does not exist"
Jul 13 09:43:20.432894 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:20.432871    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg"]
Jul 13 09:43:20.437093 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:20.437073    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c47dc5-6ddcc494f-x4rmg"]
Jul 13 09:43:21.482001 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:21.481970    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f38d199-1487-4530-8848-670ecd96c1c7" path="/var/lib/kubelet/pods/3f38d199-1487-4530-8848-670ecd96c1c7/volumes"
Jul 13 09:43:31.646709 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:31.646666    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tmbbk_d1243d30-2275-43cc-b5a9-a8de5a66beed/console-operator/1.log"
Jul 13 09:43:31.654907 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:31.654878    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t558b_db263c9c-ef1c-4e74-968b-f8822c77dffc/ovn-acl-logging/0.log"
Jul 13 09:43:31.655372 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:31.655349    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tmbbk_d1243d30-2275-43cc-b5a9-a8de5a66beed/console-operator/1.log"
Jul 13 09:43:31.664298 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:31.664278    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t558b_db263c9c-ef1c-4e74-968b-f8822c77dffc/ovn-acl-logging/0.log"
Jul 13 09:43:32.521950 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:32.521897    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w" podUID="d843214d-92b9-4ff6-b564-2ea759e59066" containerName="main" containerID="cri-o://0d3f160024e6c60bb73111516713ed0629aaae6eca7fb50cb987a7ba42445d41" gracePeriod=45
Jul 13 09:43:32.774622 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:32.774561    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:43:32.831740 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:32.831714    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfxkc\" (UniqueName: \"kubernetes.io/projected/d843214d-92b9-4ff6-b564-2ea759e59066-kube-api-access-nfxkc\") pod \"d843214d-92b9-4ff6-b564-2ea759e59066\" (UID: \"d843214d-92b9-4ff6-b564-2ea759e59066\") "
Jul 13 09:43:32.831870 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:32.831749    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d843214d-92b9-4ff6-b564-2ea759e59066-tls-certs\") pod \"d843214d-92b9-4ff6-b564-2ea759e59066\" (UID: \"d843214d-92b9-4ff6-b564-2ea759e59066\") "
Jul 13 09:43:32.831870 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:32.831797    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d843214d-92b9-4ff6-b564-2ea759e59066-model-cache\") pod \"d843214d-92b9-4ff6-b564-2ea759e59066\" (UID: \"d843214d-92b9-4ff6-b564-2ea759e59066\") "
Jul 13 09:43:32.831870 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:32.831819    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d843214d-92b9-4ff6-b564-2ea759e59066-tmp-dir\") pod \"d843214d-92b9-4ff6-b564-2ea759e59066\" (UID: \"d843214d-92b9-4ff6-b564-2ea759e59066\") "
Jul 13 09:43:32.831870 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:32.831836    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d843214d-92b9-4ff6-b564-2ea759e59066-dshm\") pod \"d843214d-92b9-4ff6-b564-2ea759e59066\" (UID: \"d843214d-92b9-4ff6-b564-2ea759e59066\") "
Jul 13 09:43:32.832120 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:32.831881    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d843214d-92b9-4ff6-b564-2ea759e59066-home\") pod \"d843214d-92b9-4ff6-b564-2ea759e59066\" (UID: \"d843214d-92b9-4ff6-b564-2ea759e59066\") "
Jul 13 09:43:32.832120 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:32.832071    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d843214d-92b9-4ff6-b564-2ea759e59066-model-cache" (OuterVolumeSpecName: "model-cache") pod "d843214d-92b9-4ff6-b564-2ea759e59066" (UID: "d843214d-92b9-4ff6-b564-2ea759e59066"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 09:43:32.832120 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:32.832088    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d843214d-92b9-4ff6-b564-2ea759e59066-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d843214d-92b9-4ff6-b564-2ea759e59066" (UID: "d843214d-92b9-4ff6-b564-2ea759e59066"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 09:43:32.832314 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:32.832262    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d843214d-92b9-4ff6-b564-2ea759e59066-home" (OuterVolumeSpecName: "home") pod "d843214d-92b9-4ff6-b564-2ea759e59066" (UID: "d843214d-92b9-4ff6-b564-2ea759e59066"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 09:43:32.832387 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:32.832364    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d843214d-92b9-4ff6-b564-2ea759e59066-model-cache\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:43:32.832511 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:32.832390    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d843214d-92b9-4ff6-b564-2ea759e59066-tmp-dir\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:43:32.832511 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:32.832404    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d843214d-92b9-4ff6-b564-2ea759e59066-home\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:43:32.834006 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:32.833980    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d843214d-92b9-4ff6-b564-2ea759e59066-kube-api-access-nfxkc" (OuterVolumeSpecName: "kube-api-access-nfxkc") pod "d843214d-92b9-4ff6-b564-2ea759e59066" (UID: "d843214d-92b9-4ff6-b564-2ea759e59066"). InnerVolumeSpecName "kube-api-access-nfxkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:43:32.834309 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:32.834294    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d843214d-92b9-4ff6-b564-2ea759e59066-dshm" (OuterVolumeSpecName: "dshm") pod "d843214d-92b9-4ff6-b564-2ea759e59066" (UID: "d843214d-92b9-4ff6-b564-2ea759e59066"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 09:43:32.834356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:32.834318    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d843214d-92b9-4ff6-b564-2ea759e59066-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d843214d-92b9-4ff6-b564-2ea759e59066" (UID: "d843214d-92b9-4ff6-b564-2ea759e59066"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:43:32.933396 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:32.933370    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfxkc\" (UniqueName: \"kubernetes.io/projected/d843214d-92b9-4ff6-b564-2ea759e59066-kube-api-access-nfxkc\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:43:32.933396 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:32.933392    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d843214d-92b9-4ff6-b564-2ea759e59066-tls-certs\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:43:32.933536 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:32.933402    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d843214d-92b9-4ff6-b564-2ea759e59066-dshm\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:43:33.391319 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.391256    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6" podUID="1269855c-b520-439c-9c13-0c7e963d98fd" containerName="main" containerID="cri-o://104b2a93aaf64afa4b6ec801d4d4682226bca257e7e056919a49702b8fbd75c4" gracePeriod=45
Jul 13 09:43:33.482781 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.482742    2553 generic.go:356] "Generic (PLEG): container finished" podID="d843214d-92b9-4ff6-b564-2ea759e59066" containerID="0d3f160024e6c60bb73111516713ed0629aaae6eca7fb50cb987a7ba42445d41" exitCode=0
Jul 13 09:43:33.482965 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.482850    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w" event={"ID":"d843214d-92b9-4ff6-b564-2ea759e59066","Type":"ContainerDied","Data":"0d3f160024e6c60bb73111516713ed0629aaae6eca7fb50cb987a7ba42445d41"}
Jul 13 09:43:33.482965 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.482883    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w" event={"ID":"d843214d-92b9-4ff6-b564-2ea759e59066","Type":"ContainerDied","Data":"c23c093f6c5909604adc699cf17a8e1aa422ca8d2136170bc5f7020fb79f4172"}
Jul 13 09:43:33.482965 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.482900    2553 scope.go:117] "RemoveContainer" containerID="0d3f160024e6c60bb73111516713ed0629aaae6eca7fb50cb987a7ba42445d41"
Jul 13 09:43:33.482965 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.482858    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"
Jul 13 09:43:33.504974 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.504950    2553 scope.go:117] "RemoveContainer" containerID="0d3f160024e6c60bb73111516713ed0629aaae6eca7fb50cb987a7ba42445d41"
Jul 13 09:43:33.505282 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:43:33.505261    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d3f160024e6c60bb73111516713ed0629aaae6eca7fb50cb987a7ba42445d41\": container with ID starting with 0d3f160024e6c60bb73111516713ed0629aaae6eca7fb50cb987a7ba42445d41 not found: ID does not exist" containerID="0d3f160024e6c60bb73111516713ed0629aaae6eca7fb50cb987a7ba42445d41"
Jul 13 09:43:33.505384 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.505289    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d3f160024e6c60bb73111516713ed0629aaae6eca7fb50cb987a7ba42445d41"} err="failed to get container status \"0d3f160024e6c60bb73111516713ed0629aaae6eca7fb50cb987a7ba42445d41\": rpc error: code = NotFound desc = could not find container \"0d3f160024e6c60bb73111516713ed0629aaae6eca7fb50cb987a7ba42445d41\": container with ID starting with 0d3f160024e6c60bb73111516713ed0629aaae6eca7fb50cb987a7ba42445d41 not found: ID does not exist"
Jul 13 09:43:33.508353 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.508332    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"]
Jul 13 09:43:33.513981 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.513960    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-c47dc5/test-model-c47dc5-kserve-7545bcbf7c-jjw6w"]
Jul 13 09:43:33.663334 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.663313    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:43:33.741053 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.741025    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1269855c-b520-439c-9c13-0c7e963d98fd-tls-certs\") pod \"1269855c-b520-439c-9c13-0c7e963d98fd\" (UID: \"1269855c-b520-439c-9c13-0c7e963d98fd\") "
Jul 13 09:43:33.741202 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.741065    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1269855c-b520-439c-9c13-0c7e963d98fd-home\") pod \"1269855c-b520-439c-9c13-0c7e963d98fd\" (UID: \"1269855c-b520-439c-9c13-0c7e963d98fd\") "
Jul 13 09:43:33.741202 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.741080    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1269855c-b520-439c-9c13-0c7e963d98fd-tmp-dir\") pod \"1269855c-b520-439c-9c13-0c7e963d98fd\" (UID: \"1269855c-b520-439c-9c13-0c7e963d98fd\") "
Jul 13 09:43:33.741202 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.741113    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1269855c-b520-439c-9c13-0c7e963d98fd-model-cache\") pod \"1269855c-b520-439c-9c13-0c7e963d98fd\" (UID: \"1269855c-b520-439c-9c13-0c7e963d98fd\") "
Jul 13 09:43:33.741202 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.741181    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1269855c-b520-439c-9c13-0c7e963d98fd-dshm\") pod \"1269855c-b520-439c-9c13-0c7e963d98fd\" (UID: \"1269855c-b520-439c-9c13-0c7e963d98fd\") "
Jul 13 09:43:33.741394 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.741241    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwwvj\" (UniqueName: \"kubernetes.io/projected/1269855c-b520-439c-9c13-0c7e963d98fd-kube-api-access-zwwvj\") pod \"1269855c-b520-439c-9c13-0c7e963d98fd\" (UID: \"1269855c-b520-439c-9c13-0c7e963d98fd\") "
Jul 13 09:43:33.741394 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.741303    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1269855c-b520-439c-9c13-0c7e963d98fd-home" (OuterVolumeSpecName: "home") pod "1269855c-b520-439c-9c13-0c7e963d98fd" (UID: "1269855c-b520-439c-9c13-0c7e963d98fd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 09:43:33.741394 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.741344    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1269855c-b520-439c-9c13-0c7e963d98fd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1269855c-b520-439c-9c13-0c7e963d98fd" (UID: "1269855c-b520-439c-9c13-0c7e963d98fd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 09:43:33.741550 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.741386    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1269855c-b520-439c-9c13-0c7e963d98fd-model-cache" (OuterVolumeSpecName: "model-cache") pod "1269855c-b520-439c-9c13-0c7e963d98fd" (UID: "1269855c-b520-439c-9c13-0c7e963d98fd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 09:43:33.741594 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.741550    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1269855c-b520-439c-9c13-0c7e963d98fd-home\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:43:33.741594 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.741567    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1269855c-b520-439c-9c13-0c7e963d98fd-tmp-dir\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:43:33.741594 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.741582    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1269855c-b520-439c-9c13-0c7e963d98fd-model-cache\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:43:33.743318 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.743298    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1269855c-b520-439c-9c13-0c7e963d98fd-dshm" (OuterVolumeSpecName: "dshm") pod "1269855c-b520-439c-9c13-0c7e963d98fd" (UID: "1269855c-b520-439c-9c13-0c7e963d98fd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 09:43:33.743318 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.743307    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1269855c-b520-439c-9c13-0c7e963d98fd-kube-api-access-zwwvj" (OuterVolumeSpecName: "kube-api-access-zwwvj") pod "1269855c-b520-439c-9c13-0c7e963d98fd" (UID: "1269855c-b520-439c-9c13-0c7e963d98fd"). InnerVolumeSpecName "kube-api-access-zwwvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:43:33.743318 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.743296    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1269855c-b520-439c-9c13-0c7e963d98fd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1269855c-b520-439c-9c13-0c7e963d98fd" (UID: "1269855c-b520-439c-9c13-0c7e963d98fd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:43:33.842404 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.842374    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1269855c-b520-439c-9c13-0c7e963d98fd-dshm\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:43:33.842404 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.842401    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwwvj\" (UniqueName: \"kubernetes.io/projected/1269855c-b520-439c-9c13-0c7e963d98fd-kube-api-access-zwwvj\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:43:33.842796 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:33.842412    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1269855c-b520-439c-9c13-0c7e963d98fd-tls-certs\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:43:34.488558 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:34.488529    2553 generic.go:356] "Generic (PLEG): container finished" podID="1269855c-b520-439c-9c13-0c7e963d98fd" containerID="104b2a93aaf64afa4b6ec801d4d4682226bca257e7e056919a49702b8fbd75c4" exitCode=0
Jul 13 09:43:34.488796 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:34.488585    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"
Jul 13 09:43:34.488796 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:34.488625    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6" event={"ID":"1269855c-b520-439c-9c13-0c7e963d98fd","Type":"ContainerDied","Data":"104b2a93aaf64afa4b6ec801d4d4682226bca257e7e056919a49702b8fbd75c4"}
Jul 13 09:43:34.488796 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:34.488671    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6" event={"ID":"1269855c-b520-439c-9c13-0c7e963d98fd","Type":"ContainerDied","Data":"f1097d364fa7bf65151153c8d47b02603308b1a98fa9003bd0acdb4f317053a9"}
Jul 13 09:43:34.488796 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:34.488710    2553 scope.go:117] "RemoveContainer" containerID="104b2a93aaf64afa4b6ec801d4d4682226bca257e7e056919a49702b8fbd75c4"
Jul 13 09:43:34.497741 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:34.497722    2553 scope.go:117] "RemoveContainer" containerID="104b2a93aaf64afa4b6ec801d4d4682226bca257e7e056919a49702b8fbd75c4"
Jul 13 09:43:34.498035 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:43:34.498008    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"104b2a93aaf64afa4b6ec801d4d4682226bca257e7e056919a49702b8fbd75c4\": container with ID starting with 104b2a93aaf64afa4b6ec801d4d4682226bca257e7e056919a49702b8fbd75c4 not found: ID does not exist" containerID="104b2a93aaf64afa4b6ec801d4d4682226bca257e7e056919a49702b8fbd75c4"
Jul 13 09:43:34.498087 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:34.498035    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"104b2a93aaf64afa4b6ec801d4d4682226bca257e7e056919a49702b8fbd75c4"} err="failed to get container status \"104b2a93aaf64afa4b6ec801d4d4682226bca257e7e056919a49702b8fbd75c4\": rpc error: code = NotFound desc = could not find container \"104b2a93aaf64afa4b6ec801d4d4682226bca257e7e056919a49702b8fbd75c4\": container with ID starting with 104b2a93aaf64afa4b6ec801d4d4682226bca257e7e056919a49702b8fbd75c4 not found: ID does not exist"
Jul 13 09:43:34.510281 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:34.510257    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"]
Jul 13 09:43:34.514726 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:34.514705    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-6f7934/test-model-6f7934-kserve-68cffbb9f-4b8r6"]
Jul 13 09:43:35.481399 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:35.481367    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1269855c-b520-439c-9c13-0c7e963d98fd" path="/var/lib/kubelet/pods/1269855c-b520-439c-9c13-0c7e963d98fd/volumes"
Jul 13 09:43:35.481798 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:43:35.481790    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d843214d-92b9-4ff6-b564-2ea759e59066" path="/var/lib/kubelet/pods/d843214d-92b9-4ff6-b564-2ea759e59066/volumes"
Jul 13 09:44:02.424135 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:02.424095    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7"]
Jul 13 09:44:02.424724 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:02.424418    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7" podUID="373c5e98-fe9d-425d-a3ea-67d3893d2509" containerName="maas-api" containerID="cri-o://ea46a4126002742e5da350d7dddb46d7a61f0d19e1928c62e16569baf8c2690d" gracePeriod=30
Jul 13 09:44:02.629160 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:02.629129    2553 generic.go:356] "Generic (PLEG): container finished" podID="373c5e98-fe9d-425d-a3ea-67d3893d2509" containerID="ea46a4126002742e5da350d7dddb46d7a61f0d19e1928c62e16569baf8c2690d" exitCode=0
Jul 13 09:44:02.629334 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:02.629208    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7" event={"ID":"373c5e98-fe9d-425d-a3ea-67d3893d2509","Type":"ContainerDied","Data":"ea46a4126002742e5da350d7dddb46d7a61f0d19e1928c62e16569baf8c2690d"}
Jul 13 09:44:02.675774 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:02.675721    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7"
Jul 13 09:44:02.814449 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:02.814420    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/373c5e98-fe9d-425d-a3ea-67d3893d2509-maas-api-tls\") pod \"373c5e98-fe9d-425d-a3ea-67d3893d2509\" (UID: \"373c5e98-fe9d-425d-a3ea-67d3893d2509\") "
Jul 13 09:44:02.814599 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:02.814479    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/373c5e98-fe9d-425d-a3ea-67d3893d2509-openshift-service-ca\") pod \"373c5e98-fe9d-425d-a3ea-67d3893d2509\" (UID: \"373c5e98-fe9d-425d-a3ea-67d3893d2509\") "
Jul 13 09:44:02.814599 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:02.814552    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wztfk\" (UniqueName: \"kubernetes.io/projected/373c5e98-fe9d-425d-a3ea-67d3893d2509-kube-api-access-wztfk\") pod \"373c5e98-fe9d-425d-a3ea-67d3893d2509\" (UID: \"373c5e98-fe9d-425d-a3ea-67d3893d2509\") "
Jul 13 09:44:02.814923 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:02.814896    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/373c5e98-fe9d-425d-a3ea-67d3893d2509-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "373c5e98-fe9d-425d-a3ea-67d3893d2509" (UID: "373c5e98-fe9d-425d-a3ea-67d3893d2509"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:44:02.816457 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:02.816438    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/373c5e98-fe9d-425d-a3ea-67d3893d2509-kube-api-access-wztfk" (OuterVolumeSpecName: "kube-api-access-wztfk") pod "373c5e98-fe9d-425d-a3ea-67d3893d2509" (UID: "373c5e98-fe9d-425d-a3ea-67d3893d2509"). InnerVolumeSpecName "kube-api-access-wztfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:44:02.816526 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:02.816506    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/373c5e98-fe9d-425d-a3ea-67d3893d2509-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "373c5e98-fe9d-425d-a3ea-67d3893d2509" (UID: "373c5e98-fe9d-425d-a3ea-67d3893d2509"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:44:02.916039 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:02.916007    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/373c5e98-fe9d-425d-a3ea-67d3893d2509-maas-api-tls\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:44:02.916039 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:02.916034    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/373c5e98-fe9d-425d-a3ea-67d3893d2509-openshift-service-ca\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:44:02.916196 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:02.916046    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wztfk\" (UniqueName: \"kubernetes.io/projected/373c5e98-fe9d-425d-a3ea-67d3893d2509-kube-api-access-wztfk\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:44:03.635310 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:03.635284    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7"
Jul 13 09:44:03.635310 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:03.635293    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7" event={"ID":"373c5e98-fe9d-425d-a3ea-67d3893d2509","Type":"ContainerDied","Data":"78d7bf76988074869baf34fb8a1049cc49f0a521b752815869a54fc9f64bfb66"}
Jul 13 09:44:03.635792 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:03.635345    2553 scope.go:117] "RemoveContainer" containerID="ea46a4126002742e5da350d7dddb46d7a61f0d19e1928c62e16569baf8c2690d"
Jul 13 09:44:03.653155 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:03.653132    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7"]
Jul 13 09:44:03.657955 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:03.657934    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6f7934-7897478445-rwvw7"]
Jul 13 09:44:05.482114 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:05.482078    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="373c5e98-fe9d-425d-a3ea-67d3893d2509" path="/var/lib/kubelet/pods/373c5e98-fe9d-425d-a3ea-67d3893d2509/volumes"
Jul 13 09:44:11.881619 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:11.881585    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5"]
Jul 13 09:44:11.882261 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:11.882239    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1269855c-b520-439c-9c13-0c7e963d98fd" containerName="main"
Jul 13 09:44:11.882356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:11.882263    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1269855c-b520-439c-9c13-0c7e963d98fd" containerName="main"
Jul 13 09:44:11.882356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:11.882291    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="373c5e98-fe9d-425d-a3ea-67d3893d2509" containerName="maas-api"
Jul 13 09:44:11.882356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:11.882300    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="373c5e98-fe9d-425d-a3ea-67d3893d2509" containerName="maas-api"
Jul 13 09:44:11.882356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:11.882313    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f38d199-1487-4530-8848-670ecd96c1c7" containerName="maas-api"
Jul 13 09:44:11.882356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:11.882321    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f38d199-1487-4530-8848-670ecd96c1c7" containerName="maas-api"
Jul 13 09:44:11.882356 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:11.882354    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d843214d-92b9-4ff6-b564-2ea759e59066" containerName="main"
Jul 13 09:44:11.882647 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:11.882362    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d843214d-92b9-4ff6-b564-2ea759e59066" containerName="main"
Jul 13 09:44:11.882647 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:11.882458    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="1269855c-b520-439c-9c13-0c7e963d98fd" containerName="main"
Jul 13 09:44:11.882647 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:11.882473    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="373c5e98-fe9d-425d-a3ea-67d3893d2509" containerName="maas-api"
Jul 13 09:44:11.882647 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:11.882485    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d843214d-92b9-4ff6-b564-2ea759e59066" containerName="main"
Jul 13 09:44:11.882647 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:11.882495    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f38d199-1487-4530-8848-670ecd96c1c7" containerName="maas-api"
Jul 13 09:44:11.885945 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:11.885925    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5"
Jul 13 09:44:11.888390 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:11.888371    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-c45f95-serving-cert\""
Jul 13 09:44:11.897329 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:11.897309    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5"]
Jul 13 09:44:11.901621 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:11.901599    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7-openshift-service-ca\") pod \"maas-api-e2e-api-a-c45f95-6674858b84-zvpl5\" (UID: \"44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5"
Jul 13 09:44:11.901749 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:11.901735    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7-maas-api-tls\") pod \"maas-api-e2e-api-a-c45f95-6674858b84-zvpl5\" (UID: \"44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5"
Jul 13 09:44:11.901822 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:11.901761    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnw8c\" (UniqueName: \"kubernetes.io/projected/44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7-kube-api-access-nnw8c\") pod \"maas-api-e2e-api-a-c45f95-6674858b84-zvpl5\" (UID: \"44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5"
Jul 13 09:44:12.002227 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:12.002198    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnw8c\" (UniqueName: \"kubernetes.io/projected/44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7-kube-api-access-nnw8c\") pod \"maas-api-e2e-api-a-c45f95-6674858b84-zvpl5\" (UID: \"44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5"
Jul 13 09:44:12.002376 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:12.002256    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7-openshift-service-ca\") pod \"maas-api-e2e-api-a-c45f95-6674858b84-zvpl5\" (UID: \"44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5"
Jul 13 09:44:12.002443 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:12.002385    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7-maas-api-tls\") pod \"maas-api-e2e-api-a-c45f95-6674858b84-zvpl5\" (UID: \"44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5"
Jul 13 09:44:12.002543 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:44:12.002516    2553 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-serving-cert: secret "maas-api-e2e-api-a-c45f95-serving-cert" not found
Jul 13 09:44:12.002675 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:44:12.002580    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7-maas-api-tls podName:44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7 nodeName:}" failed. No retries permitted until 2026-07-13 09:44:12.502562323 +0000 UTC m=+2141.580439556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7-maas-api-tls") pod "maas-api-e2e-api-a-c45f95-6674858b84-zvpl5" (UID: "44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7") : secret "maas-api-e2e-api-a-c45f95-serving-cert" not found
Jul 13 09:44:12.003018 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:12.002991    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7-openshift-service-ca\") pod \"maas-api-e2e-api-a-c45f95-6674858b84-zvpl5\" (UID: \"44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5"
Jul 13 09:44:12.014329 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:12.014300    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnw8c\" (UniqueName: \"kubernetes.io/projected/44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7-kube-api-access-nnw8c\") pod \"maas-api-e2e-api-a-c45f95-6674858b84-zvpl5\" (UID: \"44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5"
Jul 13 09:44:12.505884 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:12.505850    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7-maas-api-tls\") pod \"maas-api-e2e-api-a-c45f95-6674858b84-zvpl5\" (UID: \"44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5"
Jul 13 09:44:12.508276 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:12.508251    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7-maas-api-tls\") pod \"maas-api-e2e-api-a-c45f95-6674858b84-zvpl5\" (UID: \"44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5"
Jul 13 09:44:12.797966 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:12.797868    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5"
Jul 13 09:44:12.934183 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:12.934159    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5"]
Jul 13 09:44:12.935955 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:44:12.935929    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44aa3ea7_7a51_4b07_a5bf_dabfe17d8bf7.slice/crio-d837b48435462a80d11c5173b20ff0eaec15c7b1018f069488da73b6e4621171 WatchSource:0}: Error finding container d837b48435462a80d11c5173b20ff0eaec15c7b1018f069488da73b6e4621171: Status 404 returned error can't find the container with id d837b48435462a80d11c5173b20ff0eaec15c7b1018f069488da73b6e4621171
Jul 13 09:44:13.686225 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:13.686189    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5" event={"ID":"44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7","Type":"ContainerStarted","Data":"43d1897a07229506a4c0de6aca926fe032bc1ef69f6dba2e7ba872ba8b88eeea"}
Jul 13 09:44:13.686391 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:13.686249    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5" event={"ID":"44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7","Type":"ContainerStarted","Data":"d837b48435462a80d11c5173b20ff0eaec15c7b1018f069488da73b6e4621171"}
Jul 13 09:44:13.686391 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:13.686281    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5"
Jul 13 09:44:13.705942 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:13.705893    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5" podStartSLOduration=2.133879583 podStartE2EDuration="2.705879208s" totalImagesPullingTime="571.999625ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:44:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:44:13.704340647 +0000 UTC m=+2142.782217937" watchObservedRunningTime="2026-07-13 09:44:13.705879208 +0000 UTC m=+2142.783756463"
Jul 13 09:44:19.696847 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:19.696817    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5"
Jul 13 09:44:19.966576 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:19.966502    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc"]
Jul 13 09:44:19.970450 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:19.970430    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc"
Jul 13 09:44:19.973151 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:19.973133    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-b0f0c0-serving-cert\""
Jul 13 09:44:19.981101 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:19.981081    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc"]
Jul 13 09:44:20.069056 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:20.069020    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b95fm\" (UniqueName: \"kubernetes.io/projected/d6e7c560-6036-4a13-8711-8a6cb2be1757-kube-api-access-b95fm\") pod \"maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc\" (UID: \"d6e7c560-6036-4a13-8711-8a6cb2be1757\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc"
Jul 13 09:44:20.069056 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:20.069059    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6e7c560-6036-4a13-8711-8a6cb2be1757-openshift-service-ca\") pod \"maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc\" (UID: \"d6e7c560-6036-4a13-8711-8a6cb2be1757\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc"
Jul 13 09:44:20.069249 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:20.069079    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6e7c560-6036-4a13-8711-8a6cb2be1757-maas-api-tls\") pod \"maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc\" (UID: \"d6e7c560-6036-4a13-8711-8a6cb2be1757\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc"
Jul 13 09:44:20.169898 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:20.169852    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6e7c560-6036-4a13-8711-8a6cb2be1757-openshift-service-ca\") pod \"maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc\" (UID: \"d6e7c560-6036-4a13-8711-8a6cb2be1757\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc"
Jul 13 09:44:20.169898 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:20.169891    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6e7c560-6036-4a13-8711-8a6cb2be1757-maas-api-tls\") pod \"maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc\" (UID: \"d6e7c560-6036-4a13-8711-8a6cb2be1757\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc"
Jul 13 09:44:20.170109 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:20.169978    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b95fm\" (UniqueName: \"kubernetes.io/projected/d6e7c560-6036-4a13-8711-8a6cb2be1757-kube-api-access-b95fm\") pod \"maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc\" (UID: \"d6e7c560-6036-4a13-8711-8a6cb2be1757\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc"
Jul 13 09:44:20.170109 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:44:20.170073    2553 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-serving-cert: secret "maas-api-e2e-api-b-b0f0c0-serving-cert" not found
Jul 13 09:44:20.170179 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:44:20.170131    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6e7c560-6036-4a13-8711-8a6cb2be1757-maas-api-tls podName:d6e7c560-6036-4a13-8711-8a6cb2be1757 nodeName:}" failed. No retries permitted until 2026-07-13 09:44:20.670116376 +0000 UTC m=+2149.747993609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d6e7c560-6036-4a13-8711-8a6cb2be1757-maas-api-tls") pod "maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc" (UID: "d6e7c560-6036-4a13-8711-8a6cb2be1757") : secret "maas-api-e2e-api-b-b0f0c0-serving-cert" not found
Jul 13 09:44:20.170495 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:20.170477    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6e7c560-6036-4a13-8711-8a6cb2be1757-openshift-service-ca\") pod \"maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc\" (UID: \"d6e7c560-6036-4a13-8711-8a6cb2be1757\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc"
Jul 13 09:44:20.181522 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:20.181496    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b95fm\" (UniqueName: \"kubernetes.io/projected/d6e7c560-6036-4a13-8711-8a6cb2be1757-kube-api-access-b95fm\") pod \"maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc\" (UID: \"d6e7c560-6036-4a13-8711-8a6cb2be1757\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc"
Jul 13 09:44:20.675463 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:20.675434    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6e7c560-6036-4a13-8711-8a6cb2be1757-maas-api-tls\") pod \"maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc\" (UID: \"d6e7c560-6036-4a13-8711-8a6cb2be1757\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc"
Jul 13 09:44:20.677745 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:20.677720    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6e7c560-6036-4a13-8711-8a6cb2be1757-maas-api-tls\") pod \"maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc\" (UID: \"d6e7c560-6036-4a13-8711-8a6cb2be1757\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc"
Jul 13 09:44:20.881112 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:20.881079    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc"
Jul 13 09:44:21.013147 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:21.013118    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc"]
Jul 13 09:44:21.014890 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:44:21.014865    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6e7c560_6036_4a13_8711_8a6cb2be1757.slice/crio-f758145de2620be9da6d33151731a1ff2721bba85f8de4cc6b2d815667331727 WatchSource:0}: Error finding container f758145de2620be9da6d33151731a1ff2721bba85f8de4cc6b2d815667331727: Status 404 returned error can't find the container with id f758145de2620be9da6d33151731a1ff2721bba85f8de4cc6b2d815667331727
Jul 13 09:44:21.726600 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:21.726510    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc" event={"ID":"d6e7c560-6036-4a13-8711-8a6cb2be1757","Type":"ContainerStarted","Data":"9768220ef5d2f131dda47a7ac2758ea2460b0ff68d8e8020e6666f3273eb8cc8"}
Jul 13 09:44:21.726600 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:21.726568    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc" event={"ID":"d6e7c560-6036-4a13-8711-8a6cb2be1757","Type":"ContainerStarted","Data":"f758145de2620be9da6d33151731a1ff2721bba85f8de4cc6b2d815667331727"}
Jul 13 09:44:21.726600 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:21.726595    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc"
Jul 13 09:44:21.744834 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:21.744789    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc" podStartSLOduration=2.374797509 podStartE2EDuration="2.744774359s" totalImagesPullingTime="369.97685ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:44:21.742907914 +0000 UTC m=+2150.820785168" watchObservedRunningTime="2026-07-13 09:44:21.744774359 +0000 UTC m=+2150.822651647"
Jul 13 09:44:27.737120 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:27.737043    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc"
Jul 13 09:44:33.141987 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:33.141958    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5"]
Jul 13 09:44:33.142556 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:33.142173    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5" podUID="44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7" containerName="maas-api" containerID="cri-o://43d1897a07229506a4c0de6aca926fe032bc1ef69f6dba2e7ba872ba8b88eeea" gracePeriod=30
Jul 13 09:44:33.391407 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:33.391383    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5"
Jul 13 09:44:33.496166 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:33.496087    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnw8c\" (UniqueName: \"kubernetes.io/projected/44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7-kube-api-access-nnw8c\") pod \"44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7\" (UID: \"44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7\") "
Jul 13 09:44:33.496302 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:33.496186    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7-openshift-service-ca\") pod \"44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7\" (UID: \"44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7\") "
Jul 13 09:44:33.496355 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:33.496328    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7-maas-api-tls\") pod \"44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7\" (UID: \"44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7\") "
Jul 13 09:44:33.496595 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:33.496563    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7" (UID: "44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:44:33.498319 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:33.498295    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7" (UID: "44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:44:33.498464 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:33.498299    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7-kube-api-access-nnw8c" (OuterVolumeSpecName: "kube-api-access-nnw8c") pod "44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7" (UID: "44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7"). InnerVolumeSpecName "kube-api-access-nnw8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:44:33.597381 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:33.597343    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7-maas-api-tls\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:44:33.597381 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:33.597371    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnw8c\" (UniqueName: \"kubernetes.io/projected/44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7-kube-api-access-nnw8c\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:44:33.597381 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:33.597381    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7-openshift-service-ca\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:44:33.789524 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:33.789446    2553 generic.go:356] "Generic (PLEG): container finished" podID="44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7" containerID="43d1897a07229506a4c0de6aca926fe032bc1ef69f6dba2e7ba872ba8b88eeea" exitCode=0
Jul 13 09:44:33.789524 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:33.789501    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5"
Jul 13 09:44:33.789730 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:33.789498    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5" event={"ID":"44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7","Type":"ContainerDied","Data":"43d1897a07229506a4c0de6aca926fe032bc1ef69f6dba2e7ba872ba8b88eeea"}
Jul 13 09:44:33.789730 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:33.789624    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5" event={"ID":"44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7","Type":"ContainerDied","Data":"d837b48435462a80d11c5173b20ff0eaec15c7b1018f069488da73b6e4621171"}
Jul 13 09:44:33.789730 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:33.789645    2553 scope.go:117] "RemoveContainer" containerID="43d1897a07229506a4c0de6aca926fe032bc1ef69f6dba2e7ba872ba8b88eeea"
Jul 13 09:44:33.799715 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:33.799656    2553 scope.go:117] "RemoveContainer" containerID="43d1897a07229506a4c0de6aca926fe032bc1ef69f6dba2e7ba872ba8b88eeea"
Jul 13 09:44:33.800001 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:44:33.799983    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43d1897a07229506a4c0de6aca926fe032bc1ef69f6dba2e7ba872ba8b88eeea\": container with ID starting with 43d1897a07229506a4c0de6aca926fe032bc1ef69f6dba2e7ba872ba8b88eeea not found: ID does not exist" containerID="43d1897a07229506a4c0de6aca926fe032bc1ef69f6dba2e7ba872ba8b88eeea"
Jul 13 09:44:33.800058 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:33.800010    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43d1897a07229506a4c0de6aca926fe032bc1ef69f6dba2e7ba872ba8b88eeea"} err="failed to get container status \"43d1897a07229506a4c0de6aca926fe032bc1ef69f6dba2e7ba872ba8b88eeea\": rpc error: code = NotFound desc = could not find container \"43d1897a07229506a4c0de6aca926fe032bc1ef69f6dba2e7ba872ba8b88eeea\": container with ID starting with 43d1897a07229506a4c0de6aca926fe032bc1ef69f6dba2e7ba872ba8b88eeea not found: ID does not exist"
Jul 13 09:44:33.811936 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:33.811915    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5"]
Jul 13 09:44:33.816125 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:33.816095    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c45f95-6674858b84-zvpl5"]
Jul 13 09:44:35.481543 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:35.481510    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7" path="/var/lib/kubelet/pods/44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7/volumes"
Jul 13 09:44:39.911452 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:39.911403    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc"]
Jul 13 09:44:39.911933 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:39.911647    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc" podUID="d6e7c560-6036-4a13-8711-8a6cb2be1757" containerName="maas-api" containerID="cri-o://9768220ef5d2f131dda47a7ac2758ea2460b0ff68d8e8020e6666f3273eb8cc8" gracePeriod=30
Jul 13 09:44:40.161533 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:40.161477    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc"
Jul 13 09:44:40.260612 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:40.260582    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6e7c560-6036-4a13-8711-8a6cb2be1757-openshift-service-ca\") pod \"d6e7c560-6036-4a13-8711-8a6cb2be1757\" (UID: \"d6e7c560-6036-4a13-8711-8a6cb2be1757\") "
Jul 13 09:44:40.260790 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:40.260763    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b95fm\" (UniqueName: \"kubernetes.io/projected/d6e7c560-6036-4a13-8711-8a6cb2be1757-kube-api-access-b95fm\") pod \"d6e7c560-6036-4a13-8711-8a6cb2be1757\" (UID: \"d6e7c560-6036-4a13-8711-8a6cb2be1757\") "
Jul 13 09:44:40.260849 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:40.260833    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6e7c560-6036-4a13-8711-8a6cb2be1757-maas-api-tls\") pod \"d6e7c560-6036-4a13-8711-8a6cb2be1757\" (UID: \"d6e7c560-6036-4a13-8711-8a6cb2be1757\") "
Jul 13 09:44:40.260890 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:40.260870    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6e7c560-6036-4a13-8711-8a6cb2be1757-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d6e7c560-6036-4a13-8711-8a6cb2be1757" (UID: "d6e7c560-6036-4a13-8711-8a6cb2be1757"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:44:40.261244 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:40.261219    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6e7c560-6036-4a13-8711-8a6cb2be1757-openshift-service-ca\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:44:40.262886 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:40.262860    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6e7c560-6036-4a13-8711-8a6cb2be1757-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d6e7c560-6036-4a13-8711-8a6cb2be1757" (UID: "d6e7c560-6036-4a13-8711-8a6cb2be1757"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:44:40.262986 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:40.262918    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6e7c560-6036-4a13-8711-8a6cb2be1757-kube-api-access-b95fm" (OuterVolumeSpecName: "kube-api-access-b95fm") pod "d6e7c560-6036-4a13-8711-8a6cb2be1757" (UID: "d6e7c560-6036-4a13-8711-8a6cb2be1757"). InnerVolumeSpecName "kube-api-access-b95fm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:44:40.362796 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:40.362768    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b95fm\" (UniqueName: \"kubernetes.io/projected/d6e7c560-6036-4a13-8711-8a6cb2be1757-kube-api-access-b95fm\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:44:40.362796 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:40.362792    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6e7c560-6036-4a13-8711-8a6cb2be1757-maas-api-tls\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:44:40.827369 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:40.827335    2553 generic.go:356] "Generic (PLEG): container finished" podID="d6e7c560-6036-4a13-8711-8a6cb2be1757" containerID="9768220ef5d2f131dda47a7ac2758ea2460b0ff68d8e8020e6666f3273eb8cc8" exitCode=0
Jul 13 09:44:40.827534 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:40.827380    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc"
Jul 13 09:44:40.827534 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:40.827412    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc" event={"ID":"d6e7c560-6036-4a13-8711-8a6cb2be1757","Type":"ContainerDied","Data":"9768220ef5d2f131dda47a7ac2758ea2460b0ff68d8e8020e6666f3273eb8cc8"}
Jul 13 09:44:40.827534 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:40.827453    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc" event={"ID":"d6e7c560-6036-4a13-8711-8a6cb2be1757","Type":"ContainerDied","Data":"f758145de2620be9da6d33151731a1ff2721bba85f8de4cc6b2d815667331727"}
Jul 13 09:44:40.827534 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:40.827472    2553 scope.go:117] "RemoveContainer" containerID="9768220ef5d2f131dda47a7ac2758ea2460b0ff68d8e8020e6666f3273eb8cc8"
Jul 13 09:44:40.836525 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:40.836503    2553 scope.go:117] "RemoveContainer" containerID="9768220ef5d2f131dda47a7ac2758ea2460b0ff68d8e8020e6666f3273eb8cc8"
Jul 13 09:44:40.836795 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:44:40.836777    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9768220ef5d2f131dda47a7ac2758ea2460b0ff68d8e8020e6666f3273eb8cc8\": container with ID starting with 9768220ef5d2f131dda47a7ac2758ea2460b0ff68d8e8020e6666f3273eb8cc8 not found: ID does not exist" containerID="9768220ef5d2f131dda47a7ac2758ea2460b0ff68d8e8020e6666f3273eb8cc8"
Jul 13 09:44:40.836857 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:40.836806    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9768220ef5d2f131dda47a7ac2758ea2460b0ff68d8e8020e6666f3273eb8cc8"} err="failed to get container status \"9768220ef5d2f131dda47a7ac2758ea2460b0ff68d8e8020e6666f3273eb8cc8\": rpc error: code = NotFound desc = could not find container \"9768220ef5d2f131dda47a7ac2758ea2460b0ff68d8e8020e6666f3273eb8cc8\": container with ID starting with 9768220ef5d2f131dda47a7ac2758ea2460b0ff68d8e8020e6666f3273eb8cc8 not found: ID does not exist"
Jul 13 09:44:40.848506 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:40.848487    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc"]
Jul 13 09:44:40.852734 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:40.852717    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b0f0c0-56899c5d6b-vwmbc"]
Jul 13 09:44:41.483916 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:41.483871    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6e7c560-6036-4a13-8711-8a6cb2be1757" path="/var/lib/kubelet/pods/d6e7c560-6036-4a13-8711-8a6cb2be1757/volumes"
Jul 13 09:44:50.081968 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:50.081936    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x"]
Jul 13 09:44:50.082549 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:50.082529    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6e7c560-6036-4a13-8711-8a6cb2be1757" containerName="maas-api"
Jul 13 09:44:50.082641 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:50.082552    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6e7c560-6036-4a13-8711-8a6cb2be1757" containerName="maas-api"
Jul 13 09:44:50.082641 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:50.082592    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7" containerName="maas-api"
Jul 13 09:44:50.082641 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:50.082601    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7" containerName="maas-api"
Jul 13 09:44:50.082820 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:50.082747    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="44aa3ea7-7a51-4b07-a5bf-dabfe17d8bf7" containerName="maas-api"
Jul 13 09:44:50.082820 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:50.082769    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6e7c560-6036-4a13-8711-8a6cb2be1757" containerName="maas-api"
Jul 13 09:44:50.086233 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:50.086211    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x"
Jul 13 09:44:50.088803 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:50.088779    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-f77299-serving-cert\""
Jul 13 09:44:50.098456 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:50.098434    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x"]
Jul 13 09:44:50.147895 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:50.147861    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8czv\" (UniqueName: \"kubernetes.io/projected/2cc1f103-cc13-429c-b18f-7f0a6d67624d-kube-api-access-v8czv\") pod \"maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x\" (UID: \"2cc1f103-cc13-429c-b18f-7f0a6d67624d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x"
Jul 13 09:44:50.148074 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:50.147905    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cc1f103-cc13-429c-b18f-7f0a6d67624d-maas-api-tls\") pod \"maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x\" (UID: \"2cc1f103-cc13-429c-b18f-7f0a6d67624d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x"
Jul 13 09:44:50.148074 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:50.147930    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cc1f103-cc13-429c-b18f-7f0a6d67624d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x\" (UID: \"2cc1f103-cc13-429c-b18f-7f0a6d67624d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x"
Jul 13 09:44:50.249162 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:50.249113    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8czv\" (UniqueName: \"kubernetes.io/projected/2cc1f103-cc13-429c-b18f-7f0a6d67624d-kube-api-access-v8czv\") pod \"maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x\" (UID: \"2cc1f103-cc13-429c-b18f-7f0a6d67624d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x"
Jul 13 09:44:50.249340 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:50.249176    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cc1f103-cc13-429c-b18f-7f0a6d67624d-maas-api-tls\") pod \"maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x\" (UID: \"2cc1f103-cc13-429c-b18f-7f0a6d67624d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x"
Jul 13 09:44:50.249340 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:50.249199    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cc1f103-cc13-429c-b18f-7f0a6d67624d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x\" (UID: \"2cc1f103-cc13-429c-b18f-7f0a6d67624d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x"
Jul 13 09:44:50.249340 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:44:50.249316    2553 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-serving-cert: secret "maas-api-e2e-shared-a-f77299-serving-cert" not found
Jul 13 09:44:50.249442 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:44:50.249392    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc1f103-cc13-429c-b18f-7f0a6d67624d-maas-api-tls podName:2cc1f103-cc13-429c-b18f-7f0a6d67624d nodeName:}" failed. No retries permitted until 2026-07-13 09:44:50.749373535 +0000 UTC m=+2179.827250771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2cc1f103-cc13-429c-b18f-7f0a6d67624d-maas-api-tls") pod "maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x" (UID: "2cc1f103-cc13-429c-b18f-7f0a6d67624d") : secret "maas-api-e2e-shared-a-f77299-serving-cert" not found
Jul 13 09:44:50.249846 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:50.249829    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cc1f103-cc13-429c-b18f-7f0a6d67624d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x\" (UID: \"2cc1f103-cc13-429c-b18f-7f0a6d67624d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x"
Jul 13 09:44:50.260118 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:50.260076    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8czv\" (UniqueName: \"kubernetes.io/projected/2cc1f103-cc13-429c-b18f-7f0a6d67624d-kube-api-access-v8czv\") pod \"maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x\" (UID: \"2cc1f103-cc13-429c-b18f-7f0a6d67624d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x"
Jul 13 09:44:50.753037 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:50.753003    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cc1f103-cc13-429c-b18f-7f0a6d67624d-maas-api-tls\") pod \"maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x\" (UID: \"2cc1f103-cc13-429c-b18f-7f0a6d67624d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x"
Jul 13 09:44:50.755454 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:50.755428    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cc1f103-cc13-429c-b18f-7f0a6d67624d-maas-api-tls\") pod \"maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x\" (UID: \"2cc1f103-cc13-429c-b18f-7f0a6d67624d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x"
Jul 13 09:44:50.998130 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:50.998092    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x"
Jul 13 09:44:51.137656 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:51.137634    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x"]
Jul 13 09:44:51.140247 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:44:51.140222    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cc1f103_cc13_429c_b18f_7f0a6d67624d.slice/crio-68f74f9c24904d3aeaed68ecd454dc3e33462d1b6d74a1e33d1c00712e652154 WatchSource:0}: Error finding container 68f74f9c24904d3aeaed68ecd454dc3e33462d1b6d74a1e33d1c00712e652154: Status 404 returned error can't find the container with id 68f74f9c24904d3aeaed68ecd454dc3e33462d1b6d74a1e33d1c00712e652154
Jul 13 09:44:51.888995 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:51.888960    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x" event={"ID":"2cc1f103-cc13-429c-b18f-7f0a6d67624d","Type":"ContainerStarted","Data":"8ee2b3b81782d4a303a531f524f008b3fb3458694632591219bcc7aebe34df7a"}
Jul 13 09:44:51.889186 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:51.889014    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x" event={"ID":"2cc1f103-cc13-429c-b18f-7f0a6d67624d","Type":"ContainerStarted","Data":"68f74f9c24904d3aeaed68ecd454dc3e33462d1b6d74a1e33d1c00712e652154"}
Jul 13 09:44:51.889186 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:51.889047    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x"
Jul 13 09:44:51.908222 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:51.908174    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x" podStartSLOduration=1.425336762 podStartE2EDuration="1.9081603s" totalImagesPullingTime="482.823538ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:44:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:44:51.905908959 +0000 UTC m=+2180.983786232" watchObservedRunningTime="2026-07-13 09:44:51.9081603 +0000 UTC m=+2180.986037555"
Jul 13 09:44:57.899917 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:57.899890    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x"
Jul 13 09:44:58.264824 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:58.264744    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt"]
Jul 13 09:44:58.268506 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:58.268484    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt"
Jul 13 09:44:58.271411 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:58.271388    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-7bf32e-serving-cert\""
Jul 13 09:44:58.279960 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:58.279939    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt"]
Jul 13 09:44:58.326040 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:58.326009    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c6hm\" (UniqueName: \"kubernetes.io/projected/a3ceedba-4a3e-425a-beef-97de3b8480ca-kube-api-access-5c6hm\") pod \"maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt\" (UID: \"a3ceedba-4a3e-425a-beef-97de3b8480ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt"
Jul 13 09:44:58.326180 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:58.326068    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3ceedba-4a3e-425a-beef-97de3b8480ca-openshift-service-ca\") pod \"maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt\" (UID: \"a3ceedba-4a3e-425a-beef-97de3b8480ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt"
Jul 13 09:44:58.326180 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:58.326125    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3ceedba-4a3e-425a-beef-97de3b8480ca-maas-api-tls\") pod \"maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt\" (UID: \"a3ceedba-4a3e-425a-beef-97de3b8480ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt"
Jul 13 09:44:58.427538 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:58.427505    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3ceedba-4a3e-425a-beef-97de3b8480ca-openshift-service-ca\") pod \"maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt\" (UID: \"a3ceedba-4a3e-425a-beef-97de3b8480ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt"
Jul 13 09:44:58.427681 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:58.427574    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3ceedba-4a3e-425a-beef-97de3b8480ca-maas-api-tls\") pod \"maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt\" (UID: \"a3ceedba-4a3e-425a-beef-97de3b8480ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt"
Jul 13 09:44:58.427681 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:58.427624    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c6hm\" (UniqueName: \"kubernetes.io/projected/a3ceedba-4a3e-425a-beef-97de3b8480ca-kube-api-access-5c6hm\") pod \"maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt\" (UID: \"a3ceedba-4a3e-425a-beef-97de3b8480ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt"
Jul 13 09:44:58.428116 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:58.428093    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3ceedba-4a3e-425a-beef-97de3b8480ca-openshift-service-ca\") pod \"maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt\" (UID: \"a3ceedba-4a3e-425a-beef-97de3b8480ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt"
Jul 13 09:44:58.430006 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:58.429983    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3ceedba-4a3e-425a-beef-97de3b8480ca-maas-api-tls\") pod \"maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt\" (UID: \"a3ceedba-4a3e-425a-beef-97de3b8480ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt"
Jul 13 09:44:58.438011 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:58.437989    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c6hm\" (UniqueName: \"kubernetes.io/projected/a3ceedba-4a3e-425a-beef-97de3b8480ca-kube-api-access-5c6hm\") pod \"maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt\" (UID: \"a3ceedba-4a3e-425a-beef-97de3b8480ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt"
Jul 13 09:44:58.579448 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:58.579374    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt"
Jul 13 09:44:58.742111 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:58.742084    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt"]
Jul 13 09:44:58.743891 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:44:58.743864    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3ceedba_4a3e_425a_beef_97de3b8480ca.slice/crio-c8dd590d22156b9161a476c7bd1b2723d120dff6bba7ec90d944ac296bc26e0d WatchSource:0}: Error finding container c8dd590d22156b9161a476c7bd1b2723d120dff6bba7ec90d944ac296bc26e0d: Status 404 returned error can't find the container with id c8dd590d22156b9161a476c7bd1b2723d120dff6bba7ec90d944ac296bc26e0d
Jul 13 09:44:58.925506 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:58.925476    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt" event={"ID":"a3ceedba-4a3e-425a-beef-97de3b8480ca","Type":"ContainerStarted","Data":"c8dd590d22156b9161a476c7bd1b2723d120dff6bba7ec90d944ac296bc26e0d"}
Jul 13 09:44:59.932013 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:59.931975    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt" event={"ID":"a3ceedba-4a3e-425a-beef-97de3b8480ca","Type":"ContainerStarted","Data":"c00f0906fc5600e7099a3dfcc806e3b5b38398f5310489a25c41e89195491afa"}
Jul 13 09:44:59.932448 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:59.932059    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt"
Jul 13 09:44:59.950839 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:44:59.950795    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt" podStartSLOduration=1.510872829 podStartE2EDuration="1.950780487s" totalImagesPullingTime="439.907658ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:44:59.94858966 +0000 UTC m=+2189.026466937" watchObservedRunningTime="2026-07-13 09:44:59.950780487 +0000 UTC m=+2189.028657742"
Jul 13 09:45:00.149429 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:00.149389    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42"]
Jul 13 09:45:00.153050 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:00.153028    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42"
Jul 13 09:45:00.164463 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:00.164437    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42"]
Jul 13 09:45:00.245635 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:00.245561    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjkjd\" (UniqueName: \"kubernetes.io/projected/9d8169c4-5032-4612-b30a-e1e3b8610711-kube-api-access-kjkjd\") pod \"maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42\" (UID: \"9d8169c4-5032-4612-b30a-e1e3b8610711\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42"
Jul 13 09:45:00.346674 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:00.346644    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjkjd\" (UniqueName: \"kubernetes.io/projected/9d8169c4-5032-4612-b30a-e1e3b8610711-kube-api-access-kjkjd\") pod \"maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42\" (UID: \"9d8169c4-5032-4612-b30a-e1e3b8610711\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42"
Jul 13 09:45:00.355451 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:00.355416    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjkjd\" (UniqueName: \"kubernetes.io/projected/9d8169c4-5032-4612-b30a-e1e3b8610711-kube-api-access-kjkjd\") pod \"maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42\" (UID: \"9d8169c4-5032-4612-b30a-e1e3b8610711\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42"
Jul 13 09:45:00.464057 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:00.464023    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42"
Jul 13 09:45:00.602002 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:00.601978    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42"]
Jul 13 09:45:00.604440 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:45:00.604415    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d8169c4_5032_4612_b30a_e1e3b8610711.slice/crio-e81701ddc3524e7d06bf58d7cd087dd5233187fe2b5f0581697f696361b84e41 WatchSource:0}: Error finding container e81701ddc3524e7d06bf58d7cd087dd5233187fe2b5f0581697f696361b84e41: Status 404 returned error can't find the container with id e81701ddc3524e7d06bf58d7cd087dd5233187fe2b5f0581697f696361b84e41
Jul 13 09:45:00.938021 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:00.937985    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42" event={"ID":"9d8169c4-5032-4612-b30a-e1e3b8610711","Type":"ContainerStarted","Data":"e81701ddc3524e7d06bf58d7cd087dd5233187fe2b5f0581697f696361b84e41"}
Jul 13 09:45:03.955437 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:03.955405    2553 generic.go:356] "Generic (PLEG): container finished" podID="9d8169c4-5032-4612-b30a-e1e3b8610711" containerID="174d8a2dfb87a3fbbbd970c2c7c8b017af2998e7e7f506257d241d0248d2fddd" exitCode=7
Jul 13 09:45:03.955994 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:03.955491    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42" event={"ID":"9d8169c4-5032-4612-b30a-e1e3b8610711","Type":"ContainerDied","Data":"174d8a2dfb87a3fbbbd970c2c7c8b017af2998e7e7f506257d241d0248d2fddd"}
Jul 13 09:45:03.955994 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:03.955626    2553 scope.go:117] "RemoveContainer" containerID="174d8a2dfb87a3fbbbd970c2c7c8b017af2998e7e7f506257d241d0248d2fddd"
Jul 13 09:45:04.962487 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:04.962457    2553 generic.go:356] "Generic (PLEG): container finished" podID="9d8169c4-5032-4612-b30a-e1e3b8610711" containerID="6398b91d4e95a9c1a59a36de9148a1935703c84efb52be489a938c2ba7ebbc43" exitCode=7
Jul 13 09:45:04.962918 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:04.962545    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42" event={"ID":"9d8169c4-5032-4612-b30a-e1e3b8610711","Type":"ContainerDied","Data":"6398b91d4e95a9c1a59a36de9148a1935703c84efb52be489a938c2ba7ebbc43"}
Jul 13 09:45:04.962918 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:04.962597    2553 scope.go:117] "RemoveContainer" containerID="174d8a2dfb87a3fbbbd970c2c7c8b017af2998e7e7f506257d241d0248d2fddd"
Jul 13 09:45:04.962918 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:04.962872    2553 scope.go:117] "RemoveContainer" containerID="6398b91d4e95a9c1a59a36de9148a1935703c84efb52be489a938c2ba7ebbc43"
Jul 13 09:45:04.963118 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:45:04.963096    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42_odh-ai-gateway-infra(9d8169c4-5032-4612-b30a-e1e3b8610711)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42" podUID="9d8169c4-5032-4612-b30a-e1e3b8610711"
Jul 13 09:45:05.944070 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:05.944043    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt"
Jul 13 09:45:05.969650 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:05.969619    2553 scope.go:117] "RemoveContainer" containerID="6398b91d4e95a9c1a59a36de9148a1935703c84efb52be489a938c2ba7ebbc43"
Jul 13 09:45:05.970028 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:45:05.969875    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42_odh-ai-gateway-infra(9d8169c4-5032-4612-b30a-e1e3b8610711)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42" podUID="9d8169c4-5032-4612-b30a-e1e3b8610711"
Jul 13 09:45:20.476395 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:20.476361    2553 scope.go:117] "RemoveContainer" containerID="6398b91d4e95a9c1a59a36de9148a1935703c84efb52be489a938c2ba7ebbc43"
Jul 13 09:45:21.045276 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:21.045244    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42" event={"ID":"9d8169c4-5032-4612-b30a-e1e3b8610711","Type":"ContainerStarted","Data":"da9ab449de9b180d74558bf4ce6b4bb452f8043939fdf76a0ac29a27c0e3842f"}
Jul 13 09:45:21.062560 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:21.062472    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42" podStartSLOduration=18.745887949 podStartE2EDuration="21.062457893s" totalImagesPullingTime="2.316569944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:45:21.061724149 +0000 UTC m=+2210.139601416" watchObservedRunningTime="2026-07-13 09:45:21.062457893 +0000 UTC m=+2210.140335147"
Jul 13 09:45:22.072823 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:22.072786    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42"]
Jul 13 09:45:22.073277 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:22.073002    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42" podUID="9d8169c4-5032-4612-b30a-e1e3b8610711" containerName="cleanup" containerID="cri-o://da9ab449de9b180d74558bf4ce6b4bb452f8043939fdf76a0ac29a27c0e3842f" gracePeriod=30
Jul 13 09:45:52.203658 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:52.203626    2553 generic.go:356] "Generic (PLEG): container finished" podID="9d8169c4-5032-4612-b30a-e1e3b8610711" containerID="da9ab449de9b180d74558bf4ce6b4bb452f8043939fdf76a0ac29a27c0e3842f" exitCode=137
Jul 13 09:45:52.204066 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:52.203709    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42" event={"ID":"9d8169c4-5032-4612-b30a-e1e3b8610711","Type":"ContainerDied","Data":"da9ab449de9b180d74558bf4ce6b4bb452f8043939fdf76a0ac29a27c0e3842f"}
Jul 13 09:45:52.204066 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:52.203762    2553 scope.go:117] "RemoveContainer" containerID="6398b91d4e95a9c1a59a36de9148a1935703c84efb52be489a938c2ba7ebbc43"
Jul 13 09:45:52.260813 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:52.260789    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42"
Jul 13 09:45:52.341218 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:52.341125    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjkjd\" (UniqueName: \"kubernetes.io/projected/9d8169c4-5032-4612-b30a-e1e3b8610711-kube-api-access-kjkjd\") pod \"9d8169c4-5032-4612-b30a-e1e3b8610711\" (UID: \"9d8169c4-5032-4612-b30a-e1e3b8610711\") "
Jul 13 09:45:52.343193 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:52.343161    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d8169c4-5032-4612-b30a-e1e3b8610711-kube-api-access-kjkjd" (OuterVolumeSpecName: "kube-api-access-kjkjd") pod "9d8169c4-5032-4612-b30a-e1e3b8610711" (UID: "9d8169c4-5032-4612-b30a-e1e3b8610711"). InnerVolumeSpecName "kube-api-access-kjkjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:45:52.442591 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:52.442565    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjkjd\" (UniqueName: \"kubernetes.io/projected/9d8169c4-5032-4612-b30a-e1e3b8610711-kube-api-access-kjkjd\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:45:53.209364 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:53.209284    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42"
Jul 13 09:45:53.209364 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:53.209314    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42" event={"ID":"9d8169c4-5032-4612-b30a-e1e3b8610711","Type":"ContainerDied","Data":"e81701ddc3524e7d06bf58d7cd087dd5233187fe2b5f0581697f696361b84e41"}
Jul 13 09:45:53.209364 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:53.209364    2553 scope.go:117] "RemoveContainer" containerID="da9ab449de9b180d74558bf4ce6b4bb452f8043939fdf76a0ac29a27c0e3842f"
Jul 13 09:45:53.232786 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:53.232764    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42"]
Jul 13 09:45:53.236304 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:53.236284    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7bf32e-29732265-jhw42"]
Jul 13 09:45:53.482159 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:45:53.482083    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d8169c4-5032-4612-b30a-e1e3b8610711" path="/var/lib/kubelet/pods/9d8169c4-5032-4612-b30a-e1e3b8610711/volumes"
Jul 13 09:48:08.065361 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:08.065325    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x"]
Jul 13 09:48:08.066000 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:08.065550    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x" podUID="2cc1f103-cc13-429c-b18f-7f0a6d67624d" containerName="maas-api" containerID="cri-o://8ee2b3b81782d4a303a531f524f008b3fb3458694632591219bcc7aebe34df7a" gracePeriod=30
Jul 13 09:48:08.323460 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:08.323404    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x"
Jul 13 09:48:08.396662 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:08.396631    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cc1f103-cc13-429c-b18f-7f0a6d67624d-openshift-service-ca\") pod \"2cc1f103-cc13-429c-b18f-7f0a6d67624d\" (UID: \"2cc1f103-cc13-429c-b18f-7f0a6d67624d\") "
Jul 13 09:48:08.396839 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:08.396671    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cc1f103-cc13-429c-b18f-7f0a6d67624d-maas-api-tls\") pod \"2cc1f103-cc13-429c-b18f-7f0a6d67624d\" (UID: \"2cc1f103-cc13-429c-b18f-7f0a6d67624d\") "
Jul 13 09:48:08.396839 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:08.396757    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8czv\" (UniqueName: \"kubernetes.io/projected/2cc1f103-cc13-429c-b18f-7f0a6d67624d-kube-api-access-v8czv\") pod \"2cc1f103-cc13-429c-b18f-7f0a6d67624d\" (UID: \"2cc1f103-cc13-429c-b18f-7f0a6d67624d\") "
Jul 13 09:48:08.397039 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:08.397014    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cc1f103-cc13-429c-b18f-7f0a6d67624d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2cc1f103-cc13-429c-b18f-7f0a6d67624d" (UID: "2cc1f103-cc13-429c-b18f-7f0a6d67624d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:48:08.397156 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:08.397104    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cc1f103-cc13-429c-b18f-7f0a6d67624d-openshift-service-ca\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:48:08.399083 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:08.399050    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cc1f103-cc13-429c-b18f-7f0a6d67624d-kube-api-access-v8czv" (OuterVolumeSpecName: "kube-api-access-v8czv") pod "2cc1f103-cc13-429c-b18f-7f0a6d67624d" (UID: "2cc1f103-cc13-429c-b18f-7f0a6d67624d"). InnerVolumeSpecName "kube-api-access-v8czv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:48:08.399353 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:08.399323    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cc1f103-cc13-429c-b18f-7f0a6d67624d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2cc1f103-cc13-429c-b18f-7f0a6d67624d" (UID: "2cc1f103-cc13-429c-b18f-7f0a6d67624d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:48:08.498512 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:08.498474    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cc1f103-cc13-429c-b18f-7f0a6d67624d-maas-api-tls\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:48:08.498512 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:08.498512    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8czv\" (UniqueName: \"kubernetes.io/projected/2cc1f103-cc13-429c-b18f-7f0a6d67624d-kube-api-access-v8czv\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:48:08.897120 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:08.897090    2553 generic.go:356] "Generic (PLEG): container finished" podID="2cc1f103-cc13-429c-b18f-7f0a6d67624d" containerID="8ee2b3b81782d4a303a531f524f008b3fb3458694632591219bcc7aebe34df7a" exitCode=0
Jul 13 09:48:08.897268 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:08.897142    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x"
Jul 13 09:48:08.897268 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:08.897168    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x" event={"ID":"2cc1f103-cc13-429c-b18f-7f0a6d67624d","Type":"ContainerDied","Data":"8ee2b3b81782d4a303a531f524f008b3fb3458694632591219bcc7aebe34df7a"}
Jul 13 09:48:08.897268 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:08.897212    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x" event={"ID":"2cc1f103-cc13-429c-b18f-7f0a6d67624d","Type":"ContainerDied","Data":"68f74f9c24904d3aeaed68ecd454dc3e33462d1b6d74a1e33d1c00712e652154"}
Jul 13 09:48:08.897268 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:08.897232    2553 scope.go:117] "RemoveContainer" containerID="8ee2b3b81782d4a303a531f524f008b3fb3458694632591219bcc7aebe34df7a"
Jul 13 09:48:08.909022 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:08.908987    2553 scope.go:117] "RemoveContainer" containerID="8ee2b3b81782d4a303a531f524f008b3fb3458694632591219bcc7aebe34df7a"
Jul 13 09:48:08.909343 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:48:08.909320    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ee2b3b81782d4a303a531f524f008b3fb3458694632591219bcc7aebe34df7a\": container with ID starting with 8ee2b3b81782d4a303a531f524f008b3fb3458694632591219bcc7aebe34df7a not found: ID does not exist" containerID="8ee2b3b81782d4a303a531f524f008b3fb3458694632591219bcc7aebe34df7a"
Jul 13 09:48:08.909446 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:08.909353    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ee2b3b81782d4a303a531f524f008b3fb3458694632591219bcc7aebe34df7a"} err="failed to get container status \"8ee2b3b81782d4a303a531f524f008b3fb3458694632591219bcc7aebe34df7a\": rpc error: code = NotFound desc = could not find container \"8ee2b3b81782d4a303a531f524f008b3fb3458694632591219bcc7aebe34df7a\": container with ID starting with 8ee2b3b81782d4a303a531f524f008b3fb3458694632591219bcc7aebe34df7a not found: ID does not exist"
Jul 13 09:48:08.920572 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:08.920547    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x"]
Jul 13 09:48:08.923937 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:08.923915    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f77299-5d54dc6469-qtx8x"]
Jul 13 09:48:09.482242 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:09.482213    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cc1f103-cc13-429c-b18f-7f0a6d67624d" path="/var/lib/kubelet/pods/2cc1f103-cc13-429c-b18f-7f0a6d67624d/volumes"
Jul 13 09:48:15.275276 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:15.275238    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt"]
Jul 13 09:48:15.275709 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:15.275464    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt" podUID="a3ceedba-4a3e-425a-beef-97de3b8480ca" containerName="maas-api" containerID="cri-o://c00f0906fc5600e7099a3dfcc806e3b5b38398f5310489a25c41e89195491afa" gracePeriod=30
Jul 13 09:48:15.526787 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:15.526729    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt"
Jul 13 09:48:15.564219 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:15.564183    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3ceedba-4a3e-425a-beef-97de3b8480ca-maas-api-tls\") pod \"a3ceedba-4a3e-425a-beef-97de3b8480ca\" (UID: \"a3ceedba-4a3e-425a-beef-97de3b8480ca\") "
Jul 13 09:48:15.564385 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:15.564258    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5c6hm\" (UniqueName: \"kubernetes.io/projected/a3ceedba-4a3e-425a-beef-97de3b8480ca-kube-api-access-5c6hm\") pod \"a3ceedba-4a3e-425a-beef-97de3b8480ca\" (UID: \"a3ceedba-4a3e-425a-beef-97de3b8480ca\") "
Jul 13 09:48:15.564385 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:15.564377    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3ceedba-4a3e-425a-beef-97de3b8480ca-openshift-service-ca\") pod \"a3ceedba-4a3e-425a-beef-97de3b8480ca\" (UID: \"a3ceedba-4a3e-425a-beef-97de3b8480ca\") "
Jul 13 09:48:15.564756 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:15.564730    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3ceedba-4a3e-425a-beef-97de3b8480ca-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a3ceedba-4a3e-425a-beef-97de3b8480ca" (UID: "a3ceedba-4a3e-425a-beef-97de3b8480ca"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 09:48:15.566208 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:15.566181    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3ceedba-4a3e-425a-beef-97de3b8480ca-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a3ceedba-4a3e-425a-beef-97de3b8480ca" (UID: "a3ceedba-4a3e-425a-beef-97de3b8480ca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 09:48:15.566334 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:15.566315    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3ceedba-4a3e-425a-beef-97de3b8480ca-kube-api-access-5c6hm" (OuterVolumeSpecName: "kube-api-access-5c6hm") pod "a3ceedba-4a3e-425a-beef-97de3b8480ca" (UID: "a3ceedba-4a3e-425a-beef-97de3b8480ca"). InnerVolumeSpecName "kube-api-access-5c6hm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 09:48:15.665531 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:15.665495    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5c6hm\" (UniqueName: \"kubernetes.io/projected/a3ceedba-4a3e-425a-beef-97de3b8480ca-kube-api-access-5c6hm\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:48:15.665531 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:15.665525    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3ceedba-4a3e-425a-beef-97de3b8480ca-openshift-service-ca\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:48:15.665531 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:15.665534    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3ceedba-4a3e-425a-beef-97de3b8480ca-maas-api-tls\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\""
Jul 13 09:48:15.932967 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:15.932934    2553 generic.go:356] "Generic (PLEG): container finished" podID="a3ceedba-4a3e-425a-beef-97de3b8480ca" containerID="c00f0906fc5600e7099a3dfcc806e3b5b38398f5310489a25c41e89195491afa" exitCode=0
Jul 13 09:48:15.933160 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:15.932978    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt"
Jul 13 09:48:15.933160 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:15.933028    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt" event={"ID":"a3ceedba-4a3e-425a-beef-97de3b8480ca","Type":"ContainerDied","Data":"c00f0906fc5600e7099a3dfcc806e3b5b38398f5310489a25c41e89195491afa"}
Jul 13 09:48:15.933160 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:15.933082    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt" event={"ID":"a3ceedba-4a3e-425a-beef-97de3b8480ca","Type":"ContainerDied","Data":"c8dd590d22156b9161a476c7bd1b2723d120dff6bba7ec90d944ac296bc26e0d"}
Jul 13 09:48:15.933160 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:15.933111    2553 scope.go:117] "RemoveContainer" containerID="c00f0906fc5600e7099a3dfcc806e3b5b38398f5310489a25c41e89195491afa"
Jul 13 09:48:15.942135 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:15.942115    2553 scope.go:117] "RemoveContainer" containerID="c00f0906fc5600e7099a3dfcc806e3b5b38398f5310489a25c41e89195491afa"
Jul 13 09:48:15.942395 ip-10-0-138-89 kubenswrapper[2553]: E0713 09:48:15.942380    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c00f0906fc5600e7099a3dfcc806e3b5b38398f5310489a25c41e89195491afa\": container with ID starting with c00f0906fc5600e7099a3dfcc806e3b5b38398f5310489a25c41e89195491afa not found: ID does not exist" containerID="c00f0906fc5600e7099a3dfcc806e3b5b38398f5310489a25c41e89195491afa"
Jul 13 09:48:15.942436 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:15.942404    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c00f0906fc5600e7099a3dfcc806e3b5b38398f5310489a25c41e89195491afa"} err="failed to get container status \"c00f0906fc5600e7099a3dfcc806e3b5b38398f5310489a25c41e89195491afa\": rpc error: code = NotFound desc = could not find container \"c00f0906fc5600e7099a3dfcc806e3b5b38398f5310489a25c41e89195491afa\": container with ID starting with c00f0906fc5600e7099a3dfcc806e3b5b38398f5310489a25c41e89195491afa not found: ID does not exist"
Jul 13 09:48:15.954766 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:15.954744    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt"]
Jul 13 09:48:15.960872 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:15.960854    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7bf32e-98fbf78b5-l89pt"]
Jul 13 09:48:17.482330 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:17.482298    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3ceedba-4a3e-425a-beef-97de3b8480ca" path="/var/lib/kubelet/pods/a3ceedba-4a3e-425a-beef-97de3b8480ca/volumes"
Jul 13 09:48:26.886478 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:26.886449    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-5npln_82ae27fd-3e9f-4fa9-bc94-83bd4dff36d0/manager/0.log"
Jul 13 09:48:27.007147 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:27.007117    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f896dbf74-84666_2874d41a-520f-44c4-80b3-2e049b5414dd/manager/0.log"
Jul 13 09:48:27.511281 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:27.511251    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q_2d3f44ac-d847-4f9f-8ea3-5f82d254366b/copy-manifests/0.log"
Jul 13 09:48:27.519559 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:27.519529    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q_2d3f44ac-d847-4f9f-8ea3-5f82d254366b/manager/0.log"
Jul 13 09:48:30.568098 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:30.568062    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d64b4d488-lpn8f_171fa8f1-9ca4-4ef8-b75c-d5997171c893/kube-auth-proxy/0.log"
Jul 13 09:48:30.835170 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:30.835085    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-cvclt_e44fc8bf-2e78-4fa2-a24b-180b6c802e33/payload-pre-processing/0.log"
Jul 13 09:48:30.961420 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:30.961393    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-4whx5_27008fcf-4b88-4933-a51a-819d575679d0/payload-processing/0.log"
Jul 13 09:48:31.449875 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:31.449835    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-qmgfm_a428fb3d-c0d1-4bb9-ba0b-8ff9aaaf85b6/main/0.log"
Jul 13 09:48:31.680916 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:31.680892    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tmbbk_d1243d30-2275-43cc-b5a9-a8de5a66beed/console-operator/1.log"
Jul 13 09:48:31.689028 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:31.689008    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t558b_db263c9c-ef1c-4e74-968b-f8822c77dffc/ovn-acl-logging/0.log"
Jul 13 09:48:31.691551 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:31.691534    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tmbbk_d1243d30-2275-43cc-b5a9-a8de5a66beed/console-operator/1.log"
Jul 13 09:48:31.698523 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:31.698508    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t558b_db263c9c-ef1c-4e74-968b-f8822c77dffc/ovn-acl-logging/0.log"
Jul 13 09:48:31.708276 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:31.708219    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-qzdmm_3c53eef8-7905-4d31-aba2-e7178a9799d5/main/0.log"
Jul 13 09:48:36.750991 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.750952    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gb9tq/must-gather-j42qd"]
Jul 13 09:48:36.751565 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.751545    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cc1f103-cc13-429c-b18f-7f0a6d67624d" containerName="maas-api"
Jul 13 09:48:36.751653 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.751567    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cc1f103-cc13-429c-b18f-7f0a6d67624d" containerName="maas-api"
Jul 13 09:48:36.751653 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.751589    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d8169c4-5032-4612-b30a-e1e3b8610711" containerName="cleanup"
Jul 13 09:48:36.751653 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.751597    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d8169c4-5032-4612-b30a-e1e3b8610711" containerName="cleanup"
Jul 13 09:48:36.751653 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.751629    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d8169c4-5032-4612-b30a-e1e3b8610711" containerName="cleanup"
Jul 13 09:48:36.751653 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.751638    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d8169c4-5032-4612-b30a-e1e3b8610711" containerName="cleanup"
Jul 13 09:48:36.751940 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.751658    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3ceedba-4a3e-425a-beef-97de3b8480ca" containerName="maas-api"
Jul 13 09:48:36.751940 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.751666    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3ceedba-4a3e-425a-beef-97de3b8480ca" containerName="maas-api"
Jul 13 09:48:36.751940 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.751787    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d8169c4-5032-4612-b30a-e1e3b8610711" containerName="cleanup"
Jul 13 09:48:36.751940 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.751799    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3ceedba-4a3e-425a-beef-97de3b8480ca" containerName="maas-api"
Jul 13 09:48:36.751940 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.751812    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cc1f103-cc13-429c-b18f-7f0a6d67624d" containerName="maas-api"
Jul 13 09:48:36.751940 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.751825    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d8169c4-5032-4612-b30a-e1e3b8610711" containerName="cleanup"
Jul 13 09:48:36.751940 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.751834    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d8169c4-5032-4612-b30a-e1e3b8610711" containerName="cleanup"
Jul 13 09:48:36.751940 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.751931    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d8169c4-5032-4612-b30a-e1e3b8610711" containerName="cleanup"
Jul 13 09:48:36.751940 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.751940    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d8169c4-5032-4612-b30a-e1e3b8610711" containerName="cleanup"
Jul 13 09:48:36.756874 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.756853    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gb9tq/must-gather-j42qd"
Jul 13 09:48:36.759882 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.759859    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gb9tq\"/\"default-dockercfg-6th65\""
Jul 13 09:48:36.760163 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.760143    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gb9tq\"/\"openshift-service-ca.crt\""
Jul 13 09:48:36.760163 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.760157    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gb9tq\"/\"kube-root-ca.crt\""
Jul 13 09:48:36.774214 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.774193    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gb9tq/must-gather-j42qd"]
Jul 13 09:48:36.859137 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.859113    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0be7ac38-a783-4c14-9717-812ee9082dc8-must-gather-output\") pod \"must-gather-j42qd\" (UID: \"0be7ac38-a783-4c14-9717-812ee9082dc8\") " pod="openshift-must-gather-gb9tq/must-gather-j42qd"
Jul 13 09:48:36.859267 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.859158    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nflq9\" (UniqueName: \"kubernetes.io/projected/0be7ac38-a783-4c14-9717-812ee9082dc8-kube-api-access-nflq9\") pod \"must-gather-j42qd\" (UID: \"0be7ac38-a783-4c14-9717-812ee9082dc8\") " pod="openshift-must-gather-gb9tq/must-gather-j42qd"
Jul 13 09:48:36.960135 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.960102    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0be7ac38-a783-4c14-9717-812ee9082dc8-must-gather-output\") pod \"must-gather-j42qd\" (UID: \"0be7ac38-a783-4c14-9717-812ee9082dc8\") " pod="openshift-must-gather-gb9tq/must-gather-j42qd"
Jul 13 09:48:36.960254 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.960150    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nflq9\" (UniqueName: \"kubernetes.io/projected/0be7ac38-a783-4c14-9717-812ee9082dc8-kube-api-access-nflq9\") pod \"must-gather-j42qd\" (UID: \"0be7ac38-a783-4c14-9717-812ee9082dc8\") " pod="openshift-must-gather-gb9tq/must-gather-j42qd"
Jul 13 09:48:36.960415 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.960397    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0be7ac38-a783-4c14-9717-812ee9082dc8-must-gather-output\") pod \"must-gather-j42qd\" (UID: \"0be7ac38-a783-4c14-9717-812ee9082dc8\") " pod="openshift-must-gather-gb9tq/must-gather-j42qd"
Jul 13 09:48:36.970416 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:36.970396    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nflq9\" (UniqueName: \"kubernetes.io/projected/0be7ac38-a783-4c14-9717-812ee9082dc8-kube-api-access-nflq9\") pod \"must-gather-j42qd\" (UID: \"0be7ac38-a783-4c14-9717-812ee9082dc8\") " pod="openshift-must-gather-gb9tq/must-gather-j42qd"
Jul 13 09:48:37.080471 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:37.080410    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gb9tq/must-gather-j42qd"
Jul 13 09:48:37.210453 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:37.210429    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gb9tq/must-gather-j42qd"]
Jul 13 09:48:37.212125 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:48:37.212099    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0be7ac38_a783_4c14_9717_812ee9082dc8.slice/crio-d48942202dbdcd6c8911355f420bcc8a169ff23f89eb9e063faaa8b4d8352d37 WatchSource:0}: Error finding container d48942202dbdcd6c8911355f420bcc8a169ff23f89eb9e063faaa8b4d8352d37: Status 404 returned error can't find the container with id d48942202dbdcd6c8911355f420bcc8a169ff23f89eb9e063faaa8b4d8352d37
Jul 13 09:48:37.214081 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:37.214065    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 09:48:38.041350 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:38.041326    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gb9tq/must-gather-j42qd" event={"ID":"0be7ac38-a783-4c14-9717-812ee9082dc8","Type":"ContainerStarted","Data":"d48942202dbdcd6c8911355f420bcc8a169ff23f89eb9e063faaa8b4d8352d37"}
Jul 13 09:48:39.052648 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:39.052607    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gb9tq/must-gather-j42qd" event={"ID":"0be7ac38-a783-4c14-9717-812ee9082dc8","Type":"ContainerStarted","Data":"f6d2a3a7ad261fae165d842744e7fbd300c76385a175827f51b95c7148247810"}
Jul 13 09:48:39.053271 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:39.052660    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gb9tq/must-gather-j42qd" event={"ID":"0be7ac38-a783-4c14-9717-812ee9082dc8","Type":"ContainerStarted","Data":"4f5827237adf04a307997fe8db00f7218922b830ca50479f8a39a52b4edb3622"}
Jul 13 09:48:39.080110 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:39.080048    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gb9tq/must-gather-j42qd" podStartSLOduration=2.327895525 podStartE2EDuration="3.080027744s" totalImagesPullingTime="752.132219ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 09:48:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:48:39.077309461 +0000 UTC m=+2408.155186719" watchObservedRunningTime="2026-07-13 09:48:39.080027744 +0000 UTC m=+2408.157904999"
Jul 13 09:48:39.522043 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:39.522005    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hg679_96008549-14fd-453d-9236-a601e1010005/global-pull-secret-syncer/0.log"
Jul 13 09:48:39.700238 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:39.700205    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nh9gf_835e2516-31bc-47e3-b1e1-b212f41fd914/konnectivity-agent/0.log"
Jul 13 09:48:39.823082 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:39.822999    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-89.ec2.internal_3faaf0080471f3cd3415287075e9ebbd/haproxy/0.log"
Jul 13 09:48:46.957065 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:46.957020    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0982d942-fa73-4586-8da4-223657639e15/alertmanager/0.log"
Jul 13 09:48:46.990214 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:46.990183    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0982d942-fa73-4586-8da4-223657639e15/config-reloader/0.log"
Jul 13 09:48:47.016416 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:47.016354    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0982d942-fa73-4586-8da4-223657639e15/kube-rbac-proxy-web/0.log"
Jul 13 09:48:47.042843 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:47.042814    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0982d942-fa73-4586-8da4-223657639e15/kube-rbac-proxy/0.log"
Jul 13 09:48:47.065525 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:47.065497    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0982d942-fa73-4586-8da4-223657639e15/kube-rbac-proxy-metric/0.log"
Jul 13 09:48:47.094296 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:47.094273    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0982d942-fa73-4586-8da4-223657639e15/prom-label-proxy/0.log"
Jul 13 09:48:47.131056 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:47.131024    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0982d942-fa73-4586-8da4-223657639e15/init-config-reloader/0.log"
Jul 13 09:48:47.193291 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:47.193263    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-5wkhg_12891776-d5ad-4b5e-9c3c-4285c514c6af/cluster-monitoring-operator/0.log"
Jul 13 09:48:47.291611 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:47.291536    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-788976c5cc-tsjgz_dfc4a4f8-b3df-4835-a630-7a3492f447b6/metrics-server/0.log"
Jul 13 09:48:47.346636 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:47.346595    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6rcf6_6d983bfe-dbbb-4d67-a99b-919992b833dd/node-exporter/0.log"
Jul 13 09:48:47.369910 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:47.369881    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6rcf6_6d983bfe-dbbb-4d67-a99b-919992b833dd/kube-rbac-proxy/0.log"
Jul 13 09:48:47.397028 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:47.397005    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6rcf6_6d983bfe-dbbb-4d67-a99b-919992b833dd/init-textfile/0.log"
Jul 13 09:48:47.711735 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:47.711670    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21d6eba6-a86c-4184-8814-118f030747c4/prometheus/0.log"
Jul 13 09:48:47.743510 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:47.743482    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21d6eba6-a86c-4184-8814-118f030747c4/config-reloader/0.log"
Jul 13 09:48:47.775636 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:47.775599    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21d6eba6-a86c-4184-8814-118f030747c4/thanos-sidecar/0.log"
Jul 13 09:48:47.801702 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:47.801654    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21d6eba6-a86c-4184-8814-118f030747c4/kube-rbac-proxy-web/0.log"
Jul 13 09:48:47.826083 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:47.826057    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21d6eba6-a86c-4184-8814-118f030747c4/kube-rbac-proxy/0.log"
Jul 13 09:48:47.847624 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:47.847592    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21d6eba6-a86c-4184-8814-118f030747c4/kube-rbac-proxy-thanos/0.log"
Jul 13 09:48:47.874286 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:47.874256    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21d6eba6-a86c-4184-8814-118f030747c4/init-config-reloader/0.log"
Jul 13 09:48:47.976537 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:47.976438    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-dd54f88f8-xdf46_bb1ba9c8-fa6c-45b8-a579-f83351272d38/telemeter-client/0.log"
Jul 13 09:48:47.998651 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:47.998613    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-dd54f88f8-xdf46_bb1ba9c8-fa6c-45b8-a579-f83351272d38/reload/0.log"
Jul 13 09:48:48.020794 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:48.020755    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-dd54f88f8-xdf46_bb1ba9c8-fa6c-45b8-a579-f83351272d38/kube-rbac-proxy/0.log"
Jul 13 09:48:48.070967 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:48.070921    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8554754dcd-wkrvw_3c4ce238-518c-42b7-8eda-6d2b61880898/thanos-query/0.log"
Jul 13 09:48:48.092412 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:48.092384    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8554754dcd-wkrvw_3c4ce238-518c-42b7-8eda-6d2b61880898/kube-rbac-proxy-web/0.log"
Jul 13 09:48:48.113676 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:48.113648    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8554754dcd-wkrvw_3c4ce238-518c-42b7-8eda-6d2b61880898/kube-rbac-proxy/0.log"
Jul 13 09:48:48.134770 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:48.134722    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8554754dcd-wkrvw_3c4ce238-518c-42b7-8eda-6d2b61880898/prom-label-proxy/0.log"
Jul 13 09:48:48.155976 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:48.155947    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8554754dcd-wkrvw_3c4ce238-518c-42b7-8eda-6d2b61880898/kube-rbac-proxy-rules/0.log"
Jul 13 09:48:48.179384 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:48.179346    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8554754dcd-wkrvw_3c4ce238-518c-42b7-8eda-6d2b61880898/kube-rbac-proxy-metrics/0.log"
Jul 13 09:48:49.301711 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:49.301656    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-hfv8k_6485b81d-8dac-4cab-8f1a-653e0116ba01/networking-console-plugin/0.log"
Jul 13 09:48:49.507561 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:49.507527    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gb9tq/perf-node-gather-daemonset-7sx8f"]
Jul 13 09:48:49.515699 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:49.515659    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gb9tq/perf-node-gather-daemonset-7sx8f"
Jul 13 09:48:49.528304 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:49.528277    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gb9tq/perf-node-gather-daemonset-7sx8f"]
Jul 13 09:48:49.619701 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:49.619603    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9bbd159-ccca-4597-960f-0ab3839f1b1e-lib-modules\") pod \"perf-node-gather-daemonset-7sx8f\" (UID: \"c9bbd159-ccca-4597-960f-0ab3839f1b1e\") " pod="openshift-must-gather-gb9tq/perf-node-gather-daemonset-7sx8f"
Jul 13 09:48:49.620013 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:49.619994    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9bbd159-ccca-4597-960f-0ab3839f1b1e-sys\") pod \"perf-node-gather-daemonset-7sx8f\" (UID: \"c9bbd159-ccca-4597-960f-0ab3839f1b1e\") " pod="openshift-must-gather-gb9tq/perf-node-gather-daemonset-7sx8f"
Jul 13 09:48:49.620346 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:49.620314    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-src9k\" (UniqueName: \"kubernetes.io/projected/c9bbd159-ccca-4597-960f-0ab3839f1b1e-kube-api-access-src9k\") pod \"perf-node-gather-daemonset-7sx8f\" (UID: \"c9bbd159-ccca-4597-960f-0ab3839f1b1e\") " pod="openshift-must-gather-gb9tq/perf-node-gather-daemonset-7sx8f"
Jul 13 09:48:49.620550 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:49.620533    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c9bbd159-ccca-4597-960f-0ab3839f1b1e-proc\") pod \"perf-node-gather-daemonset-7sx8f\" (UID: \"c9bbd159-ccca-4597-960f-0ab3839f1b1e\") " pod="openshift-must-gather-gb9tq/perf-node-gather-daemonset-7sx8f"
Jul 13 09:48:49.620832 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:49.620795    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c9bbd159-ccca-4597-960f-0ab3839f1b1e-podres\") pod \"perf-node-gather-daemonset-7sx8f\" (UID: \"c9bbd159-ccca-4597-960f-0ab3839f1b1e\") " pod="openshift-must-gather-gb9tq/perf-node-gather-daemonset-7sx8f"
Jul 13 09:48:49.722424 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:49.722381    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9bbd159-ccca-4597-960f-0ab3839f1b1e-sys\") pod \"perf-node-gather-daemonset-7sx8f\" (UID: \"c9bbd159-ccca-4597-960f-0ab3839f1b1e\") " pod="openshift-must-gather-gb9tq/perf-node-gather-daemonset-7sx8f"
Jul 13 09:48:49.722633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:49.722501    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-src9k\" (UniqueName: \"kubernetes.io/projected/c9bbd159-ccca-4597-960f-0ab3839f1b1e-kube-api-access-src9k\") pod \"perf-node-gather-daemonset-7sx8f\" (UID: \"c9bbd159-ccca-4597-960f-0ab3839f1b1e\") " pod="openshift-must-gather-gb9tq/perf-node-gather-daemonset-7sx8f"
Jul 13 09:48:49.722633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:49.722548    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c9bbd159-ccca-4597-960f-0ab3839f1b1e-proc\") pod \"perf-node-gather-daemonset-7sx8f\" (UID: \"c9bbd159-ccca-4597-960f-0ab3839f1b1e\") " pod="openshift-must-gather-gb9tq/perf-node-gather-daemonset-7sx8f"
Jul 13 09:48:49.722633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:49.722569    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c9bbd159-ccca-4597-960f-0ab3839f1b1e-podres\") pod \"perf-node-gather-daemonset-7sx8f\" (UID: \"c9bbd159-ccca-4597-960f-0ab3839f1b1e\") " pod="openshift-must-gather-gb9tq/perf-node-gather-daemonset-7sx8f"
Jul 13 09:48:49.722633 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:49.722616    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9bbd159-ccca-4597-960f-0ab3839f1b1e-lib-modules\") pod \"perf-node-gather-daemonset-7sx8f\" (UID: \"c9bbd159-ccca-4597-960f-0ab3839f1b1e\") " pod="openshift-must-gather-gb9tq/perf-node-gather-daemonset-7sx8f"
Jul 13 09:48:49.722925 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:49.722836    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9bbd159-ccca-4597-960f-0ab3839f1b1e-lib-modules\") pod \"perf-node-gather-daemonset-7sx8f\" (UID: \"c9bbd159-ccca-4597-960f-0ab3839f1b1e\") " pod="openshift-must-gather-gb9tq/perf-node-gather-daemonset-7sx8f"
Jul 13 09:48:49.722925 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:49.722896    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9bbd159-ccca-4597-960f-0ab3839f1b1e-sys\") pod \"perf-node-gather-daemonset-7sx8f\" (UID: \"c9bbd159-ccca-4597-960f-0ab3839f1b1e\") " pod="openshift-must-gather-gb9tq/perf-node-gather-daemonset-7sx8f"
Jul 13 09:48:49.723265 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:49.723237    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c9bbd159-ccca-4597-960f-0ab3839f1b1e-proc\") pod \"perf-node-gather-daemonset-7sx8f\" (UID: \"c9bbd159-ccca-4597-960f-0ab3839f1b1e\") " pod="openshift-must-gather-gb9tq/perf-node-gather-daemonset-7sx8f"
Jul 13 09:48:49.723364 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:49.723346    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c9bbd159-ccca-4597-960f-0ab3839f1b1e-podres\") pod \"perf-node-gather-daemonset-7sx8f\" (UID: \"c9bbd159-ccca-4597-960f-0ab3839f1b1e\") " pod="openshift-must-gather-gb9tq/perf-node-gather-daemonset-7sx8f"
Jul 13 09:48:49.732192 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:49.732162    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-src9k\" (UniqueName: \"kubernetes.io/projected/c9bbd159-ccca-4597-960f-0ab3839f1b1e-kube-api-access-src9k\") pod \"perf-node-gather-daemonset-7sx8f\" (UID: \"c9bbd159-ccca-4597-960f-0ab3839f1b1e\") " pod="openshift-must-gather-gb9tq/perf-node-gather-daemonset-7sx8f"
Jul 13 09:48:49.827432 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:49.827400    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gb9tq/perf-node-gather-daemonset-7sx8f"
Jul 13 09:48:50.025075 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:50.022500    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gb9tq/perf-node-gather-daemonset-7sx8f"]
Jul 13 09:48:50.028292 ip-10-0-138-89 kubenswrapper[2553]: W0713 09:48:50.028255    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc9bbd159_ccca_4597_960f_0ab3839f1b1e.slice/crio-95b6f1dece6ace893b6eb234dcd8f235630d3d650b30a842533176778a21b967 WatchSource:0}: Error finding container 95b6f1dece6ace893b6eb234dcd8f235630d3d650b30a842533176778a21b967: Status 404 returned error can't find the container with id 95b6f1dece6ace893b6eb234dcd8f235630d3d650b30a842533176778a21b967
Jul 13 09:48:50.044172 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:50.042901    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tmbbk_d1243d30-2275-43cc-b5a9-a8de5a66beed/console-operator/1.log"
Jul 13 09:48:50.056770 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:50.056743    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-tmbbk_d1243d30-2275-43cc-b5a9-a8de5a66beed/console-operator/2.log"
Jul 13 09:48:50.164997 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:50.164908    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gb9tq/perf-node-gather-daemonset-7sx8f" event={"ID":"c9bbd159-ccca-4597-960f-0ab3839f1b1e","Type":"ContainerStarted","Data":"f56fab78b34f495f26f5b76fd7cf0312f2748f9e137db52a9285ba8446de2929"}
Jul 13 09:48:50.165155 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:50.165012    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gb9tq/perf-node-gather-daemonset-7sx8f" event={"ID":"c9bbd159-ccca-4597-960f-0ab3839f1b1e","Type":"ContainerStarted","Data":"95b6f1dece6ace893b6eb234dcd8f235630d3d650b30a842533176778a21b967"}
Jul 13 09:48:50.165394 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:50.165373    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gb9tq/perf-node-gather-daemonset-7sx8f"
Jul 13 09:48:50.190360 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:50.190299    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gb9tq/perf-node-gather-daemonset-7sx8f" podStartSLOduration=1.19027833 podStartE2EDuration="1.19027833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 09:48:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 09:48:50.188446984 +0000 UTC m=+2419.266324239" watchObservedRunningTime="2026-07-13 09:48:50.19027833 +0000 UTC m=+2419.268155586"
Jul 13 09:48:50.612611 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:50.612518    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-kgcg7_d706057a-268b-42c4-ac26-67fd4330f9d9/download-server/0.log"
Jul 13 09:48:51.243340 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:51.243286    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-d6lgc_aea82529-432f-4d72-af45-cdb9d24228a9/volume-data-source-validator/0.log"
Jul 13 09:48:52.475575 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:52.475544    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vrnb8_382f0622-3acb-41c7-a231-3b688b8c212e/dns/0.log"
Jul 13 09:48:52.498672 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:52.498645    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vrnb8_382f0622-3acb-41c7-a231-3b688b8c212e/kube-rbac-proxy/0.log"
Jul 13 09:48:52.523590 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:52.523568    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-btlb4_85e00737-0392-4971-b5bb-0eb2d8f14e5f/dns-node-resolver/0.log"
Jul 13 09:48:53.176634 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:53.176534    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9qslx_f477a535-0e7f-45e0-9889-b30d8e06abc0/node-ca/0.log"
Jul 13 09:48:54.373337 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:54.373307    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d64b4d488-lpn8f_171fa8f1-9ca4-4ef8-b75c-d5997171c893/kube-auth-proxy/0.log"
Jul 13 09:48:54.512830 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:54.512802    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-cvclt_e44fc8bf-2e78-4fa2-a24b-180b6c802e33/payload-pre-processing/0.log"
Jul 13 09:48:54.599289 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:54.599259    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-4whx5_27008fcf-4b88-4933-a51a-819d575679d0/payload-processing/0.log"
Jul 13 09:48:55.381733 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:55.381702    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8wp8c_5e28a544-d35a-4036-bab4-87432d8949f9/serve-healthcheck-canary/0.log"
Jul 13 09:48:55.917483 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:55.917444    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-k6qjb_c63b1cf8-18be-4229-88d4-de471969a548/insights-operator/0.log"
Jul 13 09:48:55.917986 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:55.917962    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-k6qjb_c63b1cf8-18be-4229-88d4-de471969a548/insights-operator/1.log"
Jul 13 09:48:56.096331 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:56.096305    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tgl6j_1badcca5-97df-45ad-ae75-116c7d043994/kube-rbac-proxy/0.log"
Jul 13 09:48:56.121715 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:56.121674    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tgl6j_1badcca5-97df-45ad-ae75-116c7d043994/exporter/0.log"
Jul 13 09:48:56.146510 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:56.146483    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tgl6j_1badcca5-97df-45ad-ae75-116c7d043994/extractor/0.log"
Jul 13 09:48:56.184448 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:56.184384    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gb9tq/perf-node-gather-daemonset-7sx8f"
Jul 13 09:48:58.583474 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:58.583096    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-5npln_82ae27fd-3e9f-4fa9-bc94-83bd4dff36d0/manager/0.log"
Jul 13 09:48:58.713826 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:58.713793    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f896dbf74-84666_2874d41a-520f-44c4-80b3-2e049b5414dd/manager/0.log"
Jul 13 09:48:58.999148 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:58.999062    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q_2d3f44ac-d847-4f9f-8ea3-5f82d254366b/manager/0.log"
Jul 13 09:48:59.024297 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:59.024253    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cd9bbfd9f-jqt5q_2d3f44ac-d847-4f9f-8ea3-5f82d254366b/copy-manifests/0.log"
Jul 13 09:48:59.788521 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:59.788446    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d64b4d488-lpn8f_171fa8f1-9ca4-4ef8-b75c-d5997171c893/kube-auth-proxy/0.log"
Jul 13 09:48:59.919455 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:59.919402    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-cvclt_e44fc8bf-2e78-4fa2-a24b-180b6c802e33/payload-pre-processing/0.log"
Jul 13 09:48:59.979789 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:48:59.979761    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-4whx5_27008fcf-4b88-4933-a51a-819d575679d0/payload-processing/0.log"
Jul 13 09:49:00.348533 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:49:00.348493    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-68884f4547-bxlqc_02bfba49-377f-4c02-b3f5-9fceddd3802c/manager/0.log"
Jul 13 09:49:01.416843 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:49:01.416814    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d64b4d488-lpn8f_171fa8f1-9ca4-4ef8-b75c-d5997171c893/kube-auth-proxy/0.log"
Jul 13 09:49:01.553242 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:49:01.553207    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-cvclt_e44fc8bf-2e78-4fa2-a24b-180b6c802e33/payload-pre-processing/0.log"
Jul 13 09:49:01.621790 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:49:01.621657    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-4whx5_27008fcf-4b88-4933-a51a-819d575679d0/payload-processing/0.log"
Jul 13 09:49:05.152572 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:49:05.152545    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-2q9cd_e9a2b636-7547-473a-a5e1-692f5fc76f01/migrator/0.log"
Jul 13 09:49:05.172321 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:49:05.172300    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-2q9cd_e9a2b636-7547-473a-a5e1-692f5fc76f01/graceful-termination/0.log"
Jul 13 09:49:05.534750 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:49:05.534658    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-ddnmg_7f918b89-58ae-4153-a7ba-f73ae80030db/kube-storage-version-migrator-operator/1.log"
Jul 13 09:49:05.536553 ip-10-0-138-89 kubenswrapper[2553]: I0713 09:49:05.536526    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-ddnmg_7f918b89-58ae-4153-a7ba-f73ae80030db/kube-storage-version-migrator-operator/0.log"