Jul 09 01:38:21.648271 ip-10-0-138-200 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 01:38:23.887640 ip-10-0-138-200 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 01:38:23.887640 ip-10-0-138-200 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 01:38:23.887640 ip-10-0-138-200 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 01:38:23.887640 ip-10-0-138-200 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 01:38:23.887640 ip-10-0-138-200 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 01:38:23.887640 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.857230    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 01:38:23.887640 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863650    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 01:38:23.887640 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863663    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 01:38:23.887640 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863666    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 01:38:23.887640 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863670    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 01:38:23.887640 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863675    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 01:38:23.887640 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863678    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 01:38:23.887640 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863681    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 01:38:23.887640 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863684    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 01:38:23.889249 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863686    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 01:38:23.889249 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863689    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 01:38:23.889249 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863693    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 01:38:23.889249 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863695    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 01:38:23.889249 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863698    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 01:38:23.889249 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863703    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 01:38:23.889249 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863707    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 01:38:23.889249 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863711    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 01:38:23.889249 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863714    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 01:38:23.889249 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863718    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 01:38:23.889249 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863721    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 01:38:23.889249 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863724    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 01:38:23.889249 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863727    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 01:38:23.889249 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863731    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 01:38:23.889249 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863736    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 01:38:23.889249 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863740    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 01:38:23.889249 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863744    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 01:38:23.889249 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863747    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 01:38:23.889249 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863751    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 01:38:23.891353 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863754    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 01:38:23.891353 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863757    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 01:38:23.891353 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863760    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 01:38:23.891353 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863763    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 01:38:23.891353 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863765    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 01:38:23.891353 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863769    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 01:38:23.891353 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863771    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 01:38:23.891353 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863774    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 01:38:23.891353 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863777    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 01:38:23.891353 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863780    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 01:38:23.891353 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863783    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 01:38:23.891353 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863785    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 01:38:23.891353 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863788    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 01:38:23.891353 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863791    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 01:38:23.891353 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863794    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 01:38:23.891353 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863796    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 01:38:23.891353 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863799    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 01:38:23.891353 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863801    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 01:38:23.891353 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863804    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 01:38:23.891353 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863807    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 01:38:23.892480 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863809    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 01:38:23.892480 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863812    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 01:38:23.892480 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863815    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 01:38:23.892480 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863819    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 01:38:23.892480 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863821    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 01:38:23.892480 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863825    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 01:38:23.892480 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863829    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 01:38:23.892480 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863832    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 01:38:23.892480 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863836    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 01:38:23.892480 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863840    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 01:38:23.892480 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863844    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 01:38:23.892480 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863847    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 01:38:23.892480 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863850    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 01:38:23.892480 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863853    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 01:38:23.892480 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863856    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 01:38:23.892480 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863859    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 01:38:23.892480 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863863    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 01:38:23.892480 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863865    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 01:38:23.892480 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863868    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 01:38:23.894119 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863871    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 01:38:23.894119 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863874    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 01:38:23.894119 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863876    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 01:38:23.894119 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863879    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 01:38:23.894119 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863882    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 01:38:23.894119 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863888    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 01:38:23.894119 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863891    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 01:38:23.894119 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863894    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 01:38:23.894119 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863897    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 01:38:23.894119 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863899    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 01:38:23.894119 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863902    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 01:38:23.894119 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863905    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 01:38:23.894119 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863908    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 01:38:23.894119 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863910    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 01:38:23.894119 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863913    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 01:38:23.894119 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863916    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 01:38:23.894119 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863918    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 01:38:23.894119 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863921    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 01:38:23.894119 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863923    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 01:38:23.894119 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863926    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 01:38:23.895231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863929    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 01:38:23.895231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863932    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 01:38:23.895231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863935    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 01:38:23.895231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863937    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 01:38:23.895231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863941    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 01:38:23.895231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863944    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 01:38:23.895231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863947    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 01:38:23.895231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863950    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 01:38:23.895231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863952    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 01:38:23.895231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863955    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 01:38:23.895231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863958    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 01:38:23.895231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863960    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 01:38:23.895231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.863963    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 01:38:23.895231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865799    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 01:38:23.895231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865806    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 01:38:23.895231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865810    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 01:38:23.895231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865814    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 01:38:23.895231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865818    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 01:38:23.895231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865822    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 01:38:23.896909 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865827    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 01:38:23.896909 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865831    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 01:38:23.896909 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865834    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 01:38:23.896909 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865837    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 01:38:23.896909 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865840    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 01:38:23.896909 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865843    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 01:38:23.896909 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865846    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 01:38:23.896909 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865849    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 01:38:23.896909 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865851    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 01:38:23.896909 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865854    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 01:38:23.896909 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865858    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 01:38:23.896909 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865861    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 01:38:23.896909 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865864    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 01:38:23.896909 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865867    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 01:38:23.896909 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865871    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 01:38:23.896909 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865874    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 01:38:23.896909 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865877    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 01:38:23.896909 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865880    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 01:38:23.896909 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865883    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 01:38:23.896909 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865886    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 01:38:23.899493 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865889    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 01:38:23.899493 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865892    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 01:38:23.899493 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865894    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 01:38:23.899493 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865897    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 01:38:23.899493 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865900    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 01:38:23.899493 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865903    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 01:38:23.899493 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865906    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 01:38:23.899493 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865909    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 01:38:23.899493 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865911    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 01:38:23.899493 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865914    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 01:38:23.899493 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865917    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 01:38:23.899493 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865919    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 01:38:23.899493 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865923    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 01:38:23.899493 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865925    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 01:38:23.899493 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865928    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 01:38:23.899493 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865931    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 01:38:23.899493 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865934    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 01:38:23.899493 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865937    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 01:38:23.899493 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865939    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 01:38:23.899493 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865942    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 01:38:23.900393 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865945    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 01:38:23.900393 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865947    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 01:38:23.900393 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865950    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 01:38:23.900393 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865952    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 01:38:23.900393 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865956    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 01:38:23.900393 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865959    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 01:38:23.900393 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865962    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 01:38:23.900393 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865965    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 01:38:23.900393 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865968    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 01:38:23.900393 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865973    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 01:38:23.900393 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865976    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 01:38:23.900393 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865979    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 01:38:23.900393 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865982    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 01:38:23.900393 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865986    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 01:38:23.900393 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865990    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 01:38:23.900393 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865993    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 01:38:23.900393 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865996    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 01:38:23.900393 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.865999    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 01:38:23.900393 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866002    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 01:38:23.901201 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866005    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 01:38:23.901201 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866007    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 01:38:23.901201 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866010    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 01:38:23.901201 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866013    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 01:38:23.901201 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866015    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 01:38:23.901201 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866018    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 01:38:23.901201 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866022    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 01:38:23.901201 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866025    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 01:38:23.901201 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866027    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 01:38:23.901201 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866030    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 01:38:23.901201 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866033    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 01:38:23.901201 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866035    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 01:38:23.901201 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866038    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 01:38:23.901201 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866041    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 01:38:23.901201 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866044    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 01:38:23.901201 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866046    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 01:38:23.901201 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866049    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 01:38:23.901201 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866052    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 01:38:23.901201 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866055    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 01:38:23.901954 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866059    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 01:38:23.901954 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866062    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 01:38:23.901954 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866065    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 01:38:23.901954 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866070    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 01:38:23.901954 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866073    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 01:38:23.901954 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866076    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 01:38:23.901954 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866079    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 01:38:23.901954 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866081    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 01:38:23.901954 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866084    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 01:38:23.901954 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866104    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 01:38:23.901954 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866108    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 01:38:23.901954 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866111    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 01:38:23.901954 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866114    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 01:38:23.901954 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866117    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 01:38:23.901954 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866120    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 01:38:23.901954 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866582    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 01:38:23.901954 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866588    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 01:38:23.901954 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866592    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 01:38:23.901954 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866595    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 01:38:23.901954 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866599    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 01:38:23.902756 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866602    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 01:38:23.902756 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866605    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 01:38:23.902756 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866607    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 01:38:23.902756 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866610    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 01:38:23.902756 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866613    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 01:38:23.902756 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866616    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 01:38:23.902756 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866619    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 01:38:23.902756 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866622    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 01:38:23.902756 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866624    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 01:38:23.902756 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866627    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 01:38:23.902756 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866630    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 01:38:23.902756 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866633    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 01:38:23.902756 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866636    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 01:38:23.902756 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866638    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 01:38:23.902756 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866641    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 01:38:23.902756 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866646    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 01:38:23.902756 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866648    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 01:38:23.902756 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866651    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 01:38:23.902756 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866655    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 01:38:23.902756 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866658    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 01:38:23.903625 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866660    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 01:38:23.903625 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866663    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 01:38:23.903625 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866668    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 01:38:23.903625 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866671    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 01:38:23.903625 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866675    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 01:38:23.903625 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866678    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 01:38:23.903625 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866681    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 01:38:23.903625 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866687    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 01:38:23.903625 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866690    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 01:38:23.903625 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866693    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 01:38:23.903625 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866696    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 01:38:23.903625 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866698    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 01:38:23.903625 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866702    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 01:38:23.903625 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866705    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 01:38:23.903625 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866708    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 01:38:23.903625 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866710    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 01:38:23.903625 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866713    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 01:38:23.903625 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866716    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 01:38:23.903625 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866719    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 01:38:23.904402 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866722    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 01:38:23.904402 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866725    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 01:38:23.904402 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866727    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 01:38:23.904402 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866730    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 01:38:23.904402 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866733    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 01:38:23.904402 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866735    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 01:38:23.904402 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866738    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 01:38:23.904402 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866741    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 01:38:23.904402 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866745    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 01:38:23.904402 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866748    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 01:38:23.904402 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866751    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 01:38:23.904402 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866754    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 01:38:23.904402 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866757    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 01:38:23.904402 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866759    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 01:38:23.904402 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866764    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 01:38:23.904402 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866768    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 01:38:23.904402 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866771    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 01:38:23.904402 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866774    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 01:38:23.904402 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866777    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 01:38:23.905174 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866780    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 01:38:23.905174 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866785    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 01:38:23.905174 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866788    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 01:38:23.905174 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866791    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 01:38:23.905174 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866793    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 01:38:23.905174 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866796    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 01:38:23.905174 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866799    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 01:38:23.905174 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866802    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 01:38:23.905174 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866804    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 01:38:23.905174 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866807    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 01:38:23.905174 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866810    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 01:38:23.905174 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866812    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 01:38:23.905174 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866815    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 01:38:23.905174 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866818    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 01:38:23.905174 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866821    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 01:38:23.905174 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866823    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 01:38:23.905174 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866826    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 01:38:23.905174 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866829    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 01:38:23.905174 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866831    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 01:38:23.905174 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866834    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 01:38:23.905977 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866837    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 01:38:23.905977 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866842    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 01:38:23.905977 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866845    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 01:38:23.905977 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866848    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 01:38:23.905977 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866851    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 01:38:23.905977 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866854    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 01:38:23.905977 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866857    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 01:38:23.905977 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866859    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 01:38:23.905977 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866862    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 01:38:23.905977 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866865    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 01:38:23.905977 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866868    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 01:38:23.905977 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866870    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 01:38:23.905977 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866873    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 01:38:23.905977 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866878    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 01:38:23.905977 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866880    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 01:38:23.905977 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.866883    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 01:38:23.905977 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.866960    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 01:38:23.905977 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.866967    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 01:38:23.905977 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.866973    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 01:38:23.905977 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.866978    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 01:38:23.905977 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.866983    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 01:38:23.906656 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.866986    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 01:38:23.906656 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.866991    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 01:38:23.906656 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.866995    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 01:38:23.906656 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.866998    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 01:38:23.906656 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867002    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 01:38:23.906656 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867005    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 01:38:23.906656 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867009    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 01:38:23.906656 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867012    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 01:38:23.906656 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867015    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 09 01:38:23.906656 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867018    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 01:38:23.906656 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867022    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 09 01:38:23.906656 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867025    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 01:38:23.906656 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867029    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 01:38:23.906656 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867035    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 09 01:38:23.906656 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867038    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 01:38:23.906656 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867041    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 01:38:23.906656 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867044    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 01:38:23.906656 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867048    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 01:38:23.906656 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867052    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 01:38:23.906656 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867055    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 01:38:23.906656 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867058    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 01:38:23.906656 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867062    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 01:38:23.906656 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867065    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 01:38:23.906656 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867068    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 01:38:23.907291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867072    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 01:38:23.907291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867076    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 01:38:23.907291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867079    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 01:38:23.907291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867084    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 01:38:23.907291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867103    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 01:38:23.907291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867108    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 01:38:23.907291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867111    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 01:38:23.907291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867114    2562 flags.go:64] FLAG: --enable-server="true"
Jul 09 01:38:23.907291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867118    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 01:38:23.907291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867122    2562 flags.go:64] FLAG: --event-burst="100"
Jul 09 01:38:23.907291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867126    2562 flags.go:64] FLAG: --event-qps="50"
Jul 09 01:38:23.907291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867129    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 01:38:23.907291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867132    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 01:38:23.907291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867135    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 09 01:38:23.907291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867139    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 01:38:23.907291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867142    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 01:38:23.907291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867146    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 01:38:23.907291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867149    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 09 01:38:23.907291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867152    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 01:38:23.907291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867155    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 01:38:23.907291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867160    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 01:38:23.907291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867163    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 01:38:23.907291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867166    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 01:38:23.907291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867169    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 01:38:23.907291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867172    2562 flags.go:64] FLAG: --feature-gates=""
Jul 09 01:38:23.908019 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867182    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 01:38:23.908019 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867186    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 01:38:23.908019 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867189    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 01:38:23.908019 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867192    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 01:38:23.908019 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867195    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 01:38:23.908019 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867198    2562 flags.go:64] FLAG: --help="false"
Jul 09 01:38:23.908019 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867202    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-138-200.ec2.internal"
Jul 09 01:38:23.908019 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867207    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 01:38:23.908019 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867210    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 01:38:23.908019 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867213    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 01:38:23.908019 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867217    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 01:38:23.908019 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867220    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 01:38:23.908019 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867223    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 01:38:23.908019 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867226    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 01:38:23.908019 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867229    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 01:38:23.908019 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867232    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 01:38:23.908019 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867235    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 01:38:23.908019 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867239    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 01:38:23.908019 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867242    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 09 01:38:23.908019 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867245    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 01:38:23.908019 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867248    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 01:38:23.908019 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867251    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 01:38:23.908019 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867254    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 01:38:23.908019 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867257    2562 flags.go:64] FLAG: --lock-file=""
Jul 09 01:38:23.908675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867260    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 01:38:23.908675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867263    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 01:38:23.908675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867266    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 01:38:23.908675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867273    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 01:38:23.908675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867276    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 01:38:23.908675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867279    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 01:38:23.908675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867282    2562 flags.go:64] FLAG: --logging-format="text"
Jul 09 01:38:23.908675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867285    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 01:38:23.908675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867289    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 01:38:23.908675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867292    2562 flags.go:64] FLAG: --manifest-url=""
Jul 09 01:38:23.908675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867295    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 01:38:23.908675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867299    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 01:38:23.908675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867302    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 01:38:23.908675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867306    2562 flags.go:64] FLAG: --max-pods="110"
Jul 09 01:38:23.908675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867309    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 01:38:23.908675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867314    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 01:38:23.908675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867317    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 01:38:23.908675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867320    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 01:38:23.908675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867323    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 01:38:23.908675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867326    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 01:38:23.908675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867329    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 01:38:23.908675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867337    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 01:38:23.908675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867340    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 01:38:23.908675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867343    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 01:38:23.908675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867346    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 09 01:38:23.909337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867350    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 09 01:38:23.909337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867355    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 01:38:23.909337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867358    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 01:38:23.909337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867362    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 01:38:23.909337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867365    2562 flags.go:64] FLAG: --port="10250"
Jul 09 01:38:23.909337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867368    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 01:38:23.909337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867371    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bb6c2c58bfc23ba0"
Jul 09 01:38:23.909337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867374    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 09 01:38:23.909337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867377    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 01:38:23.909337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867380    2562 flags.go:64] FLAG: --register-node="true"
Jul 09 01:38:23.909337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867384    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 09 01:38:23.909337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867389    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 09 01:38:23.909337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867393    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 09 01:38:23.909337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867396    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 01:38:23.909337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867399    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 09 01:38:23.909337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867403    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 01:38:23.909337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867406    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 01:38:23.909337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867409    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 01:38:23.909337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867412    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 01:38:23.909337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867415    2562 flags.go:64] FLAG: --runonce="false"
Jul 09 01:38:23.909337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867418    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 01:38:23.909337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867421    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 01:38:23.909337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867427    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 01:38:23.909337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867430    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 01:38:23.909337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867433    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 01:38:23.909992 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867436    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 01:38:23.909992 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867440    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 01:38:23.909992 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867443    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 01:38:23.909992 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867446    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 01:38:23.909992 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867449    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 01:38:23.909992 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867452    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 01:38:23.909992 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867455    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 01:38:23.909992 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867458    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 01:38:23.909992 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867462    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 09 01:38:23.909992 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867464    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 01:38:23.909992 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867470    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 01:38:23.909992 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867473    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 01:38:23.909992 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867476    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 01:38:23.909992 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867481    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 09 01:38:23.909992 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867484    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 01:38:23.909992 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867486    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 01:38:23.909992 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867489    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 01:38:23.909992 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867492    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 01:38:23.909992 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867497    2562 flags.go:64] FLAG: --v="2"
Jul 09 01:38:23.909992 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867501    2562 flags.go:64] FLAG: --version="false"
Jul 09 01:38:23.909992 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867505    2562 flags.go:64] FLAG: --vmodule=""
Jul 09 01:38:23.909992 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867509    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 01:38:23.909992 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.867512    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 01:38:23.909992 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867631    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 01:38:23.909992 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867635    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 01:38:23.910660 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867638    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 01:38:23.910660 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867641    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 01:38:23.910660 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867644    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 01:38:23.910660 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867647    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 01:38:23.910660 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867651    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 01:38:23.910660 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867654    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 01:38:23.910660 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867657    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 01:38:23.910660 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867660    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 01:38:23.910660 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867663    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 01:38:23.910660 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867666    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 01:38:23.910660 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867669    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 01:38:23.910660 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867672    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 01:38:23.910660 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867674    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 01:38:23.910660 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867677    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 01:38:23.910660 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867680    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 01:38:23.910660 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867683    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 01:38:23.910660 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867690    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 01:38:23.910660 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867693    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 01:38:23.910660 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867695    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 01:38:23.910660 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867698    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 01:38:23.911211 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867701    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 01:38:23.911211 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867703    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 01:38:23.911211 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867706    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 01:38:23.911211 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867709    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 01:38:23.911211 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867712    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 01:38:23.911211 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867716    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 01:38:23.911211 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867719    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 01:38:23.911211 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867722    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 01:38:23.911211 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867726    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 01:38:23.911211 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867730    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 01:38:23.911211 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867733    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 01:38:23.911211 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867736    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 01:38:23.911211 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867739    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 01:38:23.911211 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867743    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 01:38:23.911211 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867748    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 01:38:23.911211 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867751    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 01:38:23.911211 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867756    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 01:38:23.911211 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867759    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 01:38:23.911211 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867762    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 01:38:23.911721 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867765    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 01:38:23.911721 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867768    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 01:38:23.911721 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867771    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 01:38:23.911721 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867774    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 01:38:23.911721 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867776    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 01:38:23.911721 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867779    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 01:38:23.911721 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867782    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 01:38:23.911721 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867785    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 01:38:23.911721 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867788    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 01:38:23.911721 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867791    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 01:38:23.911721 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867797    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 01:38:23.911721 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867799    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 01:38:23.911721 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867802    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 01:38:23.911721 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867805    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 01:38:23.911721 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867807    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 01:38:23.911721 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867810    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 01:38:23.911721 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867813    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 01:38:23.911721 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867815    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 01:38:23.911721 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867820    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 01:38:23.911721 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867824    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 01:38:23.912262 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867829    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 01:38:23.912262 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867832    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 01:38:23.912262 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867834    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 01:38:23.912262 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867837    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 01:38:23.912262 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867840    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 01:38:23.912262 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867843    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 01:38:23.912262 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867846    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 01:38:23.912262 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867849    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 01:38:23.912262 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867851    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 01:38:23.912262 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867856    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 01:38:23.912262 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867858    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 01:38:23.912262 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867861    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 01:38:23.912262 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867864    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 01:38:23.912262 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867867    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 01:38:23.912262 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867870    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 01:38:23.912262 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867873    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 01:38:23.912262 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867876    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 01:38:23.912262 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867878    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 01:38:23.912262 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867881    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 01:38:23.912765 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867883    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 01:38:23.912765 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867886    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 01:38:23.912765 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867889    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 01:38:23.912765 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867891    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 01:38:23.912765 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867894    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 01:38:23.912765 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867897    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 01:38:23.912765 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867900    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 01:38:23.912765 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867903    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 01:38:23.912765 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867906    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 01:38:23.912765 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867908    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 01:38:23.912765 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867911    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 01:38:23.912765 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867915    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 01:38:23.912765 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867918    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 01:38:23.912765 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867921    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 01:38:23.912765 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867924    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 01:38:23.912765 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867927    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 01:38:23.912765 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867929    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 01:38:23.912765 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867932    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 01:38:23.912765 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.867935    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 01:38:23.913271 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.868745    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 01:38:23.913271 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.876715    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 09 01:38:23.913271 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.876735    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 01:38:23.913271 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.876754    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 01:38:23.913271 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.876764    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 01:38:23.913271 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876849    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 01:38:23.913271 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876856    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 01:38:23.913271 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876861    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 01:38:23.913271 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876867    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 01:38:23.913271 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876874    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 01:38:23.913271 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876879    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 01:38:23.913271 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876883    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 01:38:23.913271 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876888    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 01:38:23.913271 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876893    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 01:38:23.913652 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876897    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 01:38:23.913652 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876902    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 01:38:23.913652 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876907    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 01:38:23.913652 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876911    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 01:38:23.913652 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876916    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 01:38:23.913652 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876920    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 01:38:23.913652 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876924    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 01:38:23.913652 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876928    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 01:38:23.913652 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876933    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 01:38:23.913652 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876937    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 01:38:23.913652 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876941    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 01:38:23.913652 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876944    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 01:38:23.913652 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876949    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 01:38:23.913652 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876954    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 01:38:23.913652 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876958    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 01:38:23.913652 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876962    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 01:38:23.913652 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876967    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 01:38:23.913652 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876972    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 01:38:23.913652 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876976    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 01:38:23.913652 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876980    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 01:38:23.914231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876985    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 01:38:23.914231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876989    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 01:38:23.914231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876993    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 01:38:23.914231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.876997    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 01:38:23.914231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877002    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 01:38:23.914231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877009    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 01:38:23.914231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877014    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 01:38:23.914231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877019    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 01:38:23.914231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877023    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 01:38:23.914231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877028    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 01:38:23.914231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877032    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 01:38:23.914231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877036    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 01:38:23.914231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877041    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 01:38:23.914231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877045    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 01:38:23.914231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877049    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 01:38:23.914231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877053    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 01:38:23.914231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877057    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 01:38:23.914231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877061    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 01:38:23.914231 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877066    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 01:38:23.914708 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877070    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 01:38:23.914708 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877074    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 01:38:23.914708 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877078    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 01:38:23.914708 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877082    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 01:38:23.914708 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877086    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 01:38:23.914708 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877105    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 01:38:23.914708 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877110    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 01:38:23.914708 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877114    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 01:38:23.914708 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877119    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 01:38:23.914708 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877123    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 01:38:23.914708 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877128    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 01:38:23.914708 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877133    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 01:38:23.914708 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877137    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 01:38:23.914708 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877141    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 01:38:23.914708 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877146    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 01:38:23.914708 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877151    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 01:38:23.914708 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877155    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 01:38:23.914708 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877159    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 01:38:23.914708 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877165    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 01:38:23.915220 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877170    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 01:38:23.915220 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877174    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 01:38:23.915220 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877178    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 01:38:23.915220 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877182    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 01:38:23.915220 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877186    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 01:38:23.915220 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877190    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 01:38:23.915220 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877194    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 01:38:23.915220 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877198    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 01:38:23.915220 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877202    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 01:38:23.915220 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877207    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 01:38:23.915220 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877211    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 01:38:23.915220 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877215    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 01:38:23.915220 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877219    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 01:38:23.915220 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877223    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 01:38:23.915220 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877227    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 01:38:23.915220 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877231    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 01:38:23.915220 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877235    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 01:38:23.915220 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877239    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 01:38:23.915220 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877244    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 01:38:23.915220 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877248    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 01:38:23.915734 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877252    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 01:38:23.915734 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877256    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 01:38:23.915734 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877260    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 01:38:23.915734 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877265    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 01:38:23.915734 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877270    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 01:38:23.915734 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877274    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 01:38:23.915734 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877278    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 01:38:23.915734 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877282    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 01:38:23.915734 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877287    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 01:38:23.915734 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877291    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 01:38:23.915734 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877295    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 01:38:23.915734 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877299    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 01:38:23.915734 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.877307    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 01:38:23.915734 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877474    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 01:38:23.915734 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877481    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 01:38:23.916140 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877486    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 01:38:23.916140 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877491    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 01:38:23.916140 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877495    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 01:38:23.916140 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877500    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 01:38:23.916140 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877504    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 01:38:23.916140 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877508    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 01:38:23.916140 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877512    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 01:38:23.916140 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877517    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 01:38:23.916140 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877520    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 01:38:23.916140 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877525    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 01:38:23.916140 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877529    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 01:38:23.916140 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877533    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 01:38:23.916140 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877537    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 01:38:23.916140 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877541    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 01:38:23.916140 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877545    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 01:38:23.916140 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877552    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 01:38:23.916140 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877558    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 01:38:23.916140 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877562    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 01:38:23.916140 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877566    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 01:38:23.916140 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877571    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 01:38:23.916655 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877578    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 01:38:23.916655 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877582    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 01:38:23.916655 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877587    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 01:38:23.916655 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877591    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 01:38:23.916655 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877595    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 01:38:23.916655 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877599    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 01:38:23.916655 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877604    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 01:38:23.916655 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877608    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 01:38:23.916655 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877613    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 01:38:23.916655 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877617    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 01:38:23.916655 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877621    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 01:38:23.916655 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877625    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 01:38:23.916655 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877629    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 01:38:23.916655 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877633    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 01:38:23.916655 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877638    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 01:38:23.916655 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877642    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 01:38:23.916655 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877646    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 01:38:23.916655 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877650    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 01:38:23.916655 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877654    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 01:38:23.916655 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877658    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 01:38:23.917171 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877662    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 01:38:23.917171 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877666    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 01:38:23.917171 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877671    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 01:38:23.917171 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877675    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 01:38:23.917171 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877679    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 01:38:23.917171 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877683    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 01:38:23.917171 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877687    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 01:38:23.917171 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877693    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 01:38:23.917171 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877698    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 01:38:23.917171 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877703    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 01:38:23.917171 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877708    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 01:38:23.917171 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877712    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 01:38:23.917171 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877718    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 01:38:23.917171 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877726    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 01:38:23.917171 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877730    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 01:38:23.917171 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877735    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 01:38:23.917171 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877739    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 01:38:23.917171 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877743    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 01:38:23.917171 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877747    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 01:38:23.917673 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877753    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 01:38:23.917673 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877757    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 01:38:23.917673 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877761    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 01:38:23.917673 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877765    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 01:38:23.917673 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877769    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 01:38:23.917673 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877774    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 01:38:23.917673 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877778    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 01:38:23.917673 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877782    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 01:38:23.917673 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877786    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 01:38:23.917673 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877790    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 01:38:23.917673 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877793    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 01:38:23.917673 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877797    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 01:38:23.917673 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877802    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 01:38:23.917673 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877805    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 01:38:23.917673 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877809    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 01:38:23.917673 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877813    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 01:38:23.917673 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877817    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 01:38:23.917673 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877821    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 01:38:23.917673 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877825    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 01:38:23.918175 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877829    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 01:38:23.918175 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877833    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 01:38:23.918175 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877837    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 01:38:23.918175 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877841    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 01:38:23.918175 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877844    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 01:38:23.918175 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877850    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 01:38:23.918175 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877859    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 01:38:23.918175 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877865    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 01:38:23.918175 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877869    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 01:38:23.918175 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877873    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 01:38:23.918175 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877877    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 01:38:23.918175 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877881    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 01:38:23.918175 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877887    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 01:38:23.918175 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877891    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 01:38:23.918175 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877896    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 01:38:23.918175 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877900    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 01:38:23.918175 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877904    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 01:38:23.918175 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877908    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 01:38:23.918175 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:23.877911    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 01:38:23.918682 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.877919    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 01:38:23.918682 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.878058    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 01:38:23.918682 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.880420    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 01:38:23.918682 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.882073    2562 server.go:1019] "Starting client certificate rotation"
Jul 09 01:38:23.918682 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.882185    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 01:38:23.918682 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.882221    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 01:38:23.918682 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.885484    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 01:38:23.918682 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.890646    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 01:38:23.918682 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.900300    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 09 01:38:23.918682 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.903853    2562 log.go:25] "Validated CRI v1 image API"
Jul 09 01:38:23.918682 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.905495    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 01:38:23.918682 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.908302    2562 fs.go:135] Filesystem UUIDs: map[5f620d21-a80d-4412-a3aa-8ef00d746b24:/dev/nvme0n1p4 6da15f3f-676a-4e7d-9014-34a7f8ed6876:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 09 01:38:23.919010 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.908328    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 01:38:23.919042 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.912922    2562 manager.go:216] Machine: {Timestamp:2026-07-09 01:38:23.912434752 +0000 UTC m=+2.124087081 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3111174 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec238d407bb016d03745e4e43b4d5dba SystemUUID:ec238d40-7bb0-16d0-3745-e4e43b4d5dba BootID:b9f6068c-812d-46ae-86c7-095cbb886c0c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d7:ec:be:90:6d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d7:ec:be:90:6d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:b0:2b:02:8e:a4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 01:38:23.919042 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.913022    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 01:38:23.919042 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.913110    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 01:38:23.919042 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.917310    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 01:38:23.919042 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.917339    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-200.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 01:38:23.919042 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.918406    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 01:38:23.919042 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.918417    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 01:38:23.919042 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.918425    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 01:38:23.919307 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.918436    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 01:38:23.919759 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.919746    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 01:38:23.922282 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.922265    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 01:38:23.923968 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.923955    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 01:38:23.924140 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.924128    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 01:38:23.924179 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.924172    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 01:38:23.924212 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.924191    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 01:38:23.924212 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.924207    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 01:38:23.924282 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.924219    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 09 01:38:23.924282 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.924231    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 01:38:23.924644 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.924629    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 01:38:23.924713 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.924656    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 01:38:23.927017 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.926999    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 09 01:38:23.931703 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.931260    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 01:38:23.931703 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.931310    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 01:38:23.932983 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.932968    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 01:38:23.933075 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.932988    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 01:38:23.933075 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.932996    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 01:38:23.933075 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.933003    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 01:38:23.933075 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.933018    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 01:38:23.933075 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.933027    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 01:38:23.933075 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.933036    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 01:38:23.933075 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.933041    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 01:38:23.933075 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.933048    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 01:38:23.933075 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.933054    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 01:38:23.933075 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.933064    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 01:38:23.933075 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.933069    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 01:38:23.934829 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.934817    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 01:38:23.934873 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.934831    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 01:38:23.936003 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:23.935970    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 01:38:23.936113 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:23.936076    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-200.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 01:38:23.938220 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.938201    2562 server.go:1268] "Started kubelet"
Jul 09 01:38:23.938405 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.938348    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 01:38:23.938477 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.938425    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 01:38:23.938916 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.938869    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 01:38:23.939102 ip-10-0-138-200 systemd[1]: Started Kubernetes Kubelet.
Jul 09 01:38:23.940102 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.940014    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 01:38:23.941400 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.941384    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 01:38:23.944648 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:23.944622    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 01:38:23.946563 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.946544    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 01:38:23.946752 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.946553    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 01:38:23.947027 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:23.947006    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-200.ec2.internal\" not found"
Jul 09 01:38:23.947603 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.947586    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 01:38:23.947771 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.947753    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 01:38:23.947771 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.947773    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 01:38:23.947893 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.947801    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 01:38:23.947893 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.947815    2562 factory.go:55] Registering systemd factory
Jul 09 01:38:23.947893 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.947825    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 09 01:38:23.948101 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.947906    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 01:38:23.948101 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.947916    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 01:38:23.948204 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.948112    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vvr8z"
Jul 09 01:38:23.948204 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.948129    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-200.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 01:38:23.948287 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.948206    2562 factory.go:153] Registering CRI-O factory
Jul 09 01:38:23.948287 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.948233    2562 factory.go:223] Registration of the crio container factory successfully
Jul 09 01:38:23.948287 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.948258    2562 factory.go:103] Registering Raw factory
Jul 09 01:38:23.948287 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.948283    2562 manager.go:1196] Started watching for new ooms in manager
Jul 09 01:38:23.948778 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:23.947680    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-200.ec2.internal.18c07b5fd37030fa  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-200.ec2.internal,UID:ip-10-0-138-200.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-200.ec2.internal,},FirstTimestamp:2026-07-09 01:38:23.93817113 +0000 UTC m=+2.149823481,LastTimestamp:2026-07-09 01:38:23.93817113 +0000 UTC m=+2.149823481,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-200.ec2.internal,}"
Jul 09 01:38:23.949126 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.949109    2562 manager.go:349] Starting recovery of all containers
Jul 09 01:38:23.956744 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.956723    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vvr8z"
Jul 09 01:38:23.957845 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:23.957817    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 09 01:38:23.958063 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:23.957996    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-200.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 09 01:38:23.962518 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.962365    2562 manager.go:354] Recovery completed
Jul 09 01:38:23.967732 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.967718    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 01:38:23.970074 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.970058    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 01:38:23.970148 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.970084    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 01:38:23.970148 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.970094    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-200.ec2.internal" event="NodeHasSufficientPID"
Jul 09 01:38:23.970697 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.970683    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 01:38:23.970697 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.970694    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 01:38:23.970794 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.970708    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 01:38:23.972303 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.972283    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 01:38:23.972827 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.972812    2562 policy_none.go:49] "None policy: Start"
Jul 09 01:38:23.972875 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.972831    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 01:38:23.972875 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.972842    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 01:38:23.973451 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.973437    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 01:38:23.973493 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.973459    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 01:38:23.973493 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.973470    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-200.ec2.internal" event="NodeHasSufficientPID"
Jul 09 01:38:23.974917 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.974905    2562 policy_none.go:47] "Start"
Jul 09 01:38:23.976003 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:23.975940    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-200.ec2.internal.18c07b5fd557003b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-200.ec2.internal,UID:ip-10-0-138-200.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-200.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-200.ec2.internal,},FirstTimestamp:2026-07-09 01:38:23.970074683 +0000 UTC m=+2.181727012,LastTimestamp:2026-07-09 01:38:23.970074683 +0000 UTC m=+2.181727012,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-200.ec2.internal,}"
Jul 09 01:38:23.998889 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.998866    2562 manager.go:337] "Starting Device Plugin manager"
Jul 09 01:38:23.998991 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:23.998909    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 01:38:23.998991 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.998923    2562 server.go:87] "Starting device plugin registration server"
Jul 09 01:38:23.999288 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.999269    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 01:38:23.999360 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.999297    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 01:38:23.999429 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.999410    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 01:38:23.999573 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.999556    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 01:38:23.999573 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:23.999571    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 01:38:24.000122 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:24.000088    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 01:38:24.000222 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:24.000140    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-200.ec2.internal\" not found"
Jul 09 01:38:24.100206 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.100172    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 01:38:24.102725 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.102701    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 01:38:24.102827 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.102741    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 01:38:24.102827 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.102756    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-200.ec2.internal" event="NodeHasSufficientPID"
Jul 09 01:38:24.102827 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.102785    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-200.ec2.internal"
Jul 09 01:38:24.111664 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.111645    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-200.ec2.internal"
Jul 09 01:38:24.111758 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:24.111670    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-200.ec2.internal\": node \"ip-10-0-138-200.ec2.internal\" not found"
Jul 09 01:38:24.132549 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:24.132523    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-200.ec2.internal\" not found"
Jul 09 01:38:24.149628 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.149560    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 01:38:24.150779 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.150757    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 01:38:24.150867 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.150810    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 01:38:24.150912 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.150879    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 01:38:24.150957 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:24.150922    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 01:38:24.152928 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.152911    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 01:38:24.237011 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:24.236971    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-200.ec2.internal\" not found"
Jul 09 01:38:24.252143 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.252115    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-200.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-200.ec2.internal"]
Jul 09 01:38:24.252255 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.252204    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 01:38:24.254251 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.254230    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 01:38:24.254375 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.254262    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 01:38:24.254375 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.254277    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-200.ec2.internal" event="NodeHasSufficientPID"
Jul 09 01:38:24.256478 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.256464    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 01:38:24.256644 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.256628    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-200.ec2.internal"
Jul 09 01:38:24.256707 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.256666    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 01:38:24.258847 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.258827    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 01:38:24.258847 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.258837    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 01:38:24.259003 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.258858    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 01:38:24.259003 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.258863    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 01:38:24.259003 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.258871    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-200.ec2.internal" event="NodeHasSufficientPID"
Jul 09 01:38:24.259003 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.258885    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-200.ec2.internal" event="NodeHasSufficientPID"
Jul 09 01:38:24.261283 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.261260    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-200.ec2.internal"
Jul 09 01:38:24.261372 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.261287    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 01:38:24.262007 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.261989    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 01:38:24.262007 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.262023    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 01:38:24.262139 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.262038    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-200.ec2.internal" event="NodeHasSufficientPID"
Jul 09 01:38:24.287909 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:24.287891    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-200.ec2.internal\" not found" node="ip-10-0-138-200.ec2.internal"
Jul 09 01:38:24.292571 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:24.292549    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-200.ec2.internal\" not found" node="ip-10-0-138-200.ec2.internal"
Jul 09 01:38:24.337789 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:24.337765    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-200.ec2.internal\" not found"
Jul 09 01:38:24.349949 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.349932    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/36aa469e6c34b3631d56158075dd7a0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-200.ec2.internal\" (UID: \"36aa469e6c34b3631d56158075dd7a0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-200.ec2.internal"
Jul 09 01:38:24.350050 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.349957    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36aa469e6c34b3631d56158075dd7a0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-200.ec2.internal\" (UID: \"36aa469e6c34b3631d56158075dd7a0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-200.ec2.internal"
Jul 09 01:38:24.350050 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.349976    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f10a9fc02587642f786ed8d229854619-config\") pod \"kube-apiserver-proxy-ip-10-0-138-200.ec2.internal\" (UID: \"f10a9fc02587642f786ed8d229854619\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-200.ec2.internal"
Jul 09 01:38:24.437984 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:24.437922    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-200.ec2.internal\" not found"
Jul 09 01:38:24.450786 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.450758    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36aa469e6c34b3631d56158075dd7a0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-200.ec2.internal\" (UID: \"36aa469e6c34b3631d56158075dd7a0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-200.ec2.internal"
Jul 09 01:38:24.450786 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.450788    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f10a9fc02587642f786ed8d229854619-config\") pod \"kube-apiserver-proxy-ip-10-0-138-200.ec2.internal\" (UID: \"f10a9fc02587642f786ed8d229854619\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-200.ec2.internal"
Jul 09 01:38:24.450930 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.450805    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/36aa469e6c34b3631d56158075dd7a0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-200.ec2.internal\" (UID: \"36aa469e6c34b3631d56158075dd7a0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-200.ec2.internal"
Jul 09 01:38:24.450930 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.450846    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/36aa469e6c34b3631d56158075dd7a0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-200.ec2.internal\" (UID: \"36aa469e6c34b3631d56158075dd7a0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-200.ec2.internal"
Jul 09 01:38:24.450930 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.450852    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36aa469e6c34b3631d56158075dd7a0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-200.ec2.internal\" (UID: \"36aa469e6c34b3631d56158075dd7a0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-200.ec2.internal"
Jul 09 01:38:24.450930 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.450882    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f10a9fc02587642f786ed8d229854619-config\") pod \"kube-apiserver-proxy-ip-10-0-138-200.ec2.internal\" (UID: \"f10a9fc02587642f786ed8d229854619\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-200.ec2.internal"
Jul 09 01:38:24.539770 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:24.539733    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-200.ec2.internal\" not found"
Jul 09 01:38:24.593240 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.593210    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-200.ec2.internal"
Jul 09 01:38:24.595552 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.595532    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-200.ec2.internal"
Jul 09 01:38:24.640958 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:24.640937    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-200.ec2.internal\" not found"
Jul 09 01:38:24.745392 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:24.745340    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-200.ec2.internal\" not found"
Jul 09 01:38:24.846226 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:24.846196    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-200.ec2.internal\" not found"
Jul 09 01:38:24.881977 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.881956    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 01:38:24.882134 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.882115    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 01:38:24.947170 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:24.947149    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-200.ec2.internal\" not found"
Jul 09 01:38:24.960004 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.959986    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 01:38:24.960980 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.960952    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 01:33:24 +0000 UTC" deadline="2028-01-31 06:14:20.791301605 +0000 UTC"
Jul 09 01:38:24.961029 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:24.960981    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13708h35m55.830323809s"
Jul 09 01:38:25.000360 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.000309    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 01:38:25.047548 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.047526    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-200.ec2.internal"
Jul 09 01:38:25.061937 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.061913    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 01:38:25.063925 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.063911    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-200.ec2.internal"
Jul 09 01:38:25.073748 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.073731    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 01:38:25.119410 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.119384    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 01:38:25.182517 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:25.182482    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf10a9fc02587642f786ed8d229854619.slice/crio-23ef1d4a009af2c955974d494c5e59e112681da948d946ea2f2dde3a75cb1212 WatchSource:0}: Error finding container 23ef1d4a009af2c955974d494c5e59e112681da948d946ea2f2dde3a75cb1212: Status 404 returned error can't find the container with id 23ef1d4a009af2c955974d494c5e59e112681da948d946ea2f2dde3a75cb1212
Jul 09 01:38:25.182857 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:25.182836    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36aa469e6c34b3631d56158075dd7a0d.slice/crio-b371ddda1a03bcf60b0a4c9b5098cb64ab4cdab52b2b769a085b50ec3d0029bf WatchSource:0}: Error finding container b371ddda1a03bcf60b0a4c9b5098cb64ab4cdab52b2b769a085b50ec3d0029bf: Status 404 returned error can't find the container with id b371ddda1a03bcf60b0a4c9b5098cb64ab4cdab52b2b769a085b50ec3d0029bf
Jul 09 01:38:25.188917 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.188901    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 01:38:25.926142 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.925864    2562 apiserver.go:52] "Watching apiserver"
Jul 09 01:38:25.937032 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.936991    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 01:38:25.938291 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.938030    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-pj8tk","openshift-ovn-kubernetes/ovnkube-node-699pt","kube-system/global-pull-secret-syncer-xcs6g","kube-system/konnectivity-agent-zqpkr","kube-system/kube-apiserver-proxy-ip-10-0-138-200.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q","openshift-cluster-node-tuning-operator/tuned-tk226","openshift-dns/node-resolver-r4hf8","openshift-image-registry/node-ca-9sjqd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-200.ec2.internal","openshift-multus/multus-additional-cni-plugins-zfnsg","openshift-multus/multus-tf75l","openshift-multus/network-metrics-daemon-fbxl7","openshift-network-diagnostics/network-check-target-gkjkz"]
Jul 09 01:38:25.940836 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.940759    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:25.943463 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.943278    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9sjqd"
Jul 09 01:38:25.946833 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.944312    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 01:38:25.946833 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.944532    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 01:38:25.946833 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.944710    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pmjng\""
Jul 09 01:38:25.946833 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.945805    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zqpkr"
Jul 09 01:38:25.946833 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.946392    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 01:38:25.946833 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.946524    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fnnvt\""
Jul 09 01:38:25.946833 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.946587    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 01:38:25.946833 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.946773    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 01:38:25.949073 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.948092    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pj8tk"
Jul 09 01:38:25.949073 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.948483    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 01:38:25.949073 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.948685    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 01:38:25.949934 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.949656    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vkltz\""
Jul 09 01:38:25.949934 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.949656    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 01:38:25.951770 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.951141    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mm556\""
Jul 09 01:38:25.951770 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.951366    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 01:38:25.951770 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.951622    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 01:38:25.952430 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.952116    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q"
Jul 09 01:38:25.952430 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.952160    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 01:38:25.953512 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.953471    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:25.953620 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:25.953551    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xcs6g" podUID="d934d4c6-1de4-4fce-8aca-e3a5a1cd14df"
Jul 09 01:38:25.957042 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.955547    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 01:38:25.957042 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.955850    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 01:38:25.957042 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.956035    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 01:38:25.957042 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.956124    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r4hf8"
Jul 09 01:38:25.957372 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.957337    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-thfbn\""
Jul 09 01:38:25.958703 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.958675    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:25.960313 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.959695    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 01:38:25.960313 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.959904    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 01:38:25.960313 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.960118    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5jj8h\""
Jul 09 01:38:25.961775 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.961751    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1842fc6f-c576-4494-960b-1b7a8c583e90-socket-dir\") pod \"aws-ebs-csi-driver-node-cgw8q\" (UID: \"1842fc6f-c576-4494-960b-1b7a8c583e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q"
Jul 09 01:38:25.961872 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.961789    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1479a0d8-2d1e-48d1-ac35-9754ea6fa215-host\") pod \"node-ca-9sjqd\" (UID: \"1479a0d8-2d1e-48d1-ac35-9754ea6fa215\") " pod="openshift-image-registry/node-ca-9sjqd"
Jul 09 01:38:25.961872 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.961818    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pdgc\" (UniqueName: \"kubernetes.io/projected/29bbad86-47c3-451d-b62a-433c617a7e81-kube-api-access-6pdgc\") pod \"iptables-alerter-pj8tk\" (UID: \"29bbad86-47c3-451d-b62a-433c617a7e81\") " pod="openshift-network-operator/iptables-alerter-pj8tk"
Jul 09 01:38:25.961872 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.961846    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c5d65341-3507-4208-86f3-d3269df692bc-konnectivity-ca\") pod \"konnectivity-agent-zqpkr\" (UID: \"c5d65341-3507-4208-86f3-d3269df692bc\") " pod="kube-system/konnectivity-agent-zqpkr"
Jul 09 01:38:25.962074 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.961872    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29bbad86-47c3-451d-b62a-433c617a7e81-host-slash\") pod \"iptables-alerter-pj8tk\" (UID: \"29bbad86-47c3-451d-b62a-433c617a7e81\") " pod="openshift-network-operator/iptables-alerter-pj8tk"
Jul 09 01:38:25.962074 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.961910    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1842fc6f-c576-4494-960b-1b7a8c583e90-registration-dir\") pod \"aws-ebs-csi-driver-node-cgw8q\" (UID: \"1842fc6f-c576-4494-960b-1b7a8c583e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q"
Jul 09 01:38:25.962074 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.961948    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1842fc6f-c576-4494-960b-1b7a8c583e90-device-dir\") pod \"aws-ebs-csi-driver-node-cgw8q\" (UID: \"1842fc6f-c576-4494-960b-1b7a8c583e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q"
Jul 09 01:38:25.962074 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.961973    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgn68\" (UniqueName: \"kubernetes.io/projected/1842fc6f-c576-4494-960b-1b7a8c583e90-kube-api-access-xgn68\") pod \"aws-ebs-csi-driver-node-cgw8q\" (UID: \"1842fc6f-c576-4494-960b-1b7a8c583e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q"
Jul 09 01:38:25.962074 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.961998    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-etc-kubernetes\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:25.962074 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962021    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-etc-systemd\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:25.962074 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962046    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c5d65341-3507-4208-86f3-d3269df692bc-agent-certs\") pod \"konnectivity-agent-zqpkr\" (UID: \"c5d65341-3507-4208-86f3-d3269df692bc\") " pod="kube-system/konnectivity-agent-zqpkr"
Jul 09 01:38:25.962074 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1842fc6f-c576-4494-960b-1b7a8c583e90-etc-selinux\") pod \"aws-ebs-csi-driver-node-cgw8q\" (UID: \"1842fc6f-c576-4494-960b-1b7a8c583e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q"
Jul 09 01:38:25.962545 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962080    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:25.962545 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962113    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1842fc6f-c576-4494-960b-1b7a8c583e90-sys-fs\") pod \"aws-ebs-csi-driver-node-cgw8q\" (UID: \"1842fc6f-c576-4494-960b-1b7a8c583e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q"
Jul 09 01:38:25.962545 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962138    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-etc-sysconfig\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:25.962545 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962160    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-etc-sysctl-conf\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:25.962545 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962184    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-sys\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:25.962545 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962221    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-etc-sysctl-d\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:25.962545 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962261    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-var-lib-kubelet\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:25.962545 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962283    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-etc-tuned\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:25.962545 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962314    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-run\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:25.962545 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962335    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-host\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:25.962545 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962376    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29bbad86-47c3-451d-b62a-433c617a7e81-iptables-alerter-script\") pod \"iptables-alerter-pj8tk\" (UID: \"29bbad86-47c3-451d-b62a-433c617a7e81\") " pod="openshift-network-operator/iptables-alerter-pj8tk"
Jul 09 01:38:25.962545 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962402    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1842fc6f-c576-4494-960b-1b7a8c583e90-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cgw8q\" (UID: \"1842fc6f-c576-4494-960b-1b7a8c583e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q"
Jul 09 01:38:25.962545 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962473    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-etc-modprobe-d\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:25.962545 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962514    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-lib-modules\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:25.963252 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962542    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5l7m\" (UniqueName: \"kubernetes.io/projected/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-kube-api-access-r5l7m\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:25.963252 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962567    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1479a0d8-2d1e-48d1-ac35-9754ea6fa215-serviceca\") pod \"node-ca-9sjqd\" (UID: \"1479a0d8-2d1e-48d1-ac35-9754ea6fa215\") " pod="openshift-image-registry/node-ca-9sjqd"
Jul 09 01:38:25.963252 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962592    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-tmp\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:25.963252 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962618    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24nqs\" (UniqueName: \"kubernetes.io/projected/1479a0d8-2d1e-48d1-ac35-9754ea6fa215-kube-api-access-24nqs\") pod \"node-ca-9sjqd\" (UID: \"1479a0d8-2d1e-48d1-ac35-9754ea6fa215\") " pod="openshift-image-registry/node-ca-9sjqd"
Jul 09 01:38:25.963252 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962648    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-w8xxz\""
Jul 09 01:38:25.963252 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962784    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 01:38:25.963252 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962855    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 01:38:25.963252 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962918    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 01:38:25.963252 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962962    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 01:38:25.963252 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.962922    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 01:38:25.965195 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.963884    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 01:38:25.969410 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.965605    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 01:38:25.969410 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.965687    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 01:38:25.969410 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.965611    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 01:38:25.969410 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.966057    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 01:38:25.969410 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.966287    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8j8tp\""
Jul 09 01:38:25.969410 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.966589    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 01:38:25.969410 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.966650    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 01:38:25.969410 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.966890    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tf75l"
Jul 09 01:38:25.969870 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.969456    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 01:38:25.969870 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.969727    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mrg8z\""
Jul 09 01:38:25.969968 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.969920    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:25.970023 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:25.969982    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxl7" podUID="354cfa30-e59e-4198-996a-62a7fd0b43dc"
Jul 09 01:38:25.974337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.972010    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:25.974337 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:25.972110    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkjkz" podUID="af2aded5-20b6-406c-a3a9-d9d4f3cd725a"
Jul 09 01:38:25.974337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.973828    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 01:38:25.986750 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.986726    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-59wtb"
Jul 09 01:38:25.996300 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:25.996276    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-59wtb"
Jul 09 01:38:26.049377 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.049359    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 01:38:26.062970 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.062948    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-multus-conf-dir\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.063101 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.062983    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-host-run-multus-certs\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.063101 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063010    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-dbus\") pod \"global-pull-secret-syncer-xcs6g\" (UID: \"d934d4c6-1de4-4fce-8aca-e3a5a1cd14df\") " pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:26.063101 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063049    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1842fc6f-c576-4494-960b-1b7a8c583e90-registration-dir\") pod \"aws-ebs-csi-driver-node-cgw8q\" (UID: \"1842fc6f-c576-4494-960b-1b7a8c583e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q"
Jul 09 01:38:26.063101 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063076    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1842fc6f-c576-4494-960b-1b7a8c583e90-device-dir\") pod \"aws-ebs-csi-driver-node-cgw8q\" (UID: \"1842fc6f-c576-4494-960b-1b7a8c583e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q"
Jul 09 01:38:26.063316 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063101    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgn68\" (UniqueName: \"kubernetes.io/projected/1842fc6f-c576-4494-960b-1b7a8c583e90-kube-api-access-xgn68\") pod \"aws-ebs-csi-driver-node-cgw8q\" (UID: \"1842fc6f-c576-4494-960b-1b7a8c583e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q"
Jul 09 01:38:26.063316 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063127    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-etc-systemd\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.063316 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063149    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1842fc6f-c576-4494-960b-1b7a8c583e90-registration-dir\") pod \"aws-ebs-csi-driver-node-cgw8q\" (UID: \"1842fc6f-c576-4494-960b-1b7a8c583e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q"
Jul 09 01:38:26.063316 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063151    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c5d65341-3507-4208-86f3-d3269df692bc-agent-certs\") pod \"konnectivity-agent-zqpkr\" (UID: \"c5d65341-3507-4208-86f3-d3269df692bc\") " pod="kube-system/konnectivity-agent-zqpkr"
Jul 09 01:38:26.063316 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063184    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1842fc6f-c576-4494-960b-1b7a8c583e90-device-dir\") pod \"aws-ebs-csi-driver-node-cgw8q\" (UID: \"1842fc6f-c576-4494-960b-1b7a8c583e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q"
Jul 09 01:38:26.063316 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063197    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-etc-sysctl-conf\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.063316 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063215    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-etc-systemd\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.063316 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063236    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/57c14d99-09ac-43ca-8cbd-88d3ea0dae62-hosts-file\") pod \"node-resolver-r4hf8\" (UID: \"57c14d99-09ac-43ca-8cbd-88d3ea0dae62\") " pod="openshift-dns/node-resolver-r4hf8"
Jul 09 01:38:26.063316 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063262    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-system-cni-dir\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.063316 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063287    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-original-pull-secret\") pod \"global-pull-secret-syncer-xcs6g\" (UID: \"d934d4c6-1de4-4fce-8aca-e3a5a1cd14df\") " pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:26.063316 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063313    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-etc-sysctl-conf\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.063880 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063315    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-host-cni-bin\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.063880 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063366    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddxc8\" (UniqueName: \"kubernetes.io/projected/06fb185c-c179-447a-a8cc-523c966571b7-kube-api-access-ddxc8\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.063880 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063393    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-var-lib-kubelet\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.063880 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063414    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-etc-tuned\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.063880 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063435    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk884\" (UniqueName: \"kubernetes.io/projected/8bbd093b-0f3c-474f-b700-7ea794383781-kube-api-access-zk884\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.063880 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063455    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-host-slash\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.063880 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063481    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-var-lib-kubelet\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.063880 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063497    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-log-socket\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.063880 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063519    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-host-cni-netd\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.063880 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063540    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/90b8ee8a-a205-410e-a20c-63fe30c64bb1-cnibin\") pod \"multus-additional-cni-plugins-zfnsg\" (UID: \"90b8ee8a-a205-410e-a20c-63fe30c64bb1\") " pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:26.063880 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063562    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29bbad86-47c3-451d-b62a-433c617a7e81-iptables-alerter-script\") pod \"iptables-alerter-pj8tk\" (UID: \"29bbad86-47c3-451d-b62a-433c617a7e81\") " pod="openshift-network-operator/iptables-alerter-pj8tk"
Jul 09 01:38:26.063880 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063560    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 01:38:26.063880 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063585    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-lib-modules\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.063880 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063643    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5l7m\" (UniqueName: \"kubernetes.io/projected/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-kube-api-access-r5l7m\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.064536 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063671    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-cnibin\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.064536 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063710    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-hostroot\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.064536 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063748    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/90b8ee8a-a205-410e-a20c-63fe30c64bb1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zfnsg\" (UID: \"90b8ee8a-a205-410e-a20c-63fe30c64bb1\") " pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:26.064536 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063778    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-lib-modules\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.064536 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063781    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-tmp\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.064536 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063893    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-etc-kubernetes\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.064536 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063924    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/354cfa30-e59e-4198-996a-62a7fd0b43dc-metrics-certs\") pod \"network-metrics-daemon-fbxl7\" (UID: \"354cfa30-e59e-4198-996a-62a7fd0b43dc\") " pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:26.064536 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063950    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-systemd-units\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.064536 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.063979    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-run-systemd\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.064536 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064005    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-run-ovn\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.064536 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064030    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/06fb185c-c179-447a-a8cc-523c966571b7-ovnkube-script-lib\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.064536 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064054    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90b8ee8a-a205-410e-a20c-63fe30c64bb1-system-cni-dir\") pod \"multus-additional-cni-plugins-zfnsg\" (UID: \"90b8ee8a-a205-410e-a20c-63fe30c64bb1\") " pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:26.064536 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064080    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/90b8ee8a-a205-410e-a20c-63fe30c64bb1-os-release\") pod \"multus-additional-cni-plugins-zfnsg\" (UID: \"90b8ee8a-a205-410e-a20c-63fe30c64bb1\") " pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:26.064536 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064121    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-os-release\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.065261 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064142    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29bbad86-47c3-451d-b62a-433c617a7e81-iptables-alerter-script\") pod \"iptables-alerter-pj8tk\" (UID: \"29bbad86-47c3-451d-b62a-433c617a7e81\") " pod="openshift-network-operator/iptables-alerter-pj8tk"
Jul 09 01:38:26.065261 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064147    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-host-var-lib-kubelet\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.065261 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064217    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8bbd093b-0f3c-474f-b700-7ea794383781-multus-daemon-config\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.065261 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064246    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-kubelet-config\") pod \"global-pull-secret-syncer-xcs6g\" (UID: \"d934d4c6-1de4-4fce-8aca-e3a5a1cd14df\") " pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:26.065261 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064275    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-etc-openvswitch\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.065261 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064298    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-node-log\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.065261 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064341    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.065261 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064370    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hb6b\" (UniqueName: \"kubernetes.io/projected/90b8ee8a-a205-410e-a20c-63fe30c64bb1-kube-api-access-2hb6b\") pod \"multus-additional-cni-plugins-zfnsg\" (UID: \"90b8ee8a-a205-410e-a20c-63fe30c64bb1\") " pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:26.065261 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064415    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c5d65341-3507-4208-86f3-d3269df692bc-konnectivity-ca\") pod \"konnectivity-agent-zqpkr\" (UID: \"c5d65341-3507-4208-86f3-d3269df692bc\") " pod="kube-system/konnectivity-agent-zqpkr"
Jul 09 01:38:26.065261 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064444    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29bbad86-47c3-451d-b62a-433c617a7e81-host-slash\") pod \"iptables-alerter-pj8tk\" (UID: \"29bbad86-47c3-451d-b62a-433c617a7e81\") " pod="openshift-network-operator/iptables-alerter-pj8tk"
Jul 09 01:38:26.065261 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064475    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-etc-kubernetes\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.065261 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064497    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-host-var-lib-cni-bin\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.065261 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064518    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-host-var-lib-cni-multus\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.065261 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064540    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/06fb185c-c179-447a-a8cc-523c966571b7-env-overrides\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.066006 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064562    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/90b8ee8a-a205-410e-a20c-63fe30c64bb1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zfnsg\" (UID: \"90b8ee8a-a205-410e-a20c-63fe30c64bb1\") " pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:26.066006 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064584    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1842fc6f-c576-4494-960b-1b7a8c583e90-etc-selinux\") pod \"aws-ebs-csi-driver-node-cgw8q\" (UID: \"1842fc6f-c576-4494-960b-1b7a8c583e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q"
Jul 09 01:38:26.066006 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064585    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-etc-kubernetes\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.066006 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064604    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1842fc6f-c576-4494-960b-1b7a8c583e90-sys-fs\") pod \"aws-ebs-csi-driver-node-cgw8q\" (UID: \"1842fc6f-c576-4494-960b-1b7a8c583e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q"
Jul 09 01:38:26.066006 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064624    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-etc-sysconfig\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.066006 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064643    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-sys\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.066006 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064663    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/06fb185c-c179-447a-a8cc-523c966571b7-ovnkube-config\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.066006 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064686    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-etc-sysctl-d\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.066006 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064704    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-etc-sysconfig\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.066006 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064711    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnngq\" (UniqueName: \"kubernetes.io/projected/57c14d99-09ac-43ca-8cbd-88d3ea0dae62-kube-api-access-vnngq\") pod \"node-resolver-r4hf8\" (UID: \"57c14d99-09ac-43ca-8cbd-88d3ea0dae62\") " pod="openshift-dns/node-resolver-r4hf8"
Jul 09 01:38:26.066006 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064744    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-var-lib-openvswitch\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.066006 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064774    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-sys\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.066006 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064775    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-run-openvswitch\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.066006 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064642    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29bbad86-47c3-451d-b62a-433c617a7e81-host-slash\") pod \"iptables-alerter-pj8tk\" (UID: \"29bbad86-47c3-451d-b62a-433c617a7e81\") " pod="openshift-network-operator/iptables-alerter-pj8tk"
Jul 09 01:38:26.066716 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064869    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1842fc6f-c576-4494-960b-1b7a8c583e90-etc-selinux\") pod \"aws-ebs-csi-driver-node-cgw8q\" (UID: \"1842fc6f-c576-4494-960b-1b7a8c583e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q"
Jul 09 01:38:26.066716 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064899    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/06fb185c-c179-447a-a8cc-523c966571b7-ovn-node-metrics-cert\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.066716 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064905    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-etc-sysctl-d\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.066716 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064925    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/90b8ee8a-a205-410e-a20c-63fe30c64bb1-cni-binary-copy\") pod \"multus-additional-cni-plugins-zfnsg\" (UID: \"90b8ee8a-a205-410e-a20c-63fe30c64bb1\") " pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:26.066716 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064952    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvzdj\" (UniqueName: \"kubernetes.io/projected/354cfa30-e59e-4198-996a-62a7fd0b43dc-kube-api-access-mvzdj\") pod \"network-metrics-daemon-fbxl7\" (UID: \"354cfa30-e59e-4198-996a-62a7fd0b43dc\") " pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:26.066716 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064958    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1842fc6f-c576-4494-960b-1b7a8c583e90-sys-fs\") pod \"aws-ebs-csi-driver-node-cgw8q\" (UID: \"1842fc6f-c576-4494-960b-1b7a8c583e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q"
Jul 09 01:38:26.066716 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064958    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c5d65341-3507-4208-86f3-d3269df692bc-konnectivity-ca\") pod \"konnectivity-agent-zqpkr\" (UID: \"c5d65341-3507-4208-86f3-d3269df692bc\") " pod="kube-system/konnectivity-agent-zqpkr"
Jul 09 01:38:26.066716 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.064981    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-run\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.066716 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.065016    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-host\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.066716 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.065027    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-run\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.066716 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.065048    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57c14d99-09ac-43ca-8cbd-88d3ea0dae62-tmp-dir\") pod \"node-resolver-r4hf8\" (UID: \"57c14d99-09ac-43ca-8cbd-88d3ea0dae62\") " pod="openshift-dns/node-resolver-r4hf8"
Jul 09 01:38:26.066716 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.065073    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-host\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.066716 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.065124    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8bbd093b-0f3c-474f-b700-7ea794383781-cni-binary-copy\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.066716 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.065150    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-host-run-k8s-cni-cncf-io\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.067419 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.065174    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-host-run-netns\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.067419 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.065195    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-host-kubelet\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.067419 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.065222    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1842fc6f-c576-4494-960b-1b7a8c583e90-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cgw8q\" (UID: \"1842fc6f-c576-4494-960b-1b7a8c583e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q"
Jul 09 01:38:26.067419 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.065280    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-etc-modprobe-d\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.067419 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.065311    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1479a0d8-2d1e-48d1-ac35-9754ea6fa215-serviceca\") pod \"node-ca-9sjqd\" (UID: \"1479a0d8-2d1e-48d1-ac35-9754ea6fa215\") " pod="openshift-image-registry/node-ca-9sjqd"
Jul 09 01:38:26.067419 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.065330    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1842fc6f-c576-4494-960b-1b7a8c583e90-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cgw8q\" (UID: \"1842fc6f-c576-4494-960b-1b7a8c583e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q"
Jul 09 01:38:26.067419 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.065340    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-host-run-netns\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.067419 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.065368    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24nqs\" (UniqueName: \"kubernetes.io/projected/1479a0d8-2d1e-48d1-ac35-9754ea6fa215-kube-api-access-24nqs\") pod \"node-ca-9sjqd\" (UID: \"1479a0d8-2d1e-48d1-ac35-9754ea6fa215\") " pod="openshift-image-registry/node-ca-9sjqd"
Jul 09 01:38:26.067419 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.065415    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-etc-modprobe-d\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.067419 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.065783    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1479a0d8-2d1e-48d1-ac35-9754ea6fa215-serviceca\") pod \"node-ca-9sjqd\" (UID: \"1479a0d8-2d1e-48d1-ac35-9754ea6fa215\") " pod="openshift-image-registry/node-ca-9sjqd"
Jul 09 01:38:26.067419 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.065892    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/90b8ee8a-a205-410e-a20c-63fe30c64bb1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zfnsg\" (UID: \"90b8ee8a-a205-410e-a20c-63fe30c64bb1\") " pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:26.067419 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.065936    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1842fc6f-c576-4494-960b-1b7a8c583e90-socket-dir\") pod \"aws-ebs-csi-driver-node-cgw8q\" (UID: \"1842fc6f-c576-4494-960b-1b7a8c583e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q"
Jul 09 01:38:26.067419 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.065958    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1479a0d8-2d1e-48d1-ac35-9754ea6fa215-host\") pod \"node-ca-9sjqd\" (UID: \"1479a0d8-2d1e-48d1-ac35-9754ea6fa215\") " pod="openshift-image-registry/node-ca-9sjqd"
Jul 09 01:38:26.067419 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.065982    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-multus-socket-dir-parent\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.068078 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.066007    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pdgc\" (UniqueName: \"kubernetes.io/projected/29bbad86-47c3-451d-b62a-433c617a7e81-kube-api-access-6pdgc\") pod \"iptables-alerter-pj8tk\" (UID: \"29bbad86-47c3-451d-b62a-433c617a7e81\") " pod="openshift-network-operator/iptables-alerter-pj8tk"
Jul 09 01:38:26.068078 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.066036    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-multus-cni-dir\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.068078 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.066060    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-host-run-ovn-kubernetes\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.068078 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.066069    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1479a0d8-2d1e-48d1-ac35-9754ea6fa215-host\") pod \"node-ca-9sjqd\" (UID: \"1479a0d8-2d1e-48d1-ac35-9754ea6fa215\") " pod="openshift-image-registry/node-ca-9sjqd"
Jul 09 01:38:26.068078 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.066101    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4rgj\" (UniqueName: \"kubernetes.io/projected/af2aded5-20b6-406c-a3a9-d9d4f3cd725a-kube-api-access-s4rgj\") pod \"network-check-target-gkjkz\" (UID: \"af2aded5-20b6-406c-a3a9-d9d4f3cd725a\") " pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:26.068078 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.066198    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1842fc6f-c576-4494-960b-1b7a8c583e90-socket-dir\") pod \"aws-ebs-csi-driver-node-cgw8q\" (UID: \"1842fc6f-c576-4494-960b-1b7a8c583e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q"
Jul 09 01:38:26.068335 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.068174    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-etc-tuned\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.068600 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.068572    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c5d65341-3507-4208-86f3-d3269df692bc-agent-certs\") pod \"konnectivity-agent-zqpkr\" (UID: \"c5d65341-3507-4208-86f3-d3269df692bc\") " pod="kube-system/konnectivity-agent-zqpkr"
Jul 09 01:38:26.068700 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.068648    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-tmp\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.072560 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.072480    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5l7m\" (UniqueName: \"kubernetes.io/projected/ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1-kube-api-access-r5l7m\") pod \"tuned-tk226\" (UID: \"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1\") " pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.072828 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.072805    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgn68\" (UniqueName: \"kubernetes.io/projected/1842fc6f-c576-4494-960b-1b7a8c583e90-kube-api-access-xgn68\") pod \"aws-ebs-csi-driver-node-cgw8q\" (UID: \"1842fc6f-c576-4494-960b-1b7a8c583e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q"
Jul 09 01:38:26.073680 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.073634    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24nqs\" (UniqueName: \"kubernetes.io/projected/1479a0d8-2d1e-48d1-ac35-9754ea6fa215-kube-api-access-24nqs\") pod \"node-ca-9sjqd\" (UID: \"1479a0d8-2d1e-48d1-ac35-9754ea6fa215\") " pod="openshift-image-registry/node-ca-9sjqd"
Jul 09 01:38:26.074208 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.074177    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pdgc\" (UniqueName: \"kubernetes.io/projected/29bbad86-47c3-451d-b62a-433c617a7e81-kube-api-access-6pdgc\") pod \"iptables-alerter-pj8tk\" (UID: \"29bbad86-47c3-451d-b62a-433c617a7e81\") " pod="openshift-network-operator/iptables-alerter-pj8tk"
Jul 09 01:38:26.156407 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.156347    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-200.ec2.internal" event={"ID":"36aa469e6c34b3631d56158075dd7a0d","Type":"ContainerStarted","Data":"b371ddda1a03bcf60b0a4c9b5098cb64ab4cdab52b2b769a085b50ec3d0029bf"}
Jul 09 01:38:26.158362 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.158337    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-200.ec2.internal" event={"ID":"f10a9fc02587642f786ed8d229854619","Type":"ContainerStarted","Data":"23ef1d4a009af2c955974d494c5e59e112681da948d946ea2f2dde3a75cb1212"}
Jul 09 01:38:26.167119 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167090    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-log-socket\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.167218 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167136    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-host-cni-netd\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.167218 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167164    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/90b8ee8a-a205-410e-a20c-63fe30c64bb1-cnibin\") pod \"multus-additional-cni-plugins-zfnsg\" (UID: \"90b8ee8a-a205-410e-a20c-63fe30c64bb1\") " pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:26.167218 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167201    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-cnibin\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.167405 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167225    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-hostroot\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.167405 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167251    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/90b8ee8a-a205-410e-a20c-63fe30c64bb1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zfnsg\" (UID: \"90b8ee8a-a205-410e-a20c-63fe30c64bb1\") " pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:26.167405 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167277    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-etc-kubernetes\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.167405 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167303    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/354cfa30-e59e-4198-996a-62a7fd0b43dc-metrics-certs\") pod \"network-metrics-daemon-fbxl7\" (UID: \"354cfa30-e59e-4198-996a-62a7fd0b43dc\") " pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:26.167405 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167361    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-systemd-units\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.167405 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167388    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-run-systemd\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.167714 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167412    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-run-ovn\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.167714 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167437    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/06fb185c-c179-447a-a8cc-523c966571b7-ovnkube-script-lib\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.167714 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167462    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90b8ee8a-a205-410e-a20c-63fe30c64bb1-system-cni-dir\") pod \"multus-additional-cni-plugins-zfnsg\" (UID: \"90b8ee8a-a205-410e-a20c-63fe30c64bb1\") " pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:26.167714 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167485    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/90b8ee8a-a205-410e-a20c-63fe30c64bb1-os-release\") pod \"multus-additional-cni-plugins-zfnsg\" (UID: \"90b8ee8a-a205-410e-a20c-63fe30c64bb1\") " pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:26.167714 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167509    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-os-release\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.167714 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167533    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-host-var-lib-kubelet\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.167714 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167557    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8bbd093b-0f3c-474f-b700-7ea794383781-multus-daemon-config\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.167714 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167580    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-kubelet-config\") pod \"global-pull-secret-syncer-xcs6g\" (UID: \"d934d4c6-1de4-4fce-8aca-e3a5a1cd14df\") " pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:26.167714 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:26.167592    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:38:26.167714 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167606    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-etc-openvswitch\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.167714 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167628    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-host-cni-netd\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.167714 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167643    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-systemd-units\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.167714 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:26.167674    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/354cfa30-e59e-4198-996a-62a7fd0b43dc-metrics-certs podName:354cfa30-e59e-4198-996a-62a7fd0b43dc nodeName:}" failed. No retries permitted until 2026-07-09 01:38:26.667652182 +0000 UTC m=+4.879304519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/354cfa30-e59e-4198-996a-62a7fd0b43dc-metrics-certs") pod "network-metrics-daemon-fbxl7" (UID: "354cfa30-e59e-4198-996a-62a7fd0b43dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:38:26.167714 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167676    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-node-log\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.168505 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167693    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90b8ee8a-a205-410e-a20c-63fe30c64bb1-system-cni-dir\") pod \"multus-additional-cni-plugins-zfnsg\" (UID: \"90b8ee8a-a205-410e-a20c-63fe30c64bb1\") " pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:26.168505 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167708    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-etc-kubernetes\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.168505 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167748    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/90b8ee8a-a205-410e-a20c-63fe30c64bb1-cnibin\") pod \"multus-additional-cni-plugins-zfnsg\" (UID: \"90b8ee8a-a205-410e-a20c-63fe30c64bb1\") " pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:26.168505 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167766    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-kubelet-config\") pod \"global-pull-secret-syncer-xcs6g\" (UID: \"d934d4c6-1de4-4fce-8aca-e3a5a1cd14df\") " pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:26.168505 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167780    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/90b8ee8a-a205-410e-a20c-63fe30c64bb1-os-release\") pod \"multus-additional-cni-plugins-zfnsg\" (UID: \"90b8ee8a-a205-410e-a20c-63fe30c64bb1\") " pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:26.168505 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167790    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-host-var-lib-kubelet\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.168505 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167811    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-etc-openvswitch\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.168505 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167840    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-cnibin\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.168505 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167904    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-hostroot\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.168505 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167632    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-node-log\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.168505 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168109    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.168505 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168143    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hb6b\" (UniqueName: \"kubernetes.io/projected/90b8ee8a-a205-410e-a20c-63fe30c64bb1-kube-api-access-2hb6b\") pod \"multus-additional-cni-plugins-zfnsg\" (UID: \"90b8ee8a-a205-410e-a20c-63fe30c64bb1\") " pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:26.168505 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168177    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-host-var-lib-cni-bin\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.168505 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168206    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-host-var-lib-cni-multus\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.168505 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168233    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/06fb185c-c179-447a-a8cc-523c966571b7-env-overrides\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.168985 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168258    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/90b8ee8a-a205-410e-a20c-63fe30c64bb1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zfnsg\" (UID: \"90b8ee8a-a205-410e-a20c-63fe30c64bb1\") " pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:26.168985 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168295    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/06fb185c-c179-447a-a8cc-523c966571b7-ovnkube-config\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.168985 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168321    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnngq\" (UniqueName: \"kubernetes.io/projected/57c14d99-09ac-43ca-8cbd-88d3ea0dae62-kube-api-access-vnngq\") pod \"node-resolver-r4hf8\" (UID: \"57c14d99-09ac-43ca-8cbd-88d3ea0dae62\") " pod="openshift-dns/node-resolver-r4hf8"
Jul 09 01:38:26.168985 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168344    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/06fb185c-c179-447a-a8cc-523c966571b7-ovnkube-script-lib\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.168985 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168364    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8bbd093b-0f3c-474f-b700-7ea794383781-multus-daemon-config\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.168985 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168392    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.168985 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.167551    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-log-socket\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.168985 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168347    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-var-lib-openvswitch\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.168985 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168433    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-run-openvswitch\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.168985 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168444    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-run-ovn\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.168985 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168445    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-host-var-lib-cni-multus\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.168985 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168460    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/06fb185c-c179-447a-a8cc-523c966571b7-ovn-node-metrics-cert\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.168985 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168487    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/90b8ee8a-a205-410e-a20c-63fe30c64bb1-cni-binary-copy\") pod \"multus-additional-cni-plugins-zfnsg\" (UID: \"90b8ee8a-a205-410e-a20c-63fe30c64bb1\") " pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:26.168985 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168513    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvzdj\" (UniqueName: \"kubernetes.io/projected/354cfa30-e59e-4198-996a-62a7fd0b43dc-kube-api-access-mvzdj\") pod \"network-metrics-daemon-fbxl7\" (UID: \"354cfa30-e59e-4198-996a-62a7fd0b43dc\") " pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:26.169552 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168540    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57c14d99-09ac-43ca-8cbd-88d3ea0dae62-tmp-dir\") pod \"node-resolver-r4hf8\" (UID: \"57c14d99-09ac-43ca-8cbd-88d3ea0dae62\") " pod="openshift-dns/node-resolver-r4hf8"
Jul 09 01:38:26.169552 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168545    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/90b8ee8a-a205-410e-a20c-63fe30c64bb1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zfnsg\" (UID: \"90b8ee8a-a205-410e-a20c-63fe30c64bb1\") " pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:26.169552 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168564    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8bbd093b-0f3c-474f-b700-7ea794383781-cni-binary-copy\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.169552 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168588    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-host-run-k8s-cni-cncf-io\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.169552 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168615    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-host-run-netns\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.169552 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168615    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-os-release\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.169552 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168638    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-host-kubelet\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.169552 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168660    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-run-systemd\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.169552 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168675    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-host-kubelet\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.169552 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168720    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-host-run-netns\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.169552 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168678    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-host-run-netns\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.169552 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168758    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/90b8ee8a-a205-410e-a20c-63fe30c64bb1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zfnsg\" (UID: \"90b8ee8a-a205-410e-a20c-63fe30c64bb1\") " pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:26.169552 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168788    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-multus-socket-dir-parent\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.169552 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168815    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-multus-cni-dir\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.169552 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168846    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-host-run-ovn-kubernetes\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.170115 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168873    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4rgj\" (UniqueName: \"kubernetes.io/projected/af2aded5-20b6-406c-a3a9-d9d4f3cd725a-kube-api-access-s4rgj\") pod \"network-check-target-gkjkz\" (UID: \"af2aded5-20b6-406c-a3a9-d9d4f3cd725a\") " pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:26.170115 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168900    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-multus-conf-dir\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.170115 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168923    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-run-openvswitch\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.170115 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168929    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-host-run-multus-certs\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.170115 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168930    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/06fb185c-c179-447a-a8cc-523c966571b7-ovnkube-config\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.170115 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168965    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-dbus\") pod \"global-pull-secret-syncer-xcs6g\" (UID: \"d934d4c6-1de4-4fce-8aca-e3a5a1cd14df\") " pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:26.170115 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168983    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-host-run-k8s-cni-cncf-io\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.170115 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.169001    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/57c14d99-09ac-43ca-8cbd-88d3ea0dae62-hosts-file\") pod \"node-resolver-r4hf8\" (UID: \"57c14d99-09ac-43ca-8cbd-88d3ea0dae62\") " pod="openshift-dns/node-resolver-r4hf8"
Jul 09 01:38:26.170115 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.169022    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-host-run-netns\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.170115 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.169028    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-system-cni-dir\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.170115 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.168399    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-var-lib-openvswitch\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.170115 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.169057    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-original-pull-secret\") pod \"global-pull-secret-syncer-xcs6g\" (UID: \"d934d4c6-1de4-4fce-8aca-e3a5a1cd14df\") " pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:26.170115 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.169083    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-host-cni-bin\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.170115 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.169126    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddxc8\" (UniqueName: \"kubernetes.io/projected/06fb185c-c179-447a-a8cc-523c966571b7-kube-api-access-ddxc8\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.170115 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.169155    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk884\" (UniqueName: \"kubernetes.io/projected/8bbd093b-0f3c-474f-b700-7ea794383781-kube-api-access-zk884\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.170855 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.169181    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-host-slash\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.170855 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.169193    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/90b8ee8a-a205-410e-a20c-63fe30c64bb1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zfnsg\" (UID: \"90b8ee8a-a205-410e-a20c-63fe30c64bb1\") " pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:26.170855 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.169200    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/57c14d99-09ac-43ca-8cbd-88d3ea0dae62-hosts-file\") pod \"node-resolver-r4hf8\" (UID: \"57c14d99-09ac-43ca-8cbd-88d3ea0dae62\") " pod="openshift-dns/node-resolver-r4hf8"
Jul 09 01:38:26.170855 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:26.169281    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 01:38:26.170855 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:26.169329    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-original-pull-secret podName:d934d4c6-1de4-4fce-8aca-e3a5a1cd14df nodeName:}" failed. No retries permitted until 2026-07-09 01:38:26.669312447 +0000 UTC m=+4.880964767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-original-pull-secret") pod "global-pull-secret-syncer-xcs6g" (UID: "d934d4c6-1de4-4fce-8aca-e3a5a1cd14df") : object "kube-system"/"original-pull-secret" not registered
Jul 09 01:38:26.170855 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.169346    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-multus-cni-dir\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.170855 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.169373    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-host-cni-bin\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.170855 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.169522    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/90b8ee8a-a205-410e-a20c-63fe30c64bb1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zfnsg\" (UID: \"90b8ee8a-a205-410e-a20c-63fe30c64bb1\") " pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:26.170855 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.169593    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/06fb185c-c179-447a-a8cc-523c966571b7-env-overrides\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.170855 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.169631    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-host-run-ovn-kubernetes\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.170855 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.169654    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-multus-socket-dir-parent\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.170855 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.169695    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-multus-conf-dir\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.170855 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.169701    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-system-cni-dir\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.170855 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.169740    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-host-run-multus-certs\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.171554 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.169781    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06fb185c-c179-447a-a8cc-523c966571b7-host-slash\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.171554 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.169964    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57c14d99-09ac-43ca-8cbd-88d3ea0dae62-tmp-dir\") pod \"node-resolver-r4hf8\" (UID: \"57c14d99-09ac-43ca-8cbd-88d3ea0dae62\") " pod="openshift-dns/node-resolver-r4hf8"
Jul 09 01:38:26.171554 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.170054    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-dbus\") pod \"global-pull-secret-syncer-xcs6g\" (UID: \"d934d4c6-1de4-4fce-8aca-e3a5a1cd14df\") " pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:26.171554 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.170118    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8bbd093b-0f3c-474f-b700-7ea794383781-host-var-lib-cni-bin\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.171554 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.170134    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8bbd093b-0f3c-474f-b700-7ea794383781-cni-binary-copy\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.171554 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.170381    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/90b8ee8a-a205-410e-a20c-63fe30c64bb1-cni-binary-copy\") pod \"multus-additional-cni-plugins-zfnsg\" (UID: \"90b8ee8a-a205-410e-a20c-63fe30c64bb1\") " pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:26.174905 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.174882    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/06fb185c-c179-447a-a8cc-523c966571b7-ovn-node-metrics-cert\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.180565 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:26.180511    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 01:38:26.180565 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:26.180539    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 01:38:26.180565 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:26.180553    2562 projected.go:196] Error preparing data for projected volume kube-api-access-s4rgj for pod openshift-network-diagnostics/network-check-target-gkjkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:38:26.180783 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:26.180598    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af2aded5-20b6-406c-a3a9-d9d4f3cd725a-kube-api-access-s4rgj podName:af2aded5-20b6-406c-a3a9-d9d4f3cd725a nodeName:}" failed. No retries permitted until 2026-07-09 01:38:26.68058694 +0000 UTC m=+4.892239255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s4rgj" (UniqueName: "kubernetes.io/projected/af2aded5-20b6-406c-a3a9-d9d4f3cd725a-kube-api-access-s4rgj") pod "network-check-target-gkjkz" (UID: "af2aded5-20b6-406c-a3a9-d9d4f3cd725a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:38:26.183220 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.183194    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddxc8\" (UniqueName: \"kubernetes.io/projected/06fb185c-c179-447a-a8cc-523c966571b7-kube-api-access-ddxc8\") pod \"ovnkube-node-699pt\" (UID: \"06fb185c-c179-447a-a8cc-523c966571b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.183858 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.183814    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk884\" (UniqueName: \"kubernetes.io/projected/8bbd093b-0f3c-474f-b700-7ea794383781-kube-api-access-zk884\") pod \"multus-tf75l\" (UID: \"8bbd093b-0f3c-474f-b700-7ea794383781\") " pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.184005 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.183924    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvzdj\" (UniqueName: \"kubernetes.io/projected/354cfa30-e59e-4198-996a-62a7fd0b43dc-kube-api-access-mvzdj\") pod \"network-metrics-daemon-fbxl7\" (UID: \"354cfa30-e59e-4198-996a-62a7fd0b43dc\") " pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:26.184266 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.184242    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hb6b\" (UniqueName: \"kubernetes.io/projected/90b8ee8a-a205-410e-a20c-63fe30c64bb1-kube-api-access-2hb6b\") pod \"multus-additional-cni-plugins-zfnsg\" (UID: \"90b8ee8a-a205-410e-a20c-63fe30c64bb1\") " pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:26.185456 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.185433    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnngq\" (UniqueName: \"kubernetes.io/projected/57c14d99-09ac-43ca-8cbd-88d3ea0dae62-kube-api-access-vnngq\") pod \"node-resolver-r4hf8\" (UID: \"57c14d99-09ac-43ca-8cbd-88d3ea0dae62\") " pod="openshift-dns/node-resolver-r4hf8"
Jul 09 01:38:26.262125 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.262102    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tk226"
Jul 09 01:38:26.273000 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.272976    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pj8tk"
Jul 09 01:38:26.277078 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:26.277051    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab45d96b_8ac9_43c1_aa17_d41d6fcab7e1.slice/crio-a50656415d5cf43bd93b68578b099dbf604dabb0cf599ea374f68380c376fda9 WatchSource:0}: Error finding container a50656415d5cf43bd93b68578b099dbf604dabb0cf599ea374f68380c376fda9: Status 404 returned error can't find the container with id a50656415d5cf43bd93b68578b099dbf604dabb0cf599ea374f68380c376fda9
Jul 09 01:38:26.283135 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:26.283110    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29bbad86_47c3_451d_b62a_433c617a7e81.slice/crio-99033e7ac1b2d592c9dd708374b9ca20be0e4191ea56ad828516fd439e58cf20 WatchSource:0}: Error finding container 99033e7ac1b2d592c9dd708374b9ca20be0e4191ea56ad828516fd439e58cf20: Status 404 returned error can't find the container with id 99033e7ac1b2d592c9dd708374b9ca20be0e4191ea56ad828516fd439e58cf20
Jul 09 01:38:26.285433 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.285413    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9sjqd"
Jul 09 01:38:26.293275 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.293255    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zqpkr"
Jul 09 01:38:26.295841 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:26.295819    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1479a0d8_2d1e_48d1_ac35_9754ea6fa215.slice/crio-0e76da1327b7ff986c0b351c7fc49add2ff045cc2ab0cc4eb163994ad5ac4505 WatchSource:0}: Error finding container 0e76da1327b7ff986c0b351c7fc49add2ff045cc2ab0cc4eb163994ad5ac4505: Status 404 returned error can't find the container with id 0e76da1327b7ff986c0b351c7fc49add2ff045cc2ab0cc4eb163994ad5ac4505
Jul 09 01:38:26.301991 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.301972    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q"
Jul 09 01:38:26.303591 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:26.303569    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5d65341_3507_4208_86f3_d3269df692bc.slice/crio-6a18c074b0e22c5acb6df4dae1be59357ca0d45635cda1dbc1d872435486f4b4 WatchSource:0}: Error finding container 6a18c074b0e22c5acb6df4dae1be59357ca0d45635cda1dbc1d872435486f4b4: Status 404 returned error can't find the container with id 6a18c074b0e22c5acb6df4dae1be59357ca0d45635cda1dbc1d872435486f4b4
Jul 09 01:38:26.310662 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.310643    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r4hf8"
Jul 09 01:38:26.311605 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:26.311582    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1842fc6f_c576_4494_960b_1b7a8c583e90.slice/crio-42ec296263c2634ccaa5673d32603868c70fad4364e2a3313d24f544c556a23f WatchSource:0}: Error finding container 42ec296263c2634ccaa5673d32603868c70fad4364e2a3313d24f544c556a23f: Status 404 returned error can't find the container with id 42ec296263c2634ccaa5673d32603868c70fad4364e2a3313d24f544c556a23f
Jul 09 01:38:26.329095 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.329078    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:26.337698 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.337681    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zfnsg"
Jul 09 01:38:26.342412 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.342397    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tf75l"
Jul 09 01:38:26.672765 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.672729    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-original-pull-secret\") pod \"global-pull-secret-syncer-xcs6g\" (UID: \"d934d4c6-1de4-4fce-8aca-e3a5a1cd14df\") " pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:26.672953 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.672773    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/354cfa30-e59e-4198-996a-62a7fd0b43dc-metrics-certs\") pod \"network-metrics-daemon-fbxl7\" (UID: \"354cfa30-e59e-4198-996a-62a7fd0b43dc\") " pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:26.672953 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:26.672887    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 01:38:26.672953 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:26.672950    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-original-pull-secret podName:d934d4c6-1de4-4fce-8aca-e3a5a1cd14df nodeName:}" failed. No retries permitted until 2026-07-09 01:38:27.672934518 +0000 UTC m=+5.884586839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-original-pull-secret") pod "global-pull-secret-syncer-xcs6g" (UID: "d934d4c6-1de4-4fce-8aca-e3a5a1cd14df") : object "kube-system"/"original-pull-secret" not registered
Jul 09 01:38:26.673181 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:26.672887    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:38:26.673181 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:26.672999    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/354cfa30-e59e-4198-996a-62a7fd0b43dc-metrics-certs podName:354cfa30-e59e-4198-996a-62a7fd0b43dc nodeName:}" failed. No retries permitted until 2026-07-09 01:38:27.672989378 +0000 UTC m=+5.884641692 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/354cfa30-e59e-4198-996a-62a7fd0b43dc-metrics-certs") pod "network-metrics-daemon-fbxl7" (UID: "354cfa30-e59e-4198-996a-62a7fd0b43dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:38:26.773517 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.773481    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4rgj\" (UniqueName: \"kubernetes.io/projected/af2aded5-20b6-406c-a3a9-d9d4f3cd725a-kube-api-access-s4rgj\") pod \"network-check-target-gkjkz\" (UID: \"af2aded5-20b6-406c-a3a9-d9d4f3cd725a\") " pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:26.773670 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:26.773609    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 01:38:26.773670 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:26.773628    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 01:38:26.773670 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:26.773641    2562 projected.go:196] Error preparing data for projected volume kube-api-access-s4rgj for pod openshift-network-diagnostics/network-check-target-gkjkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:38:26.773894 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:26.773722    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af2aded5-20b6-406c-a3a9-d9d4f3cd725a-kube-api-access-s4rgj podName:af2aded5-20b6-406c-a3a9-d9d4f3cd725a nodeName:}" failed. No retries permitted until 2026-07-09 01:38:27.773702533 +0000 UTC m=+5.985354850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4rgj" (UniqueName: "kubernetes.io/projected/af2aded5-20b6-406c-a3a9-d9d4f3cd725a-kube-api-access-s4rgj") pod "network-check-target-gkjkz" (UID: "af2aded5-20b6-406c-a3a9-d9d4f3cd725a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:38:26.999740 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.999630    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 01:33:26 +0000 UTC" deadline="2028-02-10 07:07:26.292025538 +0000 UTC"
Jul 09 01:38:26.999740 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:26.999678    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13949h28m59.292352827s"
Jul 09 01:38:27.162083 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:27.162027    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9sjqd" event={"ID":"1479a0d8-2d1e-48d1-ac35-9754ea6fa215","Type":"ContainerStarted","Data":"0e76da1327b7ff986c0b351c7fc49add2ff045cc2ab0cc4eb163994ad5ac4505"}
Jul 09 01:38:27.164529 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:27.164492    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pj8tk" event={"ID":"29bbad86-47c3-451d-b62a-433c617a7e81","Type":"ContainerStarted","Data":"99033e7ac1b2d592c9dd708374b9ca20be0e4191ea56ad828516fd439e58cf20"}
Jul 09 01:38:27.166011 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:27.165939    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tk226" event={"ID":"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1","Type":"ContainerStarted","Data":"a50656415d5cf43bd93b68578b099dbf604dabb0cf599ea374f68380c376fda9"}
Jul 09 01:38:27.167462 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:27.167433    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q" event={"ID":"1842fc6f-c576-4494-960b-1b7a8c583e90","Type":"ContainerStarted","Data":"42ec296263c2634ccaa5673d32603868c70fad4364e2a3313d24f544c556a23f"}
Jul 09 01:38:27.169607 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:27.169579    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zqpkr" event={"ID":"c5d65341-3507-4208-86f3-d3269df692bc","Type":"ContainerStarted","Data":"6a18c074b0e22c5acb6df4dae1be59357ca0d45635cda1dbc1d872435486f4b4"}
Jul 09 01:38:27.589436 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:27.589399    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57c14d99_09ac_43ca_8cbd_88d3ea0dae62.slice/crio-6261939f95d25d52c6435a75897391dc4125a5c44b1a0aed4a20b714eb3649a9 WatchSource:0}: Error finding container 6261939f95d25d52c6435a75897391dc4125a5c44b1a0aed4a20b714eb3649a9: Status 404 returned error can't find the container with id 6261939f95d25d52c6435a75897391dc4125a5c44b1a0aed4a20b714eb3649a9
Jul 09 01:38:27.600820 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:27.600707    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06fb185c_c179_447a_a8cc_523c966571b7.slice/crio-39b51212c09356b973d5932b2f0d1d50a13e27d050071fd04af94b86d77fb06c WatchSource:0}: Error finding container 39b51212c09356b973d5932b2f0d1d50a13e27d050071fd04af94b86d77fb06c: Status 404 returned error can't find the container with id 39b51212c09356b973d5932b2f0d1d50a13e27d050071fd04af94b86d77fb06c
Jul 09 01:38:27.603542 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:27.603507    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b8ee8a_a205_410e_a20c_63fe30c64bb1.slice/crio-85676fe5cd6fd9d98f13ae38d06899f46e039574969a2e3d9756eca4c0c27975 WatchSource:0}: Error finding container 85676fe5cd6fd9d98f13ae38d06899f46e039574969a2e3d9756eca4c0c27975: Status 404 returned error can't find the container with id 85676fe5cd6fd9d98f13ae38d06899f46e039574969a2e3d9756eca4c0c27975
Jul 09 01:38:27.607504 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:38:27.607475    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bbd093b_0f3c_474f_b700_7ea794383781.slice/crio-470b72e833557f81a023bd84ac486853e871539f61c958eabde1fdef71bee013 WatchSource:0}: Error finding container 470b72e833557f81a023bd84ac486853e871539f61c958eabde1fdef71bee013: Status 404 returned error can't find the container with id 470b72e833557f81a023bd84ac486853e871539f61c958eabde1fdef71bee013
Jul 09 01:38:27.681608 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:27.681418    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-original-pull-secret\") pod \"global-pull-secret-syncer-xcs6g\" (UID: \"d934d4c6-1de4-4fce-8aca-e3a5a1cd14df\") " pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:27.681707 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:27.681608    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/354cfa30-e59e-4198-996a-62a7fd0b43dc-metrics-certs\") pod \"network-metrics-daemon-fbxl7\" (UID: \"354cfa30-e59e-4198-996a-62a7fd0b43dc\") " pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:27.681707 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:27.681613    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 01:38:27.681707 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:27.681697    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-original-pull-secret podName:d934d4c6-1de4-4fce-8aca-e3a5a1cd14df nodeName:}" failed. No retries permitted until 2026-07-09 01:38:29.681678256 +0000 UTC m=+7.893330597 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-original-pull-secret") pod "global-pull-secret-syncer-xcs6g" (UID: "d934d4c6-1de4-4fce-8aca-e3a5a1cd14df") : object "kube-system"/"original-pull-secret" not registered
Jul 09 01:38:27.681707 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:27.681697    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:38:27.681887 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:27.681732    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/354cfa30-e59e-4198-996a-62a7fd0b43dc-metrics-certs podName:354cfa30-e59e-4198-996a-62a7fd0b43dc nodeName:}" failed. No retries permitted until 2026-07-09 01:38:29.681722772 +0000 UTC m=+7.893375087 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/354cfa30-e59e-4198-996a-62a7fd0b43dc-metrics-certs") pod "network-metrics-daemon-fbxl7" (UID: "354cfa30-e59e-4198-996a-62a7fd0b43dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:38:27.782538 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:27.782501    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4rgj\" (UniqueName: \"kubernetes.io/projected/af2aded5-20b6-406c-a3a9-d9d4f3cd725a-kube-api-access-s4rgj\") pod \"network-check-target-gkjkz\" (UID: \"af2aded5-20b6-406c-a3a9-d9d4f3cd725a\") " pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:27.782697 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:27.782671    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 01:38:27.782697 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:27.782693    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 01:38:27.782841 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:27.782706    2562 projected.go:196] Error preparing data for projected volume kube-api-access-s4rgj for pod openshift-network-diagnostics/network-check-target-gkjkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:38:27.782841 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:27.782769    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af2aded5-20b6-406c-a3a9-d9d4f3cd725a-kube-api-access-s4rgj podName:af2aded5-20b6-406c-a3a9-d9d4f3cd725a nodeName:}" failed. No retries permitted until 2026-07-09 01:38:29.782749651 +0000 UTC m=+7.994401982 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4rgj" (UniqueName: "kubernetes.io/projected/af2aded5-20b6-406c-a3a9-d9d4f3cd725a-kube-api-access-s4rgj") pod "network-check-target-gkjkz" (UID: "af2aded5-20b6-406c-a3a9-d9d4f3cd725a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:38:28.000953 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:28.000861    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 01:33:26 +0000 UTC" deadline="2028-01-08 13:26:47.640379368 +0000 UTC"
Jul 09 01:38:28.000953 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:28.000918    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13163h48m19.639465486s"
Jul 09 01:38:28.156867 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:28.156302    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:28.156867 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:28.156424    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:28.156867 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:28.156440    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkjkz" podUID="af2aded5-20b6-406c-a3a9-d9d4f3cd725a"
Jul 09 01:38:28.156867 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:28.156560    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxl7" podUID="354cfa30-e59e-4198-996a-62a7fd0b43dc"
Jul 09 01:38:28.156867 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:28.156614    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:28.156867 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:28.156689    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xcs6g" podUID="d934d4c6-1de4-4fce-8aca-e3a5a1cd14df"
Jul 09 01:38:28.175940 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:28.175907    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-200.ec2.internal" event={"ID":"36aa469e6c34b3631d56158075dd7a0d","Type":"ContainerStarted","Data":"219e50b03b3e7684c0e69256a1257ccb2956b8338f8324b52b4e6b53ebada0d4"}
Jul 09 01:38:28.178887 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:28.178853    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-200.ec2.internal" event={"ID":"f10a9fc02587642f786ed8d229854619","Type":"ContainerStarted","Data":"952bdb5752b6897f4516444365b899322c006a16d947cc04ea78ec1e1b473334"}
Jul 09 01:38:28.184203 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:28.184176    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-699pt" event={"ID":"06fb185c-c179-447a-a8cc-523c966571b7","Type":"ContainerStarted","Data":"39b51212c09356b973d5932b2f0d1d50a13e27d050071fd04af94b86d77fb06c"}
Jul 09 01:38:28.187756 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:28.187730    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r4hf8" event={"ID":"57c14d99-09ac-43ca-8cbd-88d3ea0dae62","Type":"ContainerStarted","Data":"6261939f95d25d52c6435a75897391dc4125a5c44b1a0aed4a20b714eb3649a9"}
Jul 09 01:38:28.189696 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:28.189653    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tf75l" event={"ID":"8bbd093b-0f3c-474f-b700-7ea794383781","Type":"ContainerStarted","Data":"470b72e833557f81a023bd84ac486853e871539f61c958eabde1fdef71bee013"}
Jul 09 01:38:28.191732 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:28.191708    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfnsg" event={"ID":"90b8ee8a-a205-410e-a20c-63fe30c64bb1","Type":"ContainerStarted","Data":"85676fe5cd6fd9d98f13ae38d06899f46e039574969a2e3d9756eca4c0c27975"}
Jul 09 01:38:28.215434 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:28.215377    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-200.ec2.internal" podStartSLOduration=3.215355852 podStartE2EDuration="3.215355852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:38:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:28.214870258 +0000 UTC m=+6.426522598" watchObservedRunningTime="2026-07-09 01:38:28.215355852 +0000 UTC m=+6.427008196"
Jul 09 01:38:29.197835 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:29.196738    2562 generic.go:356] "Generic (PLEG): container finished" podID="36aa469e6c34b3631d56158075dd7a0d" containerID="219e50b03b3e7684c0e69256a1257ccb2956b8338f8324b52b4e6b53ebada0d4" exitCode=0
Jul 09 01:38:29.197835 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:29.197725    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-200.ec2.internal" event={"ID":"36aa469e6c34b3631d56158075dd7a0d","Type":"ContainerDied","Data":"219e50b03b3e7684c0e69256a1257ccb2956b8338f8324b52b4e6b53ebada0d4"}
Jul 09 01:38:29.700287 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:29.700250    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-original-pull-secret\") pod \"global-pull-secret-syncer-xcs6g\" (UID: \"d934d4c6-1de4-4fce-8aca-e3a5a1cd14df\") " pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:29.700412 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:29.700309    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/354cfa30-e59e-4198-996a-62a7fd0b43dc-metrics-certs\") pod \"network-metrics-daemon-fbxl7\" (UID: \"354cfa30-e59e-4198-996a-62a7fd0b43dc\") " pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:29.700478 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:29.700462    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:38:29.700542 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:29.700531    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/354cfa30-e59e-4198-996a-62a7fd0b43dc-metrics-certs podName:354cfa30-e59e-4198-996a-62a7fd0b43dc nodeName:}" failed. No retries permitted until 2026-07-09 01:38:33.700511363 +0000 UTC m=+11.912163689 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/354cfa30-e59e-4198-996a-62a7fd0b43dc-metrics-certs") pod "network-metrics-daemon-fbxl7" (UID: "354cfa30-e59e-4198-996a-62a7fd0b43dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:38:29.700620 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:29.700604    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 01:38:29.700697 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:29.700643    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-original-pull-secret podName:d934d4c6-1de4-4fce-8aca-e3a5a1cd14df nodeName:}" failed. No retries permitted until 2026-07-09 01:38:33.700631818 +0000 UTC m=+11.912284141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-original-pull-secret") pod "global-pull-secret-syncer-xcs6g" (UID: "d934d4c6-1de4-4fce-8aca-e3a5a1cd14df") : object "kube-system"/"original-pull-secret" not registered
Jul 09 01:38:29.800676 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:29.800644    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4rgj\" (UniqueName: \"kubernetes.io/projected/af2aded5-20b6-406c-a3a9-d9d4f3cd725a-kube-api-access-s4rgj\") pod \"network-check-target-gkjkz\" (UID: \"af2aded5-20b6-406c-a3a9-d9d4f3cd725a\") " pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:29.800838 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:29.800775    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 01:38:29.800838 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:29.800792    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 01:38:29.800838 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:29.800804    2562 projected.go:196] Error preparing data for projected volume kube-api-access-s4rgj for pod openshift-network-diagnostics/network-check-target-gkjkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:38:29.801019 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:29.800857    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af2aded5-20b6-406c-a3a9-d9d4f3cd725a-kube-api-access-s4rgj podName:af2aded5-20b6-406c-a3a9-d9d4f3cd725a nodeName:}" failed. No retries permitted until 2026-07-09 01:38:33.800836415 +0000 UTC m=+12.012488745 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4rgj" (UniqueName: "kubernetes.io/projected/af2aded5-20b6-406c-a3a9-d9d4f3cd725a-kube-api-access-s4rgj") pod "network-check-target-gkjkz" (UID: "af2aded5-20b6-406c-a3a9-d9d4f3cd725a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:38:30.151387 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:30.151344    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:30.151572 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:30.151473    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xcs6g" podUID="d934d4c6-1de4-4fce-8aca-e3a5a1cd14df"
Jul 09 01:38:30.152528 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:30.152470    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:30.152682 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:30.152570    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkjkz" podUID="af2aded5-20b6-406c-a3a9-d9d4f3cd725a"
Jul 09 01:38:30.152831 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:30.152801    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:30.152927 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:30.152907    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxl7" podUID="354cfa30-e59e-4198-996a-62a7fd0b43dc"
Jul 09 01:38:32.152171 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:32.152134    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:32.152663 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:32.152282    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xcs6g" podUID="d934d4c6-1de4-4fce-8aca-e3a5a1cd14df"
Jul 09 01:38:32.152663 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:32.152633    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:32.152794 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:32.152751    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxl7" podUID="354cfa30-e59e-4198-996a-62a7fd0b43dc"
Jul 09 01:38:32.152854 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:32.152809    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:32.152912 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:32.152880    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkjkz" podUID="af2aded5-20b6-406c-a3a9-d9d4f3cd725a"
Jul 09 01:38:33.735101 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:33.735055    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-original-pull-secret\") pod \"global-pull-secret-syncer-xcs6g\" (UID: \"d934d4c6-1de4-4fce-8aca-e3a5a1cd14df\") " pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:33.735569 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:33.735122    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/354cfa30-e59e-4198-996a-62a7fd0b43dc-metrics-certs\") pod \"network-metrics-daemon-fbxl7\" (UID: \"354cfa30-e59e-4198-996a-62a7fd0b43dc\") " pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:33.735569 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:33.735255    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:38:33.735569 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:33.735282    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 01:38:33.735569 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:33.735337    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/354cfa30-e59e-4198-996a-62a7fd0b43dc-metrics-certs podName:354cfa30-e59e-4198-996a-62a7fd0b43dc nodeName:}" failed. No retries permitted until 2026-07-09 01:38:41.735307186 +0000 UTC m=+19.946959527 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/354cfa30-e59e-4198-996a-62a7fd0b43dc-metrics-certs") pod "network-metrics-daemon-fbxl7" (UID: "354cfa30-e59e-4198-996a-62a7fd0b43dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:38:33.735569 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:33.735358    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-original-pull-secret podName:d934d4c6-1de4-4fce-8aca-e3a5a1cd14df nodeName:}" failed. No retries permitted until 2026-07-09 01:38:41.735347466 +0000 UTC m=+19.946999788 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-original-pull-secret") pod "global-pull-secret-syncer-xcs6g" (UID: "d934d4c6-1de4-4fce-8aca-e3a5a1cd14df") : object "kube-system"/"original-pull-secret" not registered
Jul 09 01:38:33.836255 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:33.835586    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4rgj\" (UniqueName: \"kubernetes.io/projected/af2aded5-20b6-406c-a3a9-d9d4f3cd725a-kube-api-access-s4rgj\") pod \"network-check-target-gkjkz\" (UID: \"af2aded5-20b6-406c-a3a9-d9d4f3cd725a\") " pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:33.836255 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:33.835780    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 01:38:33.836255 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:33.835799    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 01:38:33.836255 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:33.835813    2562 projected.go:196] Error preparing data for projected volume kube-api-access-s4rgj for pod openshift-network-diagnostics/network-check-target-gkjkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:38:33.836255 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:33.835869    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af2aded5-20b6-406c-a3a9-d9d4f3cd725a-kube-api-access-s4rgj podName:af2aded5-20b6-406c-a3a9-d9d4f3cd725a nodeName:}" failed. No retries permitted until 2026-07-09 01:38:41.835850344 +0000 UTC m=+20.047502662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4rgj" (UniqueName: "kubernetes.io/projected/af2aded5-20b6-406c-a3a9-d9d4f3cd725a-kube-api-access-s4rgj") pod "network-check-target-gkjkz" (UID: "af2aded5-20b6-406c-a3a9-d9d4f3cd725a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:38:34.152842 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:34.152791    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:34.153062 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:34.152991    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxl7" podUID="354cfa30-e59e-4198-996a-62a7fd0b43dc"
Jul 09 01:38:34.153229 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:34.153199    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:34.153352 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:34.153325    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xcs6g" podUID="d934d4c6-1de4-4fce-8aca-e3a5a1cd14df"
Jul 09 01:38:34.153427 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:34.153368    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:34.153485 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:34.153467    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkjkz" podUID="af2aded5-20b6-406c-a3a9-d9d4f3cd725a"
Jul 09 01:38:36.151842 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:36.151690    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:36.151842 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:36.151699    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:36.151842 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:36.151824    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkjkz" podUID="af2aded5-20b6-406c-a3a9-d9d4f3cd725a"
Jul 09 01:38:36.152495 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:36.151917    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxl7" podUID="354cfa30-e59e-4198-996a-62a7fd0b43dc"
Jul 09 01:38:36.152495 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:36.151978    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:36.152495 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:36.152073    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xcs6g" podUID="d934d4c6-1de4-4fce-8aca-e3a5a1cd14df"
Jul 09 01:38:37.214678 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:37.214649    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9sjqd" event={"ID":"1479a0d8-2d1e-48d1-ac35-9754ea6fa215","Type":"ContainerStarted","Data":"325698c64ce90f1e3660019e06c500afa953938501af308beb23daa7fe3734ed"}
Jul 09 01:38:37.216605 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:37.216378    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tk226" event={"ID":"ab45d96b-8ac9-43c1-aa17-d41d6fcab7e1","Type":"ContainerStarted","Data":"a83098a22a217d180fb9053fb781534db2ab8ceb51c29560c881140db01ef7a3"}
Jul 09 01:38:37.218436 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:37.218410    2562 generic.go:356] "Generic (PLEG): container finished" podID="90b8ee8a-a205-410e-a20c-63fe30c64bb1" containerID="9b81770aa2c0f3e7b50bcf95fc44d8110a1306adf78a8db750981590eefe06f0" exitCode=0
Jul 09 01:38:37.218531 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:37.218481    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfnsg" event={"ID":"90b8ee8a-a205-410e-a20c-63fe30c64bb1","Type":"ContainerDied","Data":"9b81770aa2c0f3e7b50bcf95fc44d8110a1306adf78a8db750981590eefe06f0"}
Jul 09 01:38:37.220947 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:37.220896    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-200.ec2.internal" event={"ID":"36aa469e6c34b3631d56158075dd7a0d","Type":"ContainerStarted","Data":"353e4a1ef1c3cc3f0842b4578955e3264c746cdef6daec6d48348926e0202a76"}
Jul 09 01:38:37.224475 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:37.224455    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q" event={"ID":"1842fc6f-c576-4494-960b-1b7a8c583e90","Type":"ContainerStarted","Data":"05a7354782c0d0b4bcb5a6c215989b3eb3c3c0681dc380ff1933410512f88d53"}
Jul 09 01:38:37.225819 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:37.225800    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r4hf8" event={"ID":"57c14d99-09ac-43ca-8cbd-88d3ea0dae62","Type":"ContainerStarted","Data":"d1cc8983be5891fc7bcff5030d6363a2e95c981777eb2a39053a1703038775c1"}
Jul 09 01:38:37.226941 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:37.226925    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zqpkr" event={"ID":"c5d65341-3507-4208-86f3-d3269df692bc","Type":"ContainerStarted","Data":"7f60b13d55a70a9e4f027e0f2774a3df6f605a1ee6b074eb706fa7ccd18f053f"}
Jul 09 01:38:37.240397 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:37.240359    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9sjqd" podStartSLOduration=3.001281146 podStartE2EDuration="13.240347393s" totalImagesPullingTime="10.239066247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:37.240168295 +0000 UTC m=+15.451820632" watchObservedRunningTime="2026-07-09 01:38:37.240347393 +0000 UTC m=+15.451999728"
Jul 09 01:38:37.272492 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:37.272449    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zqpkr" podStartSLOduration=2.042327943 podStartE2EDuration="12.272434477s" totalImagesPullingTime="10.230106534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:37.271428414 +0000 UTC m=+15.483080751" watchObservedRunningTime="2026-07-09 01:38:37.272434477 +0000 UTC m=+15.484086816"
Jul 09 01:38:37.280123 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:37.280102    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9sjqd_1479a0d8-2d1e-48d1-ac35-9754ea6fa215/node-ca/0.log"
Jul 09 01:38:37.312248 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:37.312202    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-r4hf8" podStartSLOduration=3.3711167140000002 podStartE2EDuration="12.312185396s" totalImagesPullingTime="8.941068682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:37.312056413 +0000 UTC m=+15.523708749" watchObservedRunningTime="2026-07-09 01:38:37.312185396 +0000 UTC m=+15.523837733"
Jul 09 01:38:37.427544 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:37.427434    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-200.ec2.internal" podStartSLOduration=12.427415964 podStartE2EDuration="12.427415964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:38:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:37.427002795 +0000 UTC m=+15.638655134" watchObservedRunningTime="2026-07-09 01:38:37.427415964 +0000 UTC m=+15.639068302"
Jul 09 01:38:37.455126 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:37.455072    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tk226" podStartSLOduration=3.195530924 podStartE2EDuration="13.455054601s" totalImagesPullingTime="10.259523677s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:37.453790437 +0000 UTC m=+15.665442774" watchObservedRunningTime="2026-07-09 01:38:37.455054601 +0000 UTC m=+15.666706919"
Jul 09 01:38:38.151713 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:38.151620    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:38.151713 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:38.151622    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:38.151904 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:38.151750    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xcs6g" podUID="d934d4c6-1de4-4fce-8aca-e3a5a1cd14df"
Jul 09 01:38:38.151904 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:38.151633    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:38.151904 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:38.151838    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxl7" podUID="354cfa30-e59e-4198-996a-62a7fd0b43dc"
Jul 09 01:38:38.151904 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:38.151879    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkjkz" podUID="af2aded5-20b6-406c-a3a9-d9d4f3cd725a"
Jul 09 01:38:38.231370 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:38.231325    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pj8tk" event={"ID":"29bbad86-47c3-451d-b62a-433c617a7e81","Type":"ContainerStarted","Data":"f61a0f768313a9855643e810485c7f97f30452e00d5be4bfcb2d5931bf820f8e"}
Jul 09 01:38:38.252580 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:38.252526    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pj8tk" podStartSLOduration=5.146482871 podStartE2EDuration="13.252509419s" totalImagesPullingTime="8.106026548s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:38.252333012 +0000 UTC m=+16.463985349" watchObservedRunningTime="2026-07-09 01:38:38.252509419 +0000 UTC m=+16.464161755"
Jul 09 01:38:40.152033 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:40.151986    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:40.152602 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:40.151993    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:40.152602 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:40.152136    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:40.152602 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:40.152131    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xcs6g" podUID="d934d4c6-1de4-4fce-8aca-e3a5a1cd14df"
Jul 09 01:38:40.152602 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:40.152258    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkjkz" podUID="af2aded5-20b6-406c-a3a9-d9d4f3cd725a"
Jul 09 01:38:40.152602 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:40.152341    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxl7" podUID="354cfa30-e59e-4198-996a-62a7fd0b43dc"
Jul 09 01:38:40.890141 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:40.890106    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zqpkr"
Jul 09 01:38:40.890840 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:40.890817    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zqpkr"
Jul 09 01:38:41.799700 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:41.799664    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-original-pull-secret\") pod \"global-pull-secret-syncer-xcs6g\" (UID: \"d934d4c6-1de4-4fce-8aca-e3a5a1cd14df\") " pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:41.800491 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:41.799730    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/354cfa30-e59e-4198-996a-62a7fd0b43dc-metrics-certs\") pod \"network-metrics-daemon-fbxl7\" (UID: \"354cfa30-e59e-4198-996a-62a7fd0b43dc\") " pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:41.800491 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:41.799837    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:38:41.800491 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:41.799893    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/354cfa30-e59e-4198-996a-62a7fd0b43dc-metrics-certs podName:354cfa30-e59e-4198-996a-62a7fd0b43dc nodeName:}" failed. No retries permitted until 2026-07-09 01:38:57.799875119 +0000 UTC m=+36.011527437 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/354cfa30-e59e-4198-996a-62a7fd0b43dc-metrics-certs") pod "network-metrics-daemon-fbxl7" (UID: "354cfa30-e59e-4198-996a-62a7fd0b43dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:38:41.800491 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:41.800247    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 01:38:41.800491 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:41.800285    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-original-pull-secret podName:d934d4c6-1de4-4fce-8aca-e3a5a1cd14df nodeName:}" failed. No retries permitted until 2026-07-09 01:38:57.800274867 +0000 UTC m=+36.011927181 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-original-pull-secret") pod "global-pull-secret-syncer-xcs6g" (UID: "d934d4c6-1de4-4fce-8aca-e3a5a1cd14df") : object "kube-system"/"original-pull-secret" not registered
Jul 09 01:38:41.900317 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:41.900276    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4rgj\" (UniqueName: \"kubernetes.io/projected/af2aded5-20b6-406c-a3a9-d9d4f3cd725a-kube-api-access-s4rgj\") pod \"network-check-target-gkjkz\" (UID: \"af2aded5-20b6-406c-a3a9-d9d4f3cd725a\") " pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:41.900503 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:41.900479    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 01:38:41.900503 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:41.900498    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 01:38:41.900612 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:41.900510    2562 projected.go:196] Error preparing data for projected volume kube-api-access-s4rgj for pod openshift-network-diagnostics/network-check-target-gkjkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:38:41.900612 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:41.900565    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af2aded5-20b6-406c-a3a9-d9d4f3cd725a-kube-api-access-s4rgj podName:af2aded5-20b6-406c-a3a9-d9d4f3cd725a nodeName:}" failed. No retries permitted until 2026-07-09 01:38:57.900548336 +0000 UTC m=+36.112200664 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4rgj" (UniqueName: "kubernetes.io/projected/af2aded5-20b6-406c-a3a9-d9d4f3cd725a-kube-api-access-s4rgj") pod "network-check-target-gkjkz" (UID: "af2aded5-20b6-406c-a3a9-d9d4f3cd725a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:38:42.154905 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:42.154876    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:42.155098 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:42.154983    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:42.155098 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:42.154984    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xcs6g" podUID="d934d4c6-1de4-4fce-8aca-e3a5a1cd14df"
Jul 09 01:38:42.155098 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:42.155010    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:42.155267 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:42.155124    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxl7" podUID="354cfa30-e59e-4198-996a-62a7fd0b43dc"
Jul 09 01:38:42.155267 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:42.155202    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkjkz" podUID="af2aded5-20b6-406c-a3a9-d9d4f3cd725a"
Jul 09 01:38:44.152359 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:44.152323    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:44.152963 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:44.152445    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:44.152963 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:44.152448    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxl7" podUID="354cfa30-e59e-4198-996a-62a7fd0b43dc"
Jul 09 01:38:44.152963 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:44.152476    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:44.152963 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:44.152566    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xcs6g" podUID="d934d4c6-1de4-4fce-8aca-e3a5a1cd14df"
Jul 09 01:38:44.152963 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:44.152651    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkjkz" podUID="af2aded5-20b6-406c-a3a9-d9d4f3cd725a"
Jul 09 01:38:46.152032 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:46.151989    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:46.152614 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:46.152107    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xcs6g" podUID="d934d4c6-1de4-4fce-8aca-e3a5a1cd14df"
Jul 09 01:38:46.152614 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:46.152166    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:46.152614 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:46.152179    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:46.152614 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:46.152259    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkjkz" podUID="af2aded5-20b6-406c-a3a9-d9d4f3cd725a"
Jul 09 01:38:46.152614 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:46.152328    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxl7" podUID="354cfa30-e59e-4198-996a-62a7fd0b43dc"
Jul 09 01:38:48.152040 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:48.151487    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:48.152040 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:48.151786    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxl7" podUID="354cfa30-e59e-4198-996a-62a7fd0b43dc"
Jul 09 01:38:48.152040 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:48.151568    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:48.152040 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:48.151878    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkjkz" podUID="af2aded5-20b6-406c-a3a9-d9d4f3cd725a"
Jul 09 01:38:48.152040 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:48.151499    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:48.152040 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:48.151954    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xcs6g" podUID="d934d4c6-1de4-4fce-8aca-e3a5a1cd14df"
Jul 09 01:38:48.212806 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:48.212785    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 01:38:48.252820 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:48.252786    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q" event={"ID":"1842fc6f-c576-4494-960b-1b7a8c583e90","Type":"ContainerStarted","Data":"cd13269ec32dda181723fec1734227ab072f5b43d43bb04a4e87ea65dec3a05d"}
Jul 09 01:38:48.254403 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:48.254380    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-699pt" event={"ID":"06fb185c-c179-447a-a8cc-523c966571b7","Type":"ContainerStarted","Data":"d03a1c9e6a9a3bdac3c928b1147c6968d74da7905f6bc467f5fbe821853509c0"}
Jul 09 01:38:48.255762 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:48.255734    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tf75l" event={"ID":"8bbd093b-0f3c-474f-b700-7ea794383781","Type":"ContainerStarted","Data":"9a1784978cc093eabfbb113a76546a88ba40a27e82e478384424b7b4caeb4acb"}
Jul 09 01:38:48.274503 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:48.274457    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tf75l" podStartSLOduration=2.856134844 podStartE2EDuration="23.274443966s" totalImagesPullingTime="20.418309122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:48.274183919 +0000 UTC m=+26.485836257" watchObservedRunningTime="2026-07-09 01:38:48.274443966 +0000 UTC m=+26.486096303"
Jul 09 01:38:48.777523 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:48.777312    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zqpkr"
Jul 09 01:38:48.777676 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:48.777632    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 01:38:48.777965 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:48.777946    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zqpkr"
Jul 09 01:38:49.013978 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:49.013850    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T01:38:48.212802453Z","UUID":"a662011a-4daf-4d34-ac4d-a839a3ef81cd","Handler":null,"Name":"","Endpoint":""}
Jul 09 01:38:49.015423 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:49.015404    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 01:38:49.015554 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:49.015438    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 01:38:49.258747 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:49.258715    2562 generic.go:356] "Generic (PLEG): container finished" podID="90b8ee8a-a205-410e-a20c-63fe30c64bb1" containerID="568d9e6ea7923d17826f6cc2f54dd73824dbfbcd7778d3cb98873e9cf581a580" exitCode=0
Jul 09 01:38:49.259127 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:49.258798    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfnsg" event={"ID":"90b8ee8a-a205-410e-a20c-63fe30c64bb1","Type":"ContainerDied","Data":"568d9e6ea7923d17826f6cc2f54dd73824dbfbcd7778d3cb98873e9cf581a580"}
Jul 09 01:38:49.261587 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:49.261563    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-699pt" event={"ID":"06fb185c-c179-447a-a8cc-523c966571b7","Type":"ContainerStarted","Data":"d769279cfe21a8d6ee8bf419129d0b48b6debc61ef515673f6699995a5eda6bc"}
Jul 09 01:38:49.261669 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:49.261639    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-699pt" event={"ID":"06fb185c-c179-447a-a8cc-523c966571b7","Type":"ContainerStarted","Data":"26a437b6be1ad25496e284f11da843a927130ad883d6391bf278452cf35f7648"}
Jul 09 01:38:49.261719 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:49.261689    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-699pt" event={"ID":"06fb185c-c179-447a-a8cc-523c966571b7","Type":"ContainerStarted","Data":"2ff2ebe3f1e4bd7fafeb2415ef5bc73e05cc2cedf6a921f6651bfe8a330a6e27"}
Jul 09 01:38:49.261757 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:49.261744    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-699pt" event={"ID":"06fb185c-c179-447a-a8cc-523c966571b7","Type":"ContainerStarted","Data":"5dc6e405e9d6a572b5024de7faf1e9d1e87562e2f1a642124bedaab64cc3d672"}
Jul 09 01:38:49.261801 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:49.261788    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-699pt" event={"ID":"06fb185c-c179-447a-a8cc-523c966571b7","Type":"ContainerStarted","Data":"2cc8fd148bad8b99114a924d2d188b6c2c710924c9d94803520c80c3aec1f1f5"}
Jul 09 01:38:50.151972 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:50.151945    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:50.151972 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:50.151965    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:50.152152 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:50.151952    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:50.152152 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:50.152051    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xcs6g" podUID="d934d4c6-1de4-4fce-8aca-e3a5a1cd14df"
Jul 09 01:38:50.152152 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:50.152115    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkjkz" podUID="af2aded5-20b6-406c-a3a9-d9d4f3cd725a"
Jul 09 01:38:50.152258 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:50.152181    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxl7" podUID="354cfa30-e59e-4198-996a-62a7fd0b43dc"
Jul 09 01:38:50.266352 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:50.266277    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q" event={"ID":"1842fc6f-c576-4494-960b-1b7a8c583e90","Type":"ContainerStarted","Data":"f30c032a7b9df8eb379179828ea275ad178719f008651f252f3d4b2932b623b5"}
Jul 09 01:38:51.270976 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:51.270903    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-699pt" event={"ID":"06fb185c-c179-447a-a8cc-523c966571b7","Type":"ContainerStarted","Data":"cadac8f9df0ac23c723008e2c46c8737bb03db8f6db1a4bf901206eab3c7b523"}
Jul 09 01:38:51.272968 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:51.272929    2562 generic.go:356] "Generic (PLEG): container finished" podID="90b8ee8a-a205-410e-a20c-63fe30c64bb1" containerID="902813a07b50de0de1e37f5a74ef39421ae787bc0f3ba4eeedcab5107372d233" exitCode=0
Jul 09 01:38:51.273108 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:51.273007    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfnsg" event={"ID":"90b8ee8a-a205-410e-a20c-63fe30c64bb1","Type":"ContainerDied","Data":"902813a07b50de0de1e37f5a74ef39421ae787bc0f3ba4eeedcab5107372d233"}
Jul 09 01:38:51.296504 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:51.296463    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cgw8q" podStartSLOduration=3.715910811 podStartE2EDuration="26.296451127s" totalImagesPullingTime="22.580540316s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:38:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:50.284125275 +0000 UTC m=+28.495777614" watchObservedRunningTime="2026-07-09 01:38:51.296451127 +0000 UTC m=+29.508103462"
Jul 09 01:38:52.151562 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:52.151532    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:52.151562 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:52.151542    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:52.151843 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:52.151644    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:52.151843 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:52.151643    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkjkz" podUID="af2aded5-20b6-406c-a3a9-d9d4f3cd725a"
Jul 09 01:38:52.151843 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:52.151754    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxl7" podUID="354cfa30-e59e-4198-996a-62a7fd0b43dc"
Jul 09 01:38:52.151843 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:52.151836    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xcs6g" podUID="d934d4c6-1de4-4fce-8aca-e3a5a1cd14df"
Jul 09 01:38:53.281499 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:53.281222    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-699pt" event={"ID":"06fb185c-c179-447a-a8cc-523c966571b7","Type":"ContainerStarted","Data":"204ca5c3b4f451826ef6323b106cfb1900fbb920bf7898e57b3df53e6af755b5"}
Jul 09 01:38:53.282265 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:53.281499    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:53.282265 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:53.281556    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:53.282265 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:53.281600    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:53.284108 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:53.284084    2562 generic.go:356] "Generic (PLEG): container finished" podID="90b8ee8a-a205-410e-a20c-63fe30c64bb1" containerID="0d87980de0d58af6e65012d45650ead2db0dd802ea7e6d42b8a722f8255e8da7" exitCode=0
Jul 09 01:38:53.284211 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:53.284143    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfnsg" event={"ID":"90b8ee8a-a205-410e-a20c-63fe30c64bb1","Type":"ContainerDied","Data":"0d87980de0d58af6e65012d45650ead2db0dd802ea7e6d42b8a722f8255e8da7"}
Jul 09 01:38:53.297747 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:53.297727    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:53.297828 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:53.297818    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:38:53.312405 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:53.312368    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-699pt" podStartSLOduration=7.884722442 podStartE2EDuration="28.3123546s" totalImagesPullingTime="20.427632158s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:53.311914323 +0000 UTC m=+31.523566659" watchObservedRunningTime="2026-07-09 01:38:53.3123546 +0000 UTC m=+31.524006936"
Jul 09 01:38:54.152030 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:54.151981    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:54.152195 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:54.152081    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xcs6g" podUID="d934d4c6-1de4-4fce-8aca-e3a5a1cd14df"
Jul 09 01:38:54.152195 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:54.152133    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:54.152195 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:54.152193    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxl7" podUID="354cfa30-e59e-4198-996a-62a7fd0b43dc"
Jul 09 01:38:54.152443 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:54.152414    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:54.152558 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:54.152511    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkjkz" podUID="af2aded5-20b6-406c-a3a9-d9d4f3cd725a"
Jul 09 01:38:56.151475 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:56.151443    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:56.151475 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:56.151480    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:56.151991 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:56.151443    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:56.151991 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:56.151565    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxl7" podUID="354cfa30-e59e-4198-996a-62a7fd0b43dc"
Jul 09 01:38:56.151991 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:56.151632    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xcs6g" podUID="d934d4c6-1de4-4fce-8aca-e3a5a1cd14df"
Jul 09 01:38:56.151991 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:56.151719    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkjkz" podUID="af2aded5-20b6-406c-a3a9-d9d4f3cd725a"
Jul 09 01:38:57.816991 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:57.816947    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-original-pull-secret\") pod \"global-pull-secret-syncer-xcs6g\" (UID: \"d934d4c6-1de4-4fce-8aca-e3a5a1cd14df\") " pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:57.817423 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:57.817002    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/354cfa30-e59e-4198-996a-62a7fd0b43dc-metrics-certs\") pod \"network-metrics-daemon-fbxl7\" (UID: \"354cfa30-e59e-4198-996a-62a7fd0b43dc\") " pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:57.817423 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:57.817122    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 01:38:57.817423 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:57.817139    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:38:57.817423 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:57.817192    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/354cfa30-e59e-4198-996a-62a7fd0b43dc-metrics-certs podName:354cfa30-e59e-4198-996a-62a7fd0b43dc nodeName:}" failed. No retries permitted until 2026-07-09 01:39:29.817173435 +0000 UTC m=+68.028825750 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/354cfa30-e59e-4198-996a-62a7fd0b43dc-metrics-certs") pod "network-metrics-daemon-fbxl7" (UID: "354cfa30-e59e-4198-996a-62a7fd0b43dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:38:57.817423 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:57.817209    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-original-pull-secret podName:d934d4c6-1de4-4fce-8aca-e3a5a1cd14df nodeName:}" failed. No retries permitted until 2026-07-09 01:39:29.817199958 +0000 UTC m=+68.028852276 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-original-pull-secret") pod "global-pull-secret-syncer-xcs6g" (UID: "d934d4c6-1de4-4fce-8aca-e3a5a1cd14df") : object "kube-system"/"original-pull-secret" not registered
Jul 09 01:38:57.918181 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:57.918145    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4rgj\" (UniqueName: \"kubernetes.io/projected/af2aded5-20b6-406c-a3a9-d9d4f3cd725a-kube-api-access-s4rgj\") pod \"network-check-target-gkjkz\" (UID: \"af2aded5-20b6-406c-a3a9-d9d4f3cd725a\") " pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:57.918342 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:57.918327    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 01:38:57.918406 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:57.918351    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 01:38:57.918406 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:57.918365    2562 projected.go:196] Error preparing data for projected volume kube-api-access-s4rgj for pod openshift-network-diagnostics/network-check-target-gkjkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:38:57.918492 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:57.918438    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af2aded5-20b6-406c-a3a9-d9d4f3cd725a-kube-api-access-s4rgj podName:af2aded5-20b6-406c-a3a9-d9d4f3cd725a nodeName:}" failed. No retries permitted until 2026-07-09 01:39:29.918421032 +0000 UTC m=+68.130073368 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4rgj" (UniqueName: "kubernetes.io/projected/af2aded5-20b6-406c-a3a9-d9d4f3cd725a-kube-api-access-s4rgj") pod "network-check-target-gkjkz" (UID: "af2aded5-20b6-406c-a3a9-d9d4f3cd725a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:38:58.151139 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:58.151115    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:58.151240 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:58.151115    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:58.151294 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:58.151239    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkjkz" podUID="af2aded5-20b6-406c-a3a9-d9d4f3cd725a"
Jul 09 01:38:58.151294 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:58.151247    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:58.151390 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:58.151315    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xcs6g" podUID="d934d4c6-1de4-4fce-8aca-e3a5a1cd14df"
Jul 09 01:38:58.151440 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:58.151401    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxl7" podUID="354cfa30-e59e-4198-996a-62a7fd0b43dc"
Jul 09 01:38:58.298856 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:58.298822    2562 generic.go:356] "Generic (PLEG): container finished" podID="90b8ee8a-a205-410e-a20c-63fe30c64bb1" containerID="e5d25da69e6223e03e8c86d83877bb382b04f37c93214e769113cad49648cbef" exitCode=0
Jul 09 01:38:58.298957 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:58.298889    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfnsg" event={"ID":"90b8ee8a-a205-410e-a20c-63fe30c64bb1","Type":"ContainerDied","Data":"e5d25da69e6223e03e8c86d83877bb382b04f37c93214e769113cad49648cbef"}
Jul 09 01:38:59.303896 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:59.303749    2562 generic.go:356] "Generic (PLEG): container finished" podID="90b8ee8a-a205-410e-a20c-63fe30c64bb1" containerID="e56aa7fbe392a068df1ad6b880073c6ff8e1c91718071b861e045a8ab05dc2f5" exitCode=0
Jul 09 01:38:59.304214 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:59.303839    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfnsg" event={"ID":"90b8ee8a-a205-410e-a20c-63fe30c64bb1","Type":"ContainerDied","Data":"e56aa7fbe392a068df1ad6b880073c6ff8e1c91718071b861e045a8ab05dc2f5"}
Jul 09 01:38:59.334645 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:59.334619    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xcs6g"]
Jul 09 01:38:59.334915 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:59.334896    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:38:59.335053 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:59.335004    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xcs6g" podUID="d934d4c6-1de4-4fce-8aca-e3a5a1cd14df"
Jul 09 01:38:59.335180 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:59.335161    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gkjkz"]
Jul 09 01:38:59.335310 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:59.335256    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:38:59.335388 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:59.335345    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkjkz" podUID="af2aded5-20b6-406c-a3a9-d9d4f3cd725a"
Jul 09 01:38:59.336570 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:59.336551    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fbxl7"]
Jul 09 01:38:59.336668 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:38:59.336649    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:38:59.336750 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:38:59.336733    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxl7" podUID="354cfa30-e59e-4198-996a-62a7fd0b43dc"
Jul 09 01:39:00.309285 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:00.309257    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfnsg" event={"ID":"90b8ee8a-a205-410e-a20c-63fe30c64bb1","Type":"ContainerStarted","Data":"17d4cf195dce27ad2a556ca75715354b444d7de80fd3e401d202bfacfdd3d28e"}
Jul 09 01:39:00.335885 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:00.335846    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zfnsg" podStartSLOduration=8.024859916 podStartE2EDuration="35.335832319s" totalImagesPullingTime="27.310972403s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:38:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:00.3343715 +0000 UTC m=+38.546023840" watchObservedRunningTime="2026-07-09 01:39:00.335832319 +0000 UTC m=+38.547484655"
Jul 09 01:39:01.151160 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:01.151134    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:39:01.151289 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:01.151226    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:39:01.151289 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:39:01.151234    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbxl7" podUID="354cfa30-e59e-4198-996a-62a7fd0b43dc"
Jul 09 01:39:01.151289 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:01.151250    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:39:01.151414 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:39:01.151309    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xcs6g" podUID="d934d4c6-1de4-4fce-8aca-e3a5a1cd14df"
Jul 09 01:39:01.151414 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:39:01.151369    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkjkz" podUID="af2aded5-20b6-406c-a3a9-d9d4f3cd725a"
Jul 09 01:39:02.556319 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.556293    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-200.ec2.internal" event="NodeReady"
Jul 09 01:39:02.556709 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.556398    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 01:39:02.605331 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.605305    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-24ln9"]
Jul 09 01:39:02.612522 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.612502    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-695mk"]
Jul 09 01:39:02.612637 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.612621    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-24ln9"
Jul 09 01:39:02.615419 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.615399    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 01:39:02.615515 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.615399    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 01:39:02.615515 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.615424    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s9n5n\""
Jul 09 01:39:02.622671 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.622641    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-24ln9"]
Jul 09 01:39:02.622767 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.622743    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-695mk"
Jul 09 01:39:02.623635 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.623616    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-695mk"]
Jul 09 01:39:02.625529 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.625510    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 01:39:02.625529 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.625526    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 01:39:02.625717 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.625527    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4v722\""
Jul 09 01:39:02.625847 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.625828    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 01:39:02.625926 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.625873    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 01:39:02.707347 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.707280    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-chv7g"]
Jul 09 01:39:02.711927 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.711912    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-chv7g"
Jul 09 01:39:02.714791 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.714767    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 01:39:02.714791 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.714781    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 01:39:02.714946 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.714810    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 01:39:02.715317 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.715297    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n8xpm\""
Jul 09 01:39:02.719010 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.718989    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-chv7g"]
Jul 09 01:39:02.756520 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.756495    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7np4\" (UniqueName: \"kubernetes.io/projected/57eec479-7796-4606-b98b-0cf65bd96d8f-kube-api-access-g7np4\") pod \"dns-default-24ln9\" (UID: \"57eec479-7796-4606-b98b-0cf65bd96d8f\") " pod="openshift-dns/dns-default-24ln9"
Jul 09 01:39:02.756614 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.756522    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebc6286a-5d2f-4e0e-b90f-950fd091c42f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-695mk\" (UID: \"ebc6286a-5d2f-4e0e-b90f-950fd091c42f\") " pod="openshift-insights/insights-runtime-extractor-695mk"
Jul 09 01:39:02.756614 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.756552    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57eec479-7796-4606-b98b-0cf65bd96d8f-tmp-dir\") pod \"dns-default-24ln9\" (UID: \"57eec479-7796-4606-b98b-0cf65bd96d8f\") " pod="openshift-dns/dns-default-24ln9"
Jul 09 01:39:02.756614 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.756574    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebc6286a-5d2f-4e0e-b90f-950fd091c42f-data-volume\") pod \"insights-runtime-extractor-695mk\" (UID: \"ebc6286a-5d2f-4e0e-b90f-950fd091c42f\") " pod="openshift-insights/insights-runtime-extractor-695mk"
Jul 09 01:39:02.756614 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.756597    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebc6286a-5d2f-4e0e-b90f-950fd091c42f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-695mk\" (UID: \"ebc6286a-5d2f-4e0e-b90f-950fd091c42f\") " pod="openshift-insights/insights-runtime-extractor-695mk"
Jul 09 01:39:02.756740 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.756643    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/57eec479-7796-4606-b98b-0cf65bd96d8f-metrics-tls\") pod \"dns-default-24ln9\" (UID: \"57eec479-7796-4606-b98b-0cf65bd96d8f\") " pod="openshift-dns/dns-default-24ln9"
Jul 09 01:39:02.756740 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.756690    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/57eec479-7796-4606-b98b-0cf65bd96d8f-config-volume\") pod \"dns-default-24ln9\" (UID: \"57eec479-7796-4606-b98b-0cf65bd96d8f\") " pod="openshift-dns/dns-default-24ln9"
Jul 09 01:39:02.756740 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.756711    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcb8v\" (UniqueName: \"kubernetes.io/projected/ebc6286a-5d2f-4e0e-b90f-950fd091c42f-kube-api-access-xcb8v\") pod \"insights-runtime-extractor-695mk\" (UID: \"ebc6286a-5d2f-4e0e-b90f-950fd091c42f\") " pod="openshift-insights/insights-runtime-extractor-695mk"
Jul 09 01:39:02.756824 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.756743    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ebc6286a-5d2f-4e0e-b90f-950fd091c42f-crio-socket\") pod \"insights-runtime-extractor-695mk\" (UID: \"ebc6286a-5d2f-4e0e-b90f-950fd091c42f\") " pod="openshift-insights/insights-runtime-extractor-695mk"
Jul 09 01:39:02.857364 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.857339    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c9d9da1-bf01-4198-b1f7-dfe8e764ae28-cert\") pod \"ingress-canary-chv7g\" (UID: \"1c9d9da1-bf01-4198-b1f7-dfe8e764ae28\") " pod="openshift-ingress-canary/ingress-canary-chv7g"
Jul 09 01:39:02.857495 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.857369    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42l2j\" (UniqueName: \"kubernetes.io/projected/1c9d9da1-bf01-4198-b1f7-dfe8e764ae28-kube-api-access-42l2j\") pod \"ingress-canary-chv7g\" (UID: \"1c9d9da1-bf01-4198-b1f7-dfe8e764ae28\") " pod="openshift-ingress-canary/ingress-canary-chv7g"
Jul 09 01:39:02.857495 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.857398    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7np4\" (UniqueName: \"kubernetes.io/projected/57eec479-7796-4606-b98b-0cf65bd96d8f-kube-api-access-g7np4\") pod \"dns-default-24ln9\" (UID: \"57eec479-7796-4606-b98b-0cf65bd96d8f\") " pod="openshift-dns/dns-default-24ln9"
Jul 09 01:39:02.857495 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.857445    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebc6286a-5d2f-4e0e-b90f-950fd091c42f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-695mk\" (UID: \"ebc6286a-5d2f-4e0e-b90f-950fd091c42f\") " pod="openshift-insights/insights-runtime-extractor-695mk"
Jul 09 01:39:02.857495 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.857483    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57eec479-7796-4606-b98b-0cf65bd96d8f-tmp-dir\") pod \"dns-default-24ln9\" (UID: \"57eec479-7796-4606-b98b-0cf65bd96d8f\") " pod="openshift-dns/dns-default-24ln9"
Jul 09 01:39:02.857637 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.857506    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebc6286a-5d2f-4e0e-b90f-950fd091c42f-data-volume\") pod \"insights-runtime-extractor-695mk\" (UID: \"ebc6286a-5d2f-4e0e-b90f-950fd091c42f\") " pod="openshift-insights/insights-runtime-extractor-695mk"
Jul 09 01:39:02.857637 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.857523    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebc6286a-5d2f-4e0e-b90f-950fd091c42f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-695mk\" (UID: \"ebc6286a-5d2f-4e0e-b90f-950fd091c42f\") " pod="openshift-insights/insights-runtime-extractor-695mk"
Jul 09 01:39:02.857637 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.857541    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/57eec479-7796-4606-b98b-0cf65bd96d8f-metrics-tls\") pod \"dns-default-24ln9\" (UID: \"57eec479-7796-4606-b98b-0cf65bd96d8f\") " pod="openshift-dns/dns-default-24ln9"
Jul 09 01:39:02.857637 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.857568    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/57eec479-7796-4606-b98b-0cf65bd96d8f-config-volume\") pod \"dns-default-24ln9\" (UID: \"57eec479-7796-4606-b98b-0cf65bd96d8f\") " pod="openshift-dns/dns-default-24ln9"
Jul 09 01:39:02.857797 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.857669    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcb8v\" (UniqueName: \"kubernetes.io/projected/ebc6286a-5d2f-4e0e-b90f-950fd091c42f-kube-api-access-xcb8v\") pod \"insights-runtime-extractor-695mk\" (UID: \"ebc6286a-5d2f-4e0e-b90f-950fd091c42f\") " pod="openshift-insights/insights-runtime-extractor-695mk"
Jul 09 01:39:02.857797 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.857703    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ebc6286a-5d2f-4e0e-b90f-950fd091c42f-crio-socket\") pod \"insights-runtime-extractor-695mk\" (UID: \"ebc6286a-5d2f-4e0e-b90f-950fd091c42f\") " pod="openshift-insights/insights-runtime-extractor-695mk"
Jul 09 01:39:02.857917 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.857893    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57eec479-7796-4606-b98b-0cf65bd96d8f-tmp-dir\") pod \"dns-default-24ln9\" (UID: \"57eec479-7796-4606-b98b-0cf65bd96d8f\") " pod="openshift-dns/dns-default-24ln9"
Jul 09 01:39:02.858108 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.857892    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebc6286a-5d2f-4e0e-b90f-950fd091c42f-data-volume\") pod \"insights-runtime-extractor-695mk\" (UID: \"ebc6286a-5d2f-4e0e-b90f-950fd091c42f\") " pod="openshift-insights/insights-runtime-extractor-695mk"
Jul 09 01:39:02.858108 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.857929    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ebc6286a-5d2f-4e0e-b90f-950fd091c42f-crio-socket\") pod \"insights-runtime-extractor-695mk\" (UID: \"ebc6286a-5d2f-4e0e-b90f-950fd091c42f\") " pod="openshift-insights/insights-runtime-extractor-695mk"
Jul 09 01:39:02.858266 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.858133    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebc6286a-5d2f-4e0e-b90f-950fd091c42f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-695mk\" (UID: \"ebc6286a-5d2f-4e0e-b90f-950fd091c42f\") " pod="openshift-insights/insights-runtime-extractor-695mk"
Jul 09 01:39:02.858354 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.858332    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/57eec479-7796-4606-b98b-0cf65bd96d8f-config-volume\") pod \"dns-default-24ln9\" (UID: \"57eec479-7796-4606-b98b-0cf65bd96d8f\") " pod="openshift-dns/dns-default-24ln9"
Jul 09 01:39:02.861261 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.861244    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebc6286a-5d2f-4e0e-b90f-950fd091c42f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-695mk\" (UID: \"ebc6286a-5d2f-4e0e-b90f-950fd091c42f\") " pod="openshift-insights/insights-runtime-extractor-695mk"
Jul 09 01:39:02.861261 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.861255    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/57eec479-7796-4606-b98b-0cf65bd96d8f-metrics-tls\") pod \"dns-default-24ln9\" (UID: \"57eec479-7796-4606-b98b-0cf65bd96d8f\") " pod="openshift-dns/dns-default-24ln9"
Jul 09 01:39:02.869762 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.869740    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcb8v\" (UniqueName: \"kubernetes.io/projected/ebc6286a-5d2f-4e0e-b90f-950fd091c42f-kube-api-access-xcb8v\") pod \"insights-runtime-extractor-695mk\" (UID: \"ebc6286a-5d2f-4e0e-b90f-950fd091c42f\") " pod="openshift-insights/insights-runtime-extractor-695mk"
Jul 09 01:39:02.869974 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.869958    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7np4\" (UniqueName: \"kubernetes.io/projected/57eec479-7796-4606-b98b-0cf65bd96d8f-kube-api-access-g7np4\") pod \"dns-default-24ln9\" (UID: \"57eec479-7796-4606-b98b-0cf65bd96d8f\") " pod="openshift-dns/dns-default-24ln9"
Jul 09 01:39:02.922174 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.922152    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-24ln9"
Jul 09 01:39:02.931376 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.931356    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-695mk"
Jul 09 01:39:02.958713 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.958692    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c9d9da1-bf01-4198-b1f7-dfe8e764ae28-cert\") pod \"ingress-canary-chv7g\" (UID: \"1c9d9da1-bf01-4198-b1f7-dfe8e764ae28\") " pod="openshift-ingress-canary/ingress-canary-chv7g"
Jul 09 01:39:02.958794 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.958731    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42l2j\" (UniqueName: \"kubernetes.io/projected/1c9d9da1-bf01-4198-b1f7-dfe8e764ae28-kube-api-access-42l2j\") pod \"ingress-canary-chv7g\" (UID: \"1c9d9da1-bf01-4198-b1f7-dfe8e764ae28\") " pod="openshift-ingress-canary/ingress-canary-chv7g"
Jul 09 01:39:02.961011 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.960992    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c9d9da1-bf01-4198-b1f7-dfe8e764ae28-cert\") pod \"ingress-canary-chv7g\" (UID: \"1c9d9da1-bf01-4198-b1f7-dfe8e764ae28\") " pod="openshift-ingress-canary/ingress-canary-chv7g"
Jul 09 01:39:02.967655 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:02.967616    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42l2j\" (UniqueName: \"kubernetes.io/projected/1c9d9da1-bf01-4198-b1f7-dfe8e764ae28-kube-api-access-42l2j\") pod \"ingress-canary-chv7g\" (UID: \"1c9d9da1-bf01-4198-b1f7-dfe8e764ae28\") " pod="openshift-ingress-canary/ingress-canary-chv7g"
Jul 09 01:39:03.020798 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:03.020766    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-chv7g"
Jul 09 01:39:03.110301 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:03.110089    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-695mk"]
Jul 09 01:39:03.113607 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:39:03.113574    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebc6286a_5d2f_4e0e_b90f_950fd091c42f.slice/crio-be6e334f707a2b55248549c9228f6f063e68e9ba9af1c709e006f497eaf13f0c WatchSource:0}: Error finding container be6e334f707a2b55248549c9228f6f063e68e9ba9af1c709e006f497eaf13f0c: Status 404 returned error can't find the container with id be6e334f707a2b55248549c9228f6f063e68e9ba9af1c709e006f497eaf13f0c
Jul 09 01:39:03.114265 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:03.114244    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-24ln9"]
Jul 09 01:39:03.118907 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:39:03.118882    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57eec479_7796_4606_b98b_0cf65bd96d8f.slice/crio-64bbcd81837666f86c8671d212f656d03e75e5188c8c1666af7a08fc6d613d46 WatchSource:0}: Error finding container 64bbcd81837666f86c8671d212f656d03e75e5188c8c1666af7a08fc6d613d46: Status 404 returned error can't find the container with id 64bbcd81837666f86c8671d212f656d03e75e5188c8c1666af7a08fc6d613d46
Jul 09 01:39:03.151391 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:03.151365    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:39:03.151489 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:03.151370    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:39:03.151542 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:03.151497    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:39:03.155459 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:03.154782    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 01:39:03.155459 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:03.154894    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 01:39:03.155459 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:03.155049    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9w8gn\""
Jul 09 01:39:03.155459 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:03.154784    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 01:39:03.155459 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:03.155289    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 01:39:03.155459 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:03.155409    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-npl7s\""
Jul 09 01:39:03.182957 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:03.182923    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-chv7g"]
Jul 09 01:39:03.186923 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:39:03.186902    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c9d9da1_bf01_4198_b1f7_dfe8e764ae28.slice/crio-f9624d6743adc1ef73ad34df862cd2f26c8a8f00ab08fcf7f05f6ee2030f9be3 WatchSource:0}: Error finding container f9624d6743adc1ef73ad34df862cd2f26c8a8f00ab08fcf7f05f6ee2030f9be3: Status 404 returned error can't find the container with id f9624d6743adc1ef73ad34df862cd2f26c8a8f00ab08fcf7f05f6ee2030f9be3
Jul 09 01:39:03.317070 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:03.317039    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-695mk" event={"ID":"ebc6286a-5d2f-4e0e-b90f-950fd091c42f","Type":"ContainerStarted","Data":"be6e334f707a2b55248549c9228f6f063e68e9ba9af1c709e006f497eaf13f0c"}
Jul 09 01:39:03.318067 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:03.318045    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-24ln9" event={"ID":"57eec479-7796-4606-b98b-0cf65bd96d8f","Type":"ContainerStarted","Data":"64bbcd81837666f86c8671d212f656d03e75e5188c8c1666af7a08fc6d613d46"}
Jul 09 01:39:03.319088 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:03.319070    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-chv7g" event={"ID":"1c9d9da1-bf01-4198-b1f7-dfe8e764ae28","Type":"ContainerStarted","Data":"f9624d6743adc1ef73ad34df862cd2f26c8a8f00ab08fcf7f05f6ee2030f9be3"}
Jul 09 01:39:06.588729 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:06.588697    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-c2sl5"]
Jul 09 01:39:06.677108 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:06.677078    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-c2sl5"]
Jul 09 01:39:06.677276 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:06.677183    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c2sl5"
Jul 09 01:39:06.680694 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:06.680665    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 09 01:39:06.681847 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:06.681819    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 01:39:06.681847 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:06.681844    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 01:39:06.682002 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:06.681913    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6cdrb\""
Jul 09 01:39:06.682002 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:06.681930    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 01:39:06.682002 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:06.681844    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 09 01:39:06.789297 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:06.789264    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2326dd0b-fb56-4cbf-a644-7e051314d1a2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-c2sl5\" (UID: \"2326dd0b-fb56-4cbf-a644-7e051314d1a2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c2sl5"
Jul 09 01:39:06.789297 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:06.789299    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ds7f\" (UniqueName: \"kubernetes.io/projected/2326dd0b-fb56-4cbf-a644-7e051314d1a2-kube-api-access-2ds7f\") pod \"prometheus-operator-567f7b8b7c-c2sl5\" (UID: \"2326dd0b-fb56-4cbf-a644-7e051314d1a2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c2sl5"
Jul 09 01:39:06.789474 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:06.789377    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2326dd0b-fb56-4cbf-a644-7e051314d1a2-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-c2sl5\" (UID: \"2326dd0b-fb56-4cbf-a644-7e051314d1a2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c2sl5"
Jul 09 01:39:06.789474 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:06.789398    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2326dd0b-fb56-4cbf-a644-7e051314d1a2-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-c2sl5\" (UID: \"2326dd0b-fb56-4cbf-a644-7e051314d1a2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c2sl5"
Jul 09 01:39:06.890223 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:06.890148    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2326dd0b-fb56-4cbf-a644-7e051314d1a2-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-c2sl5\" (UID: \"2326dd0b-fb56-4cbf-a644-7e051314d1a2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c2sl5"
Jul 09 01:39:06.890223 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:06.890189    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2326dd0b-fb56-4cbf-a644-7e051314d1a2-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-c2sl5\" (UID: \"2326dd0b-fb56-4cbf-a644-7e051314d1a2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c2sl5"
Jul 09 01:39:06.890420 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:06.890275    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2326dd0b-fb56-4cbf-a644-7e051314d1a2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-c2sl5\" (UID: \"2326dd0b-fb56-4cbf-a644-7e051314d1a2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c2sl5"
Jul 09 01:39:06.890420 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:39:06.890357    2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 09 01:39:06.890511 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:06.890418    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ds7f\" (UniqueName: \"kubernetes.io/projected/2326dd0b-fb56-4cbf-a644-7e051314d1a2-kube-api-access-2ds7f\") pod \"prometheus-operator-567f7b8b7c-c2sl5\" (UID: \"2326dd0b-fb56-4cbf-a644-7e051314d1a2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c2sl5"
Jul 09 01:39:06.890511 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:39:06.890434    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2326dd0b-fb56-4cbf-a644-7e051314d1a2-prometheus-operator-tls podName:2326dd0b-fb56-4cbf-a644-7e051314d1a2 nodeName:}" failed. No retries permitted until 2026-07-09 01:39:07.390412277 +0000 UTC m=+45.602064606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/2326dd0b-fb56-4cbf-a644-7e051314d1a2-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-c2sl5" (UID: "2326dd0b-fb56-4cbf-a644-7e051314d1a2") : secret "prometheus-operator-tls" not found
Jul 09 01:39:06.890993 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:06.890969    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2326dd0b-fb56-4cbf-a644-7e051314d1a2-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-c2sl5\" (UID: \"2326dd0b-fb56-4cbf-a644-7e051314d1a2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c2sl5"
Jul 09 01:39:06.894580 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:06.894548    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2326dd0b-fb56-4cbf-a644-7e051314d1a2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-c2sl5\" (UID: \"2326dd0b-fb56-4cbf-a644-7e051314d1a2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c2sl5"
Jul 09 01:39:06.899065 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:06.899043    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ds7f\" (UniqueName: \"kubernetes.io/projected/2326dd0b-fb56-4cbf-a644-7e051314d1a2-kube-api-access-2ds7f\") pod \"prometheus-operator-567f7b8b7c-c2sl5\" (UID: \"2326dd0b-fb56-4cbf-a644-7e051314d1a2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c2sl5"
Jul 09 01:39:07.393387 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:07.393357    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2326dd0b-fb56-4cbf-a644-7e051314d1a2-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-c2sl5\" (UID: \"2326dd0b-fb56-4cbf-a644-7e051314d1a2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c2sl5"
Jul 09 01:39:07.395825 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:07.395800    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2326dd0b-fb56-4cbf-a644-7e051314d1a2-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-c2sl5\" (UID: \"2326dd0b-fb56-4cbf-a644-7e051314d1a2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c2sl5"
Jul 09 01:39:07.588317 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:07.588279    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c2sl5"
Jul 09 01:39:09.335611 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:09.335461    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-c2sl5"]
Jul 09 01:39:09.336164 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:09.335653    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-24ln9" event={"ID":"57eec479-7796-4606-b98b-0cf65bd96d8f","Type":"ContainerStarted","Data":"bbab299fe1169db22381907c7e077b57c08ade4a66351fa4951bd6ee8e303663"}
Jul 09 01:39:09.337397 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:09.337374    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-chv7g" event={"ID":"1c9d9da1-bf01-4198-b1f7-dfe8e764ae28","Type":"ContainerStarted","Data":"cc0ef2da506ef152dda9978483c34b1f2952e9e661f584b36a657ffdd40be3ef"}
Jul 09 01:39:10.341975 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:10.341727    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-695mk" event={"ID":"ebc6286a-5d2f-4e0e-b90f-950fd091c42f","Type":"ContainerStarted","Data":"fefded642499dab40ab45daeed05d9bd3a52a308ed4da37a3981359420aa0b76"}
Jul 09 01:39:10.343605 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:10.343582    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-24ln9" event={"ID":"57eec479-7796-4606-b98b-0cf65bd96d8f","Type":"ContainerStarted","Data":"6cbdf05c285a5867d4ebbbcf5940aa94e3eb22c0e3a73cf40d2ecc51aa3b5abb"}
Jul 09 01:39:10.343729 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:10.343700    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-24ln9"
Jul 09 01:39:10.344778 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:10.344759    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c2sl5" event={"ID":"2326dd0b-fb56-4cbf-a644-7e051314d1a2","Type":"ContainerStarted","Data":"00ed163e46f1153ff9cfdcfc756789554583212df4bdce05d8cb964877847e71"}
Jul 09 01:39:10.363188 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:10.363137    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-24ln9" podStartSLOduration=2.284892771 podStartE2EDuration="8.363119269s" totalImagesPullingTime="6.078226498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:39:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:10.362382329 +0000 UTC m=+48.574034666" watchObservedRunningTime="2026-07-09 01:39:10.363119269 +0000 UTC m=+48.574771608"
Jul 09 01:39:10.384499 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:10.384458    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-chv7g" podStartSLOduration=2.367586811 podStartE2EDuration="8.384445653s" totalImagesPullingTime="6.016858842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:39:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:10.383561629 +0000 UTC m=+48.595213969" watchObservedRunningTime="2026-07-09 01:39:10.384445653 +0000 UTC m=+48.596097988"
Jul 09 01:39:11.348417 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:11.348390    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-695mk" event={"ID":"ebc6286a-5d2f-4e0e-b90f-950fd091c42f","Type":"ContainerStarted","Data":"7a51a41fcd3f1136a8bfb0fb6803741a69fb17605bb3c9dab490ca446b229c0d"}
Jul 09 01:39:12.353860 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:12.353822    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c2sl5" event={"ID":"2326dd0b-fb56-4cbf-a644-7e051314d1a2","Type":"ContainerStarted","Data":"09970483507fdf43b5e4494e272f97d1012db52d967028955eee4d71a0ccb6af"}
Jul 09 01:39:12.354297 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:12.353887    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c2sl5" event={"ID":"2326dd0b-fb56-4cbf-a644-7e051314d1a2","Type":"ContainerStarted","Data":"bfdfeceb011041feeecc9f5d22fe9deed9f071412b550c98240a7c0b64b85ea9"}
Jul 09 01:39:12.370549 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:12.370487    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c2sl5" podStartSLOduration=4.492781336 podStartE2EDuration="6.370469613s" totalImagesPullingTime="1.877688277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:12.369908178 +0000 UTC m=+50.581560513" watchObservedRunningTime="2026-07-09 01:39:12.370469613 +0000 UTC m=+50.582121962"
Jul 09 01:39:13.469705 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.469672    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-599658689f-nrqf2"]
Jul 09 01:39:13.541754 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.541721    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-599658689f-nrqf2"]
Jul 09 01:39:13.541934 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.541835    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:39:13.544977 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.544937    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 01:39:13.544977 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.544954    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9x9t2\""
Jul 09 01:39:13.545180 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.544955    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 01:39:13.546616 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.546191    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 01:39:13.546616 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.546201    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 01:39:13.546616 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.546337    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 01:39:13.546616 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.546461    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 01:39:13.546616 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.546569    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 01:39:13.642401 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.642368    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aae0f151-38a0-4091-87a4-8825d5968cb7-service-ca\") pod \"console-599658689f-nrqf2\" (UID: \"aae0f151-38a0-4091-87a4-8825d5968cb7\") " pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:39:13.642509 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.642402    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aae0f151-38a0-4091-87a4-8825d5968cb7-console-config\") pod \"console-599658689f-nrqf2\" (UID: \"aae0f151-38a0-4091-87a4-8825d5968cb7\") " pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:39:13.642509 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.642448    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aae0f151-38a0-4091-87a4-8825d5968cb7-console-serving-cert\") pod \"console-599658689f-nrqf2\" (UID: \"aae0f151-38a0-4091-87a4-8825d5968cb7\") " pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:39:13.642509 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.642487    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrd2f\" (UniqueName: \"kubernetes.io/projected/aae0f151-38a0-4091-87a4-8825d5968cb7-kube-api-access-rrd2f\") pod \"console-599658689f-nrqf2\" (UID: \"aae0f151-38a0-4091-87a4-8825d5968cb7\") " pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:39:13.642612 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.642532    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aae0f151-38a0-4091-87a4-8825d5968cb7-console-oauth-config\") pod \"console-599658689f-nrqf2\" (UID: \"aae0f151-38a0-4091-87a4-8825d5968cb7\") " pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:39:13.642612 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.642554    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aae0f151-38a0-4091-87a4-8825d5968cb7-oauth-serving-cert\") pod \"console-599658689f-nrqf2\" (UID: \"aae0f151-38a0-4091-87a4-8825d5968cb7\") " pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:39:13.743476 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.743422    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aae0f151-38a0-4091-87a4-8825d5968cb7-console-config\") pod \"console-599658689f-nrqf2\" (UID: \"aae0f151-38a0-4091-87a4-8825d5968cb7\") " pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:39:13.743476 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.743461    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aae0f151-38a0-4091-87a4-8825d5968cb7-console-serving-cert\") pod \"console-599658689f-nrqf2\" (UID: \"aae0f151-38a0-4091-87a4-8825d5968cb7\") " pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:39:13.743630 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.743481    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrd2f\" (UniqueName: \"kubernetes.io/projected/aae0f151-38a0-4091-87a4-8825d5968cb7-kube-api-access-rrd2f\") pod \"console-599658689f-nrqf2\" (UID: \"aae0f151-38a0-4091-87a4-8825d5968cb7\") " pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:39:13.743630 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.743514    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aae0f151-38a0-4091-87a4-8825d5968cb7-console-oauth-config\") pod \"console-599658689f-nrqf2\" (UID: \"aae0f151-38a0-4091-87a4-8825d5968cb7\") " pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:39:13.743734 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.743701    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aae0f151-38a0-4091-87a4-8825d5968cb7-oauth-serving-cert\") pod \"console-599658689f-nrqf2\" (UID: \"aae0f151-38a0-4091-87a4-8825d5968cb7\") " pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:39:13.743805 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.743788    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aae0f151-38a0-4091-87a4-8825d5968cb7-service-ca\") pod \"console-599658689f-nrqf2\" (UID: \"aae0f151-38a0-4091-87a4-8825d5968cb7\") " pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:39:13.744186 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.744158    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aae0f151-38a0-4091-87a4-8825d5968cb7-console-config\") pod \"console-599658689f-nrqf2\" (UID: \"aae0f151-38a0-4091-87a4-8825d5968cb7\") " pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:39:13.744326 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.744309    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aae0f151-38a0-4091-87a4-8825d5968cb7-oauth-serving-cert\") pod \"console-599658689f-nrqf2\" (UID: \"aae0f151-38a0-4091-87a4-8825d5968cb7\") " pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:39:13.744463 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.744443    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aae0f151-38a0-4091-87a4-8825d5968cb7-service-ca\") pod \"console-599658689f-nrqf2\" (UID: \"aae0f151-38a0-4091-87a4-8825d5968cb7\") " pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:39:13.747146 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.747128    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aae0f151-38a0-4091-87a4-8825d5968cb7-console-serving-cert\") pod \"console-599658689f-nrqf2\" (UID: \"aae0f151-38a0-4091-87a4-8825d5968cb7\") " pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:39:13.747227 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.747144    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aae0f151-38a0-4091-87a4-8825d5968cb7-console-oauth-config\") pod \"console-599658689f-nrqf2\" (UID: \"aae0f151-38a0-4091-87a4-8825d5968cb7\") " pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:39:13.751408 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.751385    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrd2f\" (UniqueName: \"kubernetes.io/projected/aae0f151-38a0-4091-87a4-8825d5968cb7-kube-api-access-rrd2f\") pod \"console-599658689f-nrqf2\" (UID: \"aae0f151-38a0-4091-87a4-8825d5968cb7\") " pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:39:13.852275 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.852253    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:39:13.938649 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.938623    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-cnbl2"]
Jul 09 01:39:13.960934 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.960910    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-cnbl2"]
Jul 09 01:39:13.961102 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.961087    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cnbl2"
Jul 09 01:39:13.965145 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.964554    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 09 01:39:13.965145 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.964715    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 09 01:39:13.965145 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.964851    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4c2bl\""
Jul 09 01:39:13.967331 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.967291    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v"]
Jul 09 01:39:13.997037 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.996974    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fdjbs"]
Jul 09 01:39:13.997140 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.997107    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v"
Jul 09 01:39:13.999577 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.999550    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 09 01:39:13.999577 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.999562    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ktwhh\""
Jul 09 01:39:13.999746 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.999578    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 09 01:39:13.999746 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:13.999608    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 09 01:39:14.016440 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:39:14.016415    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaae0f151_38a0_4091_87a4_8825d5968cb7.slice/crio-afe1acbb3914684b7cf17f40352c7563beaa3d8fb9df236fc0e01444694da583 WatchSource:0}: Error finding container afe1acbb3914684b7cf17f40352c7563beaa3d8fb9df236fc0e01444694da583: Status 404 returned error can't find the container with id afe1acbb3914684b7cf17f40352c7563beaa3d8fb9df236fc0e01444694da583
Jul 09 01:39:14.017397 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.017383    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v"]
Jul 09 01:39:14.017454 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.017423    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-599658689f-nrqf2"]
Jul 09 01:39:14.017525 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.017503    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.019882 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.019865    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 01:39:14.020124 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.020106    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mb84g\""
Jul 09 01:39:14.020270 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.020251    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 01:39:14.020342 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.020295    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 01:39:14.045457 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.045437    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-rhc8v\" (UID: \"0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v"
Jul 09 01:39:14.045548 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.045465    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-cnbl2\" (UID: \"dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cnbl2"
Jul 09 01:39:14.045548 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.045495    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-cnbl2\" (UID: \"dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cnbl2"
Jul 09 01:39:14.045548 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.045510    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/43947d65-f367-4cf4-8c37-2fb07939ef30-node-exporter-tls\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.045548 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.045526    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-rhc8v\" (UID: \"0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v"
Jul 09 01:39:14.045548 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.045544    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-rhc8v\" (UID: \"0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v"
Jul 09 01:39:14.045779 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.045561    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/43947d65-f367-4cf4-8c37-2fb07939ef30-node-exporter-textfile\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.045779 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.045660    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z54fl\" (UniqueName: \"kubernetes.io/projected/43947d65-f367-4cf4-8c37-2fb07939ef30-kube-api-access-z54fl\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.045779 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.045692    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-cnbl2\" (UID: \"dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cnbl2"
Jul 09 01:39:14.045779 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.045718    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-rhc8v\" (UID: \"0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v"
Jul 09 01:39:14.045779 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.045772    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g852h\" (UniqueName: \"kubernetes.io/projected/dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7-kube-api-access-g852h\") pod \"openshift-state-metrics-54cf96dfcf-cnbl2\" (UID: \"dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cnbl2"
Jul 09 01:39:14.045999 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.045806    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43947d65-f367-4cf4-8c37-2fb07939ef30-metrics-client-ca\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.045999 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.045835    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43947d65-f367-4cf4-8c37-2fb07939ef30-sys\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.045999 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.045873    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/43947d65-f367-4cf4-8c37-2fb07939ef30-node-exporter-wtmp\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.045999 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.045899    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4c7s\" (UniqueName: \"kubernetes.io/projected/0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6-kube-api-access-h4c7s\") pod \"kube-state-metrics-7c9dbb8b7d-rhc8v\" (UID: \"0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v"
Jul 09 01:39:14.045999 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.045927    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/43947d65-f367-4cf4-8c37-2fb07939ef30-node-exporter-accelerators-collector-config\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.045999 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.045955    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/43947d65-f367-4cf4-8c37-2fb07939ef30-root\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.045999 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.045979    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43947d65-f367-4cf4-8c37-2fb07939ef30-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.046251 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.046010    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-rhc8v\" (UID: \"0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v"
Jul 09 01:39:14.146527 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.146502    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z54fl\" (UniqueName: \"kubernetes.io/projected/43947d65-f367-4cf4-8c37-2fb07939ef30-kube-api-access-z54fl\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.146527 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.146528    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-cnbl2\" (UID: \"dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cnbl2"
Jul 09 01:39:14.146658 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.146544    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-rhc8v\" (UID: \"0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v"
Jul 09 01:39:14.146658 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.146573    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g852h\" (UniqueName: \"kubernetes.io/projected/dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7-kube-api-access-g852h\") pod \"openshift-state-metrics-54cf96dfcf-cnbl2\" (UID: \"dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cnbl2"
Jul 09 01:39:14.146658 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.146604    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43947d65-f367-4cf4-8c37-2fb07939ef30-metrics-client-ca\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.146658 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.146628    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43947d65-f367-4cf4-8c37-2fb07939ef30-sys\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.146842 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.146661    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/43947d65-f367-4cf4-8c37-2fb07939ef30-node-exporter-wtmp\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.146842 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.146685    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4c7s\" (UniqueName: \"kubernetes.io/projected/0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6-kube-api-access-h4c7s\") pod \"kube-state-metrics-7c9dbb8b7d-rhc8v\" (UID: \"0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v"
Jul 09 01:39:14.146842 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.146740    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43947d65-f367-4cf4-8c37-2fb07939ef30-sys\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.146842 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.146791    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/43947d65-f367-4cf4-8c37-2fb07939ef30-node-exporter-accelerators-collector-config\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.146842 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.146814    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/43947d65-f367-4cf4-8c37-2fb07939ef30-node-exporter-wtmp\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.146842 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.146827    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/43947d65-f367-4cf4-8c37-2fb07939ef30-root\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.147302 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.146861    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43947d65-f367-4cf4-8c37-2fb07939ef30-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.147302 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.146871    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/43947d65-f367-4cf4-8c37-2fb07939ef30-root\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.147302 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.146897    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-rhc8v\" (UID: \"0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v"
Jul 09 01:39:14.147302 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.146917    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-rhc8v\" (UID: \"0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v"
Jul 09 01:39:14.147302 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.146963    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-rhc8v\" (UID: \"0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v"
Jul 09 01:39:14.147302 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.146991    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-cnbl2\" (UID: \"dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cnbl2"
Jul 09 01:39:14.147302 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.147055    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-cnbl2\" (UID: \"dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cnbl2"
Jul 09 01:39:14.147302 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.147081    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/43947d65-f367-4cf4-8c37-2fb07939ef30-node-exporter-tls\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.147302 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.147102    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-rhc8v\" (UID: \"0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v"
Jul 09 01:39:14.147302 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.147132    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-rhc8v\" (UID: \"0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v"
Jul 09 01:39:14.147302 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.147158    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/43947d65-f367-4cf4-8c37-2fb07939ef30-node-exporter-textfile\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.147822 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.147318    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-cnbl2\" (UID: \"dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cnbl2"
Jul 09 01:39:14.147822 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.147328    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/43947d65-f367-4cf4-8c37-2fb07939ef30-node-exporter-accelerators-collector-config\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.147822 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.147321    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43947d65-f367-4cf4-8c37-2fb07939ef30-metrics-client-ca\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.147822 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.147447    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/43947d65-f367-4cf4-8c37-2fb07939ef30-node-exporter-textfile\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.147822 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:39:14.147486    2562 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 09 01:39:14.147822 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:39:14.147629    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7-openshift-state-metrics-tls podName:dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7 nodeName:}" failed. No retries permitted until 2026-07-09 01:39:14.647606827 +0000 UTC m=+52.859259144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-cnbl2" (UID: "dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7") : secret "openshift-state-metrics-tls" not found
Jul 09 01:39:14.148152 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.148128    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-rhc8v\" (UID: \"0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v"
Jul 09 01:39:14.148426 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.148401    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-rhc8v\" (UID: \"0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v"
Jul 09 01:39:14.149384 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.149364    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43947d65-f367-4cf4-8c37-2fb07939ef30-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.149502 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.149485    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-rhc8v\" (UID: \"0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v"
Jul 09 01:39:14.149644 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.149625    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-cnbl2\" (UID: \"dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cnbl2"
Jul 09 01:39:14.149769 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.149755    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/43947d65-f367-4cf4-8c37-2fb07939ef30-node-exporter-tls\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.149858 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.149843    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-rhc8v\" (UID: \"0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v"
Jul 09 01:39:14.154528 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.154509    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z54fl\" (UniqueName: \"kubernetes.io/projected/43947d65-f367-4cf4-8c37-2fb07939ef30-kube-api-access-z54fl\") pod \"node-exporter-fdjbs\" (UID: \"43947d65-f367-4cf4-8c37-2fb07939ef30\") " pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.154899 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.154880    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g852h\" (UniqueName: \"kubernetes.io/projected/dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7-kube-api-access-g852h\") pod \"openshift-state-metrics-54cf96dfcf-cnbl2\" (UID: \"dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cnbl2"
Jul 09 01:39:14.155292 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.155275    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4c7s\" (UniqueName: \"kubernetes.io/projected/0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6-kube-api-access-h4c7s\") pod \"kube-state-metrics-7c9dbb8b7d-rhc8v\" (UID: \"0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v"
Jul 09 01:39:14.306007 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.305985    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v"
Jul 09 01:39:14.326452 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.326436    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fdjbs"
Jul 09 01:39:14.354511 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:39:14.354483    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43947d65_f367_4cf4_8c37_2fb07939ef30.slice/crio-e040b9090e5fa46777f48668a014125df721711fe9e6f459a34b6b0fe23d4b2d WatchSource:0}: Error finding container e040b9090e5fa46777f48668a014125df721711fe9e6f459a34b6b0fe23d4b2d: Status 404 returned error can't find the container with id e040b9090e5fa46777f48668a014125df721711fe9e6f459a34b6b0fe23d4b2d
Jul 09 01:39:14.362632 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.362609    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-695mk" event={"ID":"ebc6286a-5d2f-4e0e-b90f-950fd091c42f","Type":"ContainerStarted","Data":"1a5a8789e6af91f1bcf525262c13363788cde3bbd2d807c446a4e09acf93b2dd"}
Jul 09 01:39:14.363857 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.363829    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fdjbs" event={"ID":"43947d65-f367-4cf4-8c37-2fb07939ef30","Type":"ContainerStarted","Data":"e040b9090e5fa46777f48668a014125df721711fe9e6f459a34b6b0fe23d4b2d"}
Jul 09 01:39:14.364877 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.364851    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-599658689f-nrqf2" event={"ID":"aae0f151-38a0-4091-87a4-8825d5968cb7","Type":"ContainerStarted","Data":"afe1acbb3914684b7cf17f40352c7563beaa3d8fb9df236fc0e01444694da583"}
Jul 09 01:39:14.381407 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.381360    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-695mk" podStartSLOduration=2.15851075 podStartE2EDuration="12.381341554s" totalImagesPullingTime="10.222830804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:39:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:14.380495553 +0000 UTC m=+52.592147908" watchObservedRunningTime="2026-07-09 01:39:14.381341554 +0000 UTC m=+52.592993890"
Jul 09 01:39:14.443495 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.443472    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v"]
Jul 09 01:39:14.446060 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:39:14.446036    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cf73d3b_8a56_49ad_8fe6_6aa05b9bb4a6.slice/crio-88c1e671da50c19e053ec59375cd620d088147c29ac26efeae48e2c995fd95e3 WatchSource:0}: Error finding container 88c1e671da50c19e053ec59375cd620d088147c29ac26efeae48e2c995fd95e3: Status 404 returned error can't find the container with id 88c1e671da50c19e053ec59375cd620d088147c29ac26efeae48e2c995fd95e3
Jul 09 01:39:14.650801 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.650736    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-cnbl2\" (UID: \"dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cnbl2"
Jul 09 01:39:14.652958 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.652940    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-cnbl2\" (UID: \"dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cnbl2"
Jul 09 01:39:14.875558 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:14.875527    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cnbl2"
Jul 09 01:39:15.013893 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.013865    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 01:39:15.038197 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.038123    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 01:39:15.038197 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.038167    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-cnbl2"]
Jul 09 01:39:15.038320 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.038267    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.039624 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:39:15.039572    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc7fdf5a_0044_4dc2_bfe8_a8872c9fbdc7.slice/crio-4504dc81169d475f64b418c36383b445458a3039a454c34b64a05d55a8d7ae19 WatchSource:0}: Error finding container 4504dc81169d475f64b418c36383b445458a3039a454c34b64a05d55a8d7ae19: Status 404 returned error can't find the container with id 4504dc81169d475f64b418c36383b445458a3039a454c34b64a05d55a8d7ae19
Jul 09 01:39:15.041230 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.041204    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 09 01:39:15.043621 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.041429    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 09 01:39:15.043621 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.041651    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 09 01:39:15.043621 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.042213    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 09 01:39:15.043621 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.042451    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 09 01:39:15.043621 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.042656    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 09 01:39:15.043621 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.042849    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 09 01:39:15.043621 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.043054    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 09 01:39:15.043621 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.043257    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nh6bw\""
Jul 09 01:39:15.043621 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.043452    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 09 01:39:15.053598 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.053293    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-config-volume\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.053598 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.053348    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0657f127-9741-4fc2-bf9c-cc319c05017c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.053598 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.053379    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.053598 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.053412    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.053598 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.053444    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw927\" (UniqueName: \"kubernetes.io/projected/0657f127-9741-4fc2-bf9c-cc319c05017c-kube-api-access-lw927\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.053598 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.053484    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.053598 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.053503    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0657f127-9741-4fc2-bf9c-cc319c05017c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.053598 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.053527    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0657f127-9741-4fc2-bf9c-cc319c05017c-config-out\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.053598 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.053560    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0657f127-9741-4fc2-bf9c-cc319c05017c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.054069 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.053609    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.054069 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.053646    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0657f127-9741-4fc2-bf9c-cc319c05017c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.054069 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.053674    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-web-config\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.054069 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.053697    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.154392 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.154335    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0657f127-9741-4fc2-bf9c-cc319c05017c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.154392 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.154365    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.154392 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.154393    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.154610 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.154415    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw927\" (UniqueName: \"kubernetes.io/projected/0657f127-9741-4fc2-bf9c-cc319c05017c-kube-api-access-lw927\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.154610 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.154434    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.154610 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.154449    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0657f127-9741-4fc2-bf9c-cc319c05017c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.154610 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.154466    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0657f127-9741-4fc2-bf9c-cc319c05017c-config-out\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.154610 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.154494    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0657f127-9741-4fc2-bf9c-cc319c05017c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.154610 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.154509    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.154610 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.154530    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0657f127-9741-4fc2-bf9c-cc319c05017c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.154610 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.154554    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-web-config\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.154610 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.154570    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.154610 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.154585    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-config-volume\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.155825 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.155228    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0657f127-9741-4fc2-bf9c-cc319c05017c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.156416 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:39:15.155922    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0657f127-9741-4fc2-bf9c-cc319c05017c-alertmanager-trusted-ca-bundle podName:0657f127-9741-4fc2-bf9c-cc319c05017c nodeName:}" failed. No retries permitted until 2026-07-09 01:39:15.65589929 +0000 UTC m=+53.867551620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/0657f127-9741-4fc2-bf9c-cc319c05017c-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "0657f127-9741-4fc2-bf9c-cc319c05017c") : configmap references non-existent config key: ca-bundle.crt
Jul 09 01:39:15.157883 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.156970    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0657f127-9741-4fc2-bf9c-cc319c05017c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.159266 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.159245    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.164044 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.163886    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.164668 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.164309    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0657f127-9741-4fc2-bf9c-cc319c05017c-config-out\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.164668 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.164623    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.165245 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.165199    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.165742 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.165637    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-web-config\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.165742 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.165686    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.165877 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.165765    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-config-volume\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.166423 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.166379    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw927\" (UniqueName: \"kubernetes.io/projected/0657f127-9741-4fc2-bf9c-cc319c05017c-kube-api-access-lw927\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.166963 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.166941    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0657f127-9741-4fc2-bf9c-cc319c05017c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.369610 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.369578    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v" event={"ID":"0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6","Type":"ContainerStarted","Data":"88c1e671da50c19e053ec59375cd620d088147c29ac26efeae48e2c995fd95e3"}
Jul 09 01:39:15.372448 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.372423    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cnbl2" event={"ID":"dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7","Type":"ContainerStarted","Data":"c2d29a441bef20d786faf6fac890add0207a7c4c3642f9efbed868cfdd599e6e"}
Jul 09 01:39:15.372575 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.372492    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cnbl2" event={"ID":"dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7","Type":"ContainerStarted","Data":"8307774c676fd43ccb13675d3570bae32659dd387102e797332ae19a22a1ed9e"}
Jul 09 01:39:15.372575 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.372525    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cnbl2" event={"ID":"dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7","Type":"ContainerStarted","Data":"4504dc81169d475f64b418c36383b445458a3039a454c34b64a05d55a8d7ae19"}
Jul 09 01:39:15.659750 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.659723    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0657f127-9741-4fc2-bf9c-cc319c05017c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.660683 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.660662    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0657f127-9741-4fc2-bf9c-cc319c05017c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:15.958337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:15.958253    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:39:16.178824 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.178700    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 01:39:16.182158 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:39:16.182135    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0657f127_9741_4fc2_bf9c_cc319c05017c.slice/crio-f60c54cda799d1ffee66f302f35294cda348665a9efe69b17b1c9f19a62bf579 WatchSource:0}: Error finding container f60c54cda799d1ffee66f302f35294cda348665a9efe69b17b1c9f19a62bf579: Status 404 returned error can't find the container with id f60c54cda799d1ffee66f302f35294cda348665a9efe69b17b1c9f19a62bf579
Jul 09 01:39:16.377784 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.377755    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0657f127-9741-4fc2-bf9c-cc319c05017c","Type":"ContainerStarted","Data":"f60c54cda799d1ffee66f302f35294cda348665a9efe69b17b1c9f19a62bf579"}
Jul 09 01:39:16.380525 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.379571    2562 generic.go:356] "Generic (PLEG): container finished" podID="43947d65-f367-4cf4-8c37-2fb07939ef30" containerID="e0ba7c635dc3bb66f262a091d0bb403d586e966eed9bd7fbb091d6d2a00aace8" exitCode=0
Jul 09 01:39:16.380525 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.379645    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fdjbs" event={"ID":"43947d65-f367-4cf4-8c37-2fb07939ef30","Type":"ContainerDied","Data":"e0ba7c635dc3bb66f262a091d0bb403d586e966eed9bd7fbb091d6d2a00aace8"}
Jul 09 01:39:16.384434 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.383769    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v" event={"ID":"0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6","Type":"ContainerStarted","Data":"c881c7cde9151ab36bee7e5c9f6f28df3a09330077955e4edf18fd9083d543b9"}
Jul 09 01:39:16.384434 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.383817    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v" event={"ID":"0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6","Type":"ContainerStarted","Data":"d53afdd279cc689f5d7b8cdd4bd0574daec7f36b1d3d75bfe8e3ab6455c0ad00"}
Jul 09 01:39:16.384434 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.383844    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v" event={"ID":"0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6","Type":"ContainerStarted","Data":"f2f643b39df8e74dd17ba61127b21682058aaa2a30b6efd3d4d811aac068e510"}
Jul 09 01:39:16.419918 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.419756    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rhc8v" podStartSLOduration=1.80846026 podStartE2EDuration="3.419735947s" totalImagesPullingTime="1.611275687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:39:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:16.418718163 +0000 UTC m=+54.630370525" watchObservedRunningTime="2026-07-09 01:39:16.419735947 +0000 UTC m=+54.631388283"
Jul 09 01:39:16.931172 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.931141    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"]
Jul 09 01:39:16.934434 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.934415    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:16.938090 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.938070    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 09 01:39:16.938204 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.938152    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 09 01:39:16.938262 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.938211    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 09 01:39:16.938316 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.938290    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6f52d\""
Jul 09 01:39:16.938316 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.938300    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 09 01:39:16.938770 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.938751    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 09 01:39:16.938871 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.938814    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1i9nfgfni4ur2\""
Jul 09 01:39:16.947978 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.947959    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"]
Jul 09 01:39:16.971292 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.971273    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c-secret-grpc-tls\") pod \"thanos-querier-79cb9dd7b7-thkn2\" (UID: \"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c\") " pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:16.971411 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.971302    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79cb9dd7b7-thkn2\" (UID: \"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c\") " pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:16.971411 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.971324    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79cb9dd7b7-thkn2\" (UID: \"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c\") " pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:16.971522 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.971411    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c-secret-thanos-querier-tls\") pod \"thanos-querier-79cb9dd7b7-thkn2\" (UID: \"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c\") " pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:16.971522 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.971450    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79cb9dd7b7-thkn2\" (UID: \"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c\") " pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:16.971522 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.971468    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp4tw\" (UniqueName: \"kubernetes.io/projected/a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c-kube-api-access-fp4tw\") pod \"thanos-querier-79cb9dd7b7-thkn2\" (UID: \"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c\") " pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:16.971522 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.971491    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79cb9dd7b7-thkn2\" (UID: \"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c\") " pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:16.971722 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:16.971545    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c-metrics-client-ca\") pod \"thanos-querier-79cb9dd7b7-thkn2\" (UID: \"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c\") " pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:17.072454 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:17.072427    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c-metrics-client-ca\") pod \"thanos-querier-79cb9dd7b7-thkn2\" (UID: \"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c\") " pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:17.072613 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:17.072481    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c-secret-grpc-tls\") pod \"thanos-querier-79cb9dd7b7-thkn2\" (UID: \"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c\") " pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:17.072613 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:17.072507    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79cb9dd7b7-thkn2\" (UID: \"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c\") " pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:17.072613 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:17.072541    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79cb9dd7b7-thkn2\" (UID: \"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c\") " pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:17.072809 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:17.072678    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c-secret-thanos-querier-tls\") pod \"thanos-querier-79cb9dd7b7-thkn2\" (UID: \"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c\") " pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:17.072809 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:17.072737    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79cb9dd7b7-thkn2\" (UID: \"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c\") " pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:17.072809 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:17.072768    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp4tw\" (UniqueName: \"kubernetes.io/projected/a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c-kube-api-access-fp4tw\") pod \"thanos-querier-79cb9dd7b7-thkn2\" (UID: \"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c\") " pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:17.072809 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:17.072798    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79cb9dd7b7-thkn2\" (UID: \"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c\") " pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:17.073429 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:17.073405    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c-metrics-client-ca\") pod \"thanos-querier-79cb9dd7b7-thkn2\" (UID: \"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c\") " pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:17.075660 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:17.075556    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79cb9dd7b7-thkn2\" (UID: \"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c\") " pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:17.075660 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:17.075650    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79cb9dd7b7-thkn2\" (UID: \"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c\") " pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:17.075921 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:17.075880    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c-secret-grpc-tls\") pod \"thanos-querier-79cb9dd7b7-thkn2\" (UID: \"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c\") " pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:17.076445 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:17.076425    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c-secret-thanos-querier-tls\") pod \"thanos-querier-79cb9dd7b7-thkn2\" (UID: \"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c\") " pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:17.076513 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:17.076431    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79cb9dd7b7-thkn2\" (UID: \"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c\") " pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:17.076513 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:17.076431    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79cb9dd7b7-thkn2\" (UID: \"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c\") " pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:17.085442 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:17.085421    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp4tw\" (UniqueName: \"kubernetes.io/projected/a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c-kube-api-access-fp4tw\") pod \"thanos-querier-79cb9dd7b7-thkn2\" (UID: \"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c\") " pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:17.245424 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:17.245171    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:17.390391 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:17.390299    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cnbl2" event={"ID":"dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7","Type":"ContainerStarted","Data":"95e30fa676052c0eb2b550651a06bcd7832ae8a5dcf928d2738fa3202c12c6e4"}
Jul 09 01:39:17.392799 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:17.392773    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fdjbs" event={"ID":"43947d65-f367-4cf4-8c37-2fb07939ef30","Type":"ContainerStarted","Data":"d31c2210bce6f549d0766b6dedc06041ee04ac891f6c796f3d17dd1327e492be"}
Jul 09 01:39:17.393233 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:17.393193    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fdjbs" event={"ID":"43947d65-f367-4cf4-8c37-2fb07939ef30","Type":"ContainerStarted","Data":"2ddf63d0d761b7cf297f2f1e5d49488d67e27fb8fce83ee2b217131ee4dbdb49"}
Jul 09 01:39:17.410956 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:17.410905    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cnbl2" podStartSLOduration=2.930906495 podStartE2EDuration="4.410886427s" totalImagesPullingTime="1.479979932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:39:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:17.409495865 +0000 UTC m=+55.621148202" watchObservedRunningTime="2026-07-09 01:39:17.410886427 +0000 UTC m=+55.622538766"
Jul 09 01:39:17.428293 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:17.428247    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fdjbs" podStartSLOduration=3.10087928 podStartE2EDuration="4.428229542s" totalImagesPullingTime="1.250105405s" totalInitContainerRuntime="77.244857ms" isStatefulPod=true podCreationTimestamp="2026-07-09 01:39:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:17.42684128 +0000 UTC m=+55.638493617" watchObservedRunningTime="2026-07-09 01:39:17.428229542 +0000 UTC m=+55.639881883"
Jul 09 01:39:18.340708 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.340672    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-784d559c-28pzc"]
Jul 09 01:39:18.343029 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.342993    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:18.347176 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.346973    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 09 01:39:18.347176 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.347029    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5uvl7k1pruff5\""
Jul 09 01:39:18.347176 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.347047    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 09 01:39:18.347176 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.346973    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 09 01:39:18.347464 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.347369    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-sld6v\""
Jul 09 01:39:18.347641 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.347622    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 09 01:39:18.354627 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.354604    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-784d559c-28pzc"]
Jul 09 01:39:18.387137 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.387102    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e9e4b665-cc44-4db4-b0ad-5e833d08bec4-secret-metrics-server-tls\") pod \"metrics-server-784d559c-28pzc\" (UID: \"e9e4b665-cc44-4db4-b0ad-5e833d08bec4\") " pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:18.387256 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.387239    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e9e4b665-cc44-4db4-b0ad-5e833d08bec4-secret-metrics-server-client-certs\") pod \"metrics-server-784d559c-28pzc\" (UID: \"e9e4b665-cc44-4db4-b0ad-5e833d08bec4\") " pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:18.387304 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.387275    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9e4b665-cc44-4db4-b0ad-5e833d08bec4-client-ca-bundle\") pod \"metrics-server-784d559c-28pzc\" (UID: \"e9e4b665-cc44-4db4-b0ad-5e833d08bec4\") " pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:18.387348 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.387326    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9e4b665-cc44-4db4-b0ad-5e833d08bec4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-784d559c-28pzc\" (UID: \"e9e4b665-cc44-4db4-b0ad-5e833d08bec4\") " pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:18.387396 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.387353    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e9e4b665-cc44-4db4-b0ad-5e833d08bec4-audit-log\") pod \"metrics-server-784d559c-28pzc\" (UID: \"e9e4b665-cc44-4db4-b0ad-5e833d08bec4\") " pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:18.387451 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.387429    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e9e4b665-cc44-4db4-b0ad-5e833d08bec4-metrics-server-audit-profiles\") pod \"metrics-server-784d559c-28pzc\" (UID: \"e9e4b665-cc44-4db4-b0ad-5e833d08bec4\") " pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:18.387509 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.387491    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnp2b\" (UniqueName: \"kubernetes.io/projected/e9e4b665-cc44-4db4-b0ad-5e833d08bec4-kube-api-access-gnp2b\") pod \"metrics-server-784d559c-28pzc\" (UID: \"e9e4b665-cc44-4db4-b0ad-5e833d08bec4\") " pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:18.489644 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.488390    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e9e4b665-cc44-4db4-b0ad-5e833d08bec4-metrics-server-audit-profiles\") pod \"metrics-server-784d559c-28pzc\" (UID: \"e9e4b665-cc44-4db4-b0ad-5e833d08bec4\") " pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:18.489644 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.488437    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnp2b\" (UniqueName: \"kubernetes.io/projected/e9e4b665-cc44-4db4-b0ad-5e833d08bec4-kube-api-access-gnp2b\") pod \"metrics-server-784d559c-28pzc\" (UID: \"e9e4b665-cc44-4db4-b0ad-5e833d08bec4\") " pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:18.489644 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.488491    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e9e4b665-cc44-4db4-b0ad-5e833d08bec4-secret-metrics-server-tls\") pod \"metrics-server-784d559c-28pzc\" (UID: \"e9e4b665-cc44-4db4-b0ad-5e833d08bec4\") " pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:18.489644 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.488612    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e9e4b665-cc44-4db4-b0ad-5e833d08bec4-secret-metrics-server-client-certs\") pod \"metrics-server-784d559c-28pzc\" (UID: \"e9e4b665-cc44-4db4-b0ad-5e833d08bec4\") " pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:18.489644 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.488639    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9e4b665-cc44-4db4-b0ad-5e833d08bec4-client-ca-bundle\") pod \"metrics-server-784d559c-28pzc\" (UID: \"e9e4b665-cc44-4db4-b0ad-5e833d08bec4\") " pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:18.489644 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.488708    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9e4b665-cc44-4db4-b0ad-5e833d08bec4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-784d559c-28pzc\" (UID: \"e9e4b665-cc44-4db4-b0ad-5e833d08bec4\") " pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:18.489644 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.488733    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e9e4b665-cc44-4db4-b0ad-5e833d08bec4-audit-log\") pod \"metrics-server-784d559c-28pzc\" (UID: \"e9e4b665-cc44-4db4-b0ad-5e833d08bec4\") " pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:18.490726 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.490130    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e9e4b665-cc44-4db4-b0ad-5e833d08bec4-metrics-server-audit-profiles\") pod \"metrics-server-784d559c-28pzc\" (UID: \"e9e4b665-cc44-4db4-b0ad-5e833d08bec4\") " pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:18.490726 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.490678    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9e4b665-cc44-4db4-b0ad-5e833d08bec4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-784d559c-28pzc\" (UID: \"e9e4b665-cc44-4db4-b0ad-5e833d08bec4\") " pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:18.491211 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.491153    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e9e4b665-cc44-4db4-b0ad-5e833d08bec4-audit-log\") pod \"metrics-server-784d559c-28pzc\" (UID: \"e9e4b665-cc44-4db4-b0ad-5e833d08bec4\") " pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:18.493060 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.492951    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e9e4b665-cc44-4db4-b0ad-5e833d08bec4-secret-metrics-server-client-certs\") pod \"metrics-server-784d559c-28pzc\" (UID: \"e9e4b665-cc44-4db4-b0ad-5e833d08bec4\") " pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:18.493461 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.493434    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9e4b665-cc44-4db4-b0ad-5e833d08bec4-client-ca-bundle\") pod \"metrics-server-784d559c-28pzc\" (UID: \"e9e4b665-cc44-4db4-b0ad-5e833d08bec4\") " pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:18.494591 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.494550    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e9e4b665-cc44-4db4-b0ad-5e833d08bec4-secret-metrics-server-tls\") pod \"metrics-server-784d559c-28pzc\" (UID: \"e9e4b665-cc44-4db4-b0ad-5e833d08bec4\") " pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:18.498761 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.498737    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnp2b\" (UniqueName: \"kubernetes.io/projected/e9e4b665-cc44-4db4-b0ad-5e833d08bec4-kube-api-access-gnp2b\") pod \"metrics-server-784d559c-28pzc\" (UID: \"e9e4b665-cc44-4db4-b0ad-5e833d08bec4\") " pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:18.532426 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.532395    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"]
Jul 09 01:39:18.548885 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:39:18.548861    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda915bbd1_6534_4ffc_a0e8_75ee02ec6b8c.slice/crio-9fbca856494594368d0f3355eb1baeb397a4478049069324c7c50a5f1b06cb88 WatchSource:0}: Error finding container 9fbca856494594368d0f3355eb1baeb397a4478049069324c7c50a5f1b06cb88: Status 404 returned error can't find the container with id 9fbca856494594368d0f3355eb1baeb397a4478049069324c7c50a5f1b06cb88
Jul 09 01:39:18.654422 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.654360    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:18.730577 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.730540    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-7djfk"]
Jul 09 01:39:18.733476 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.733152    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7djfk"
Jul 09 01:39:18.736171 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.736103    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-926rn\""
Jul 09 01:39:18.736314 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.736272    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 09 01:39:18.742101 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.742046    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-7djfk"]
Jul 09 01:39:18.782924 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.782901    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-784d559c-28pzc"]
Jul 09 01:39:18.785647 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:39:18.785625    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9e4b665_cc44_4db4_b0ad_5e833d08bec4.slice/crio-e3f315830d1439cb0afd9d4f0a0f354bf8529ddc955dc9092976383098c82d0e WatchSource:0}: Error finding container e3f315830d1439cb0afd9d4f0a0f354bf8529ddc955dc9092976383098c82d0e: Status 404 returned error can't find the container with id e3f315830d1439cb0afd9d4f0a0f354bf8529ddc955dc9092976383098c82d0e
Jul 09 01:39:18.791422 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.791402    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d4e9ac0a-b2da-4b82-86c6-c69b57d0f6c0-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-7djfk\" (UID: \"d4e9ac0a-b2da-4b82-86c6-c69b57d0f6c0\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7djfk"
Jul 09 01:39:18.791500 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.791491    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkbhr\" (UniqueName: \"kubernetes.io/projected/d4e9ac0a-b2da-4b82-86c6-c69b57d0f6c0-kube-api-access-mkbhr\") pod \"monitoring-plugin-d5dcff7cf-7djfk\" (UID: \"d4e9ac0a-b2da-4b82-86c6-c69b57d0f6c0\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7djfk"
Jul 09 01:39:18.891926 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.891897    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkbhr\" (UniqueName: \"kubernetes.io/projected/d4e9ac0a-b2da-4b82-86c6-c69b57d0f6c0-kube-api-access-mkbhr\") pod \"monitoring-plugin-d5dcff7cf-7djfk\" (UID: \"d4e9ac0a-b2da-4b82-86c6-c69b57d0f6c0\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7djfk"
Jul 09 01:39:18.892056 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.892004    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d4e9ac0a-b2da-4b82-86c6-c69b57d0f6c0-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-7djfk\" (UID: \"d4e9ac0a-b2da-4b82-86c6-c69b57d0f6c0\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7djfk"
Jul 09 01:39:18.892195 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:39:18.892178    2562 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 09 01:39:18.892253 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:39:18.892240    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4e9ac0a-b2da-4b82-86c6-c69b57d0f6c0-monitoring-plugin-cert podName:d4e9ac0a-b2da-4b82-86c6-c69b57d0f6c0 nodeName:}" failed. No retries permitted until 2026-07-09 01:39:19.39222448 +0000 UTC m=+57.603876795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/d4e9ac0a-b2da-4b82-86c6-c69b57d0f6c0-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-7djfk" (UID: "d4e9ac0a-b2da-4b82-86c6-c69b57d0f6c0") : secret "monitoring-plugin-cert" not found
Jul 09 01:39:18.900478 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:18.900460    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkbhr\" (UniqueName: \"kubernetes.io/projected/d4e9ac0a-b2da-4b82-86c6-c69b57d0f6c0-kube-api-access-mkbhr\") pod \"monitoring-plugin-d5dcff7cf-7djfk\" (UID: \"d4e9ac0a-b2da-4b82-86c6-c69b57d0f6c0\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7djfk"
Jul 09 01:39:19.163411 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.163380    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5d84b66c64-56vbt"]
Jul 09 01:39:19.167671 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.167651    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.170369 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.170342    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 09 01:39:19.170485 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.170406    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 09 01:39:19.170485 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.170428    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 09 01:39:19.170726 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.170712    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 09 01:39:19.170926 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.170913    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 09 01:39:19.171009 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.170995    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-r6nsl\""
Jul 09 01:39:19.175235 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.175218    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 09 01:39:19.178101 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.178081    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5d84b66c64-56vbt"]
Jul 09 01:39:19.196409 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.196033    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/285f78f2-08aa-455a-8613-e1b219ac3559-federate-client-tls\") pod \"telemeter-client-5d84b66c64-56vbt\" (UID: \"285f78f2-08aa-455a-8613-e1b219ac3559\") " pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.196409 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.196104    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/285f78f2-08aa-455a-8613-e1b219ac3559-secret-telemeter-client\") pod \"telemeter-client-5d84b66c64-56vbt\" (UID: \"285f78f2-08aa-455a-8613-e1b219ac3559\") " pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.196409 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.196149    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/285f78f2-08aa-455a-8613-e1b219ac3559-telemeter-client-tls\") pod \"telemeter-client-5d84b66c64-56vbt\" (UID: \"285f78f2-08aa-455a-8613-e1b219ac3559\") " pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.196409 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.196444    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/285f78f2-08aa-455a-8613-e1b219ac3559-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d84b66c64-56vbt\" (UID: \"285f78f2-08aa-455a-8613-e1b219ac3559\") " pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.196936 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.196495    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/285f78f2-08aa-455a-8613-e1b219ac3559-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d84b66c64-56vbt\" (UID: \"285f78f2-08aa-455a-8613-e1b219ac3559\") " pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.196936 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.196530    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/285f78f2-08aa-455a-8613-e1b219ac3559-metrics-client-ca\") pod \"telemeter-client-5d84b66c64-56vbt\" (UID: \"285f78f2-08aa-455a-8613-e1b219ac3559\") " pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.196936 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.196561    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/285f78f2-08aa-455a-8613-e1b219ac3559-serving-certs-ca-bundle\") pod \"telemeter-client-5d84b66c64-56vbt\" (UID: \"285f78f2-08aa-455a-8613-e1b219ac3559\") " pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.196936 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.196587    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4wpg\" (UniqueName: \"kubernetes.io/projected/285f78f2-08aa-455a-8613-e1b219ac3559-kube-api-access-l4wpg\") pod \"telemeter-client-5d84b66c64-56vbt\" (UID: \"285f78f2-08aa-455a-8613-e1b219ac3559\") " pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.297514 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.297480    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/285f78f2-08aa-455a-8613-e1b219ac3559-metrics-client-ca\") pod \"telemeter-client-5d84b66c64-56vbt\" (UID: \"285f78f2-08aa-455a-8613-e1b219ac3559\") " pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.297674 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.297532    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/285f78f2-08aa-455a-8613-e1b219ac3559-serving-certs-ca-bundle\") pod \"telemeter-client-5d84b66c64-56vbt\" (UID: \"285f78f2-08aa-455a-8613-e1b219ac3559\") " pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.297674 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.297566    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4wpg\" (UniqueName: \"kubernetes.io/projected/285f78f2-08aa-455a-8613-e1b219ac3559-kube-api-access-l4wpg\") pod \"telemeter-client-5d84b66c64-56vbt\" (UID: \"285f78f2-08aa-455a-8613-e1b219ac3559\") " pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.297674 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.297663    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/285f78f2-08aa-455a-8613-e1b219ac3559-federate-client-tls\") pod \"telemeter-client-5d84b66c64-56vbt\" (UID: \"285f78f2-08aa-455a-8613-e1b219ac3559\") " pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.297844 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.297726    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/285f78f2-08aa-455a-8613-e1b219ac3559-secret-telemeter-client\") pod \"telemeter-client-5d84b66c64-56vbt\" (UID: \"285f78f2-08aa-455a-8613-e1b219ac3559\") " pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.297844 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.297757    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/285f78f2-08aa-455a-8613-e1b219ac3559-telemeter-client-tls\") pod \"telemeter-client-5d84b66c64-56vbt\" (UID: \"285f78f2-08aa-455a-8613-e1b219ac3559\") " pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.297844 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.297785    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/285f78f2-08aa-455a-8613-e1b219ac3559-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d84b66c64-56vbt\" (UID: \"285f78f2-08aa-455a-8613-e1b219ac3559\") " pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.297844 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.297829    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/285f78f2-08aa-455a-8613-e1b219ac3559-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d84b66c64-56vbt\" (UID: \"285f78f2-08aa-455a-8613-e1b219ac3559\") " pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.298342 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.298316    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/285f78f2-08aa-455a-8613-e1b219ac3559-metrics-client-ca\") pod \"telemeter-client-5d84b66c64-56vbt\" (UID: \"285f78f2-08aa-455a-8613-e1b219ac3559\") " pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.298460 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.298342    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/285f78f2-08aa-455a-8613-e1b219ac3559-serving-certs-ca-bundle\") pod \"telemeter-client-5d84b66c64-56vbt\" (UID: \"285f78f2-08aa-455a-8613-e1b219ac3559\") " pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.298802 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.298760    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/285f78f2-08aa-455a-8613-e1b219ac3559-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d84b66c64-56vbt\" (UID: \"285f78f2-08aa-455a-8613-e1b219ac3559\") " pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.301192 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.301165    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/285f78f2-08aa-455a-8613-e1b219ac3559-telemeter-client-tls\") pod \"telemeter-client-5d84b66c64-56vbt\" (UID: \"285f78f2-08aa-455a-8613-e1b219ac3559\") " pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.301498 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.301478    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/285f78f2-08aa-455a-8613-e1b219ac3559-secret-telemeter-client\") pod \"telemeter-client-5d84b66c64-56vbt\" (UID: \"285f78f2-08aa-455a-8613-e1b219ac3559\") " pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.301578 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.301523    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/285f78f2-08aa-455a-8613-e1b219ac3559-federate-client-tls\") pod \"telemeter-client-5d84b66c64-56vbt\" (UID: \"285f78f2-08aa-455a-8613-e1b219ac3559\") " pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.301635 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.301613    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/285f78f2-08aa-455a-8613-e1b219ac3559-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d84b66c64-56vbt\" (UID: \"285f78f2-08aa-455a-8613-e1b219ac3559\") " pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.307148 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.307124    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4wpg\" (UniqueName: \"kubernetes.io/projected/285f78f2-08aa-455a-8613-e1b219ac3559-kube-api-access-l4wpg\") pod \"telemeter-client-5d84b66c64-56vbt\" (UID: \"285f78f2-08aa-455a-8613-e1b219ac3559\") " pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.399220 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.398725    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d4e9ac0a-b2da-4b82-86c6-c69b57d0f6c0-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-7djfk\" (UID: \"d4e9ac0a-b2da-4b82-86c6-c69b57d0f6c0\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7djfk"
Jul 09 01:39:19.402462 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.402375    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d4e9ac0a-b2da-4b82-86c6-c69b57d0f6c0-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-7djfk\" (UID: \"d4e9ac0a-b2da-4b82-86c6-c69b57d0f6c0\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7djfk"
Jul 09 01:39:19.417836 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.417099    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-599658689f-nrqf2" event={"ID":"aae0f151-38a0-4091-87a4-8825d5968cb7","Type":"ContainerStarted","Data":"713bf0e488b48f0e294963f5c93f1d8c5791eb72e59f734b8b39869cf7ead690"}
Jul 09 01:39:19.421928 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.421864    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-784d559c-28pzc" event={"ID":"e9e4b665-cc44-4db4-b0ad-5e833d08bec4","Type":"ContainerStarted","Data":"e3f315830d1439cb0afd9d4f0a0f354bf8529ddc955dc9092976383098c82d0e"}
Jul 09 01:39:19.423478 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.423456    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2" event={"ID":"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c","Type":"ContainerStarted","Data":"9fbca856494594368d0f3355eb1baeb397a4478049069324c7c50a5f1b06cb88"}
Jul 09 01:39:19.427074 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.427040    2562 generic.go:356] "Generic (PLEG): container finished" podID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerID="61c8024b63ad942d051f048fdbe2539b437bf9c814c3c5f744081e500d84e466" exitCode=0
Jul 09 01:39:19.427168 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.427073    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0657f127-9741-4fc2-bf9c-cc319c05017c","Type":"ContainerDied","Data":"61c8024b63ad942d051f048fdbe2539b437bf9c814c3c5f744081e500d84e466"}
Jul 09 01:39:19.436555 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.436307    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-599658689f-nrqf2" podStartSLOduration=2.050457903 podStartE2EDuration="6.436288825s" totalImagesPullingTime="4.385830922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:39:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:19.435600854 +0000 UTC m=+57.647253194" watchObservedRunningTime="2026-07-09 01:39:19.436288825 +0000 UTC m=+57.647941164"
Jul 09 01:39:19.476853 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.476827    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt"
Jul 09 01:39:19.627204 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.627059    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5d84b66c64-56vbt"]
Jul 09 01:39:19.629736 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:39:19.629699    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod285f78f2_08aa_455a_8613_e1b219ac3559.slice/crio-7ed9c7f742dc9eae5f8be19f47e00e6dda72878c4e618787a948811d9fded4b5 WatchSource:0}: Error finding container 7ed9c7f742dc9eae5f8be19f47e00e6dda72878c4e618787a948811d9fded4b5: Status 404 returned error can't find the container with id 7ed9c7f742dc9eae5f8be19f47e00e6dda72878c4e618787a948811d9fded4b5
Jul 09 01:39:19.646058 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.646037    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7djfk"
Jul 09 01:39:19.788645 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:19.788619    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-7djfk"]
Jul 09 01:39:19.791101 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:39:19.791073    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4e9ac0a_b2da_4b82_86c6_c69b57d0f6c0.slice/crio-2f8046f3b2239f082d1248cd8880b89fa408379a88a11a7c2ce50f57e868cc42 WatchSource:0}: Error finding container 2f8046f3b2239f082d1248cd8880b89fa408379a88a11a7c2ce50f57e868cc42: Status 404 returned error can't find the container with id 2f8046f3b2239f082d1248cd8880b89fa408379a88a11a7c2ce50f57e868cc42
Jul 09 01:39:20.134786 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.134751    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 01:39:20.138458 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.138437    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.142327 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.142305    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-49cq6\""
Jul 09 01:39:20.145040 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.142655    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 09 01:39:20.145040 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.142891    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 09 01:39:20.145040 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.143336    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-l9a470a1fd22\""
Jul 09 01:39:20.145040 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.143578    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 09 01:39:20.145040 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.143786    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 09 01:39:20.147236 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.145495    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 09 01:39:20.147236 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.145710    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 09 01:39:20.147236 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.145906    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 09 01:39:20.147236 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.146139    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 09 01:39:20.147236 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.146313    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 09 01:39:20.147236 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.146473    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 09 01:39:20.147236 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.146655    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 09 01:39:20.147236 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.146864    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 09 01:39:20.147236 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.147075    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 09 01:39:20.150794 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.149156    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 09 01:39:20.166927 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.165902    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 01:39:20.210825 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.210796    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.210982 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.210832    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.210982 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.210855    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.210982 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.210913    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.210982 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.210955    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.211274 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.210997    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dlsr\" (UniqueName: \"kubernetes.io/projected/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-kube-api-access-4dlsr\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.211274 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.211149    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-web-config\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.211274 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.211190    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.211274 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.211247    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.211475 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.211289    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.211475 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.211315    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.211475 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.211359    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.211475 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.211397    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-config-out\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.211475 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.211424    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.211731 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.211510    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.211731 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.211533    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.211731 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.211567    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.211731 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.211596    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-config\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.211731 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.211610    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.211731 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.211629    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.314237 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.312869    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.314237 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.312907    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.314237 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.312941    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.314237 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.312971    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-config\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.314237 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.313000    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.314237 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.313045    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.314237 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.313072    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.314237 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.313095    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.314237 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.313117    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.314237 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.313168    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.314237 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.313194    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.314237 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.313216    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dlsr\" (UniqueName: \"kubernetes.io/projected/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-kube-api-access-4dlsr\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.314237 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.313261    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-web-config\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.314237 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.313298    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.315298 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.314077    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.315298 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.315222    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.315444 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.315404    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.318372 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.318070    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.318372 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.318122    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.318372 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.318156    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.318372 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.318198    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.318372 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.318234    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-config-out\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.318372 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.318259    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.318372 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.318358    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.318827 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.318496    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.319252 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.318903    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.320257 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.319963    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.320553 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.320532    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.321220 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.321197    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-web-config\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.321549 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.321524    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.321906 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.321849    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.321906 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.321867    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.322577 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.322552    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.322664 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.322644    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-config-out\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.322824 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.322804    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.323356 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.323335    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.323356 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.323348    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.323861 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.323839    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.324255 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.324235    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dlsr\" (UniqueName: \"kubernetes.io/projected/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-kube-api-access-4dlsr\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.324619 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.324533    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-config\") pod \"prometheus-k8s-0\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:20.351744 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.351721    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-24ln9"
Jul 09 01:39:20.434698 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.434573    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7djfk" event={"ID":"d4e9ac0a-b2da-4b82-86c6-c69b57d0f6c0","Type":"ContainerStarted","Data":"2f8046f3b2239f082d1248cd8880b89fa408379a88a11a7c2ce50f57e868cc42"}
Jul 09 01:39:20.436080 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.436052    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt" event={"ID":"285f78f2-08aa-455a-8613-e1b219ac3559","Type":"ContainerStarted","Data":"7ed9c7f742dc9eae5f8be19f47e00e6dda72878c4e618787a948811d9fded4b5"}
Jul 09 01:39:20.479288 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:20.479229    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:23.394029 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:23.393868    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 01:39:23.399972 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:39:23.399942    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba6ff2b3_4a2c_412b_9a68_dea7da2acd70.slice/crio-eb1819100ed9019960ed68371975f942e63723ffbdaf375413ac3ee7c4890c9f WatchSource:0}: Error finding container eb1819100ed9019960ed68371975f942e63723ffbdaf375413ac3ee7c4890c9f: Status 404 returned error can't find the container with id eb1819100ed9019960ed68371975f942e63723ffbdaf375413ac3ee7c4890c9f
Jul 09 01:39:23.452719 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:23.452612    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0657f127-9741-4fc2-bf9c-cc319c05017c","Type":"ContainerStarted","Data":"3fc465d23d24fa0783f83b69d53c3c2e047acf0defdab8d5b624ec4c17254c3a"}
Jul 09 01:39:23.456076 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:23.455446    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-784d559c-28pzc" event={"ID":"e9e4b665-cc44-4db4-b0ad-5e833d08bec4","Type":"ContainerStarted","Data":"9aae6bf20a7ed5b96702c30e1ec6e41f0f0e779e38eaf6cd52bbe0569a5d6823"}
Jul 09 01:39:23.457491 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:23.457444    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70","Type":"ContainerStarted","Data":"eb1819100ed9019960ed68371975f942e63723ffbdaf375413ac3ee7c4890c9f"}
Jul 09 01:39:23.461226 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:23.461167    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2" event={"ID":"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c","Type":"ContainerStarted","Data":"cae4c70fc40ac8003212004e598aa9563f02f5bc2db3535f868c0aa18c44620d"}
Jul 09 01:39:23.461357 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:23.461276    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2" event={"ID":"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c","Type":"ContainerStarted","Data":"1bcd0453c82633e27a7caecd1229165a5218490201e7e8f754ffc79e86709c4b"}
Jul 09 01:39:23.463517 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:23.463457    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7djfk" event={"ID":"d4e9ac0a-b2da-4b82-86c6-c69b57d0f6c0","Type":"ContainerStarted","Data":"3ff9d392d753985d3cf5be8a94663c367ea237625e9d392c75a17b70e5ebf83b"}
Jul 09 01:39:23.468739 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:23.466357    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt" event={"ID":"285f78f2-08aa-455a-8613-e1b219ac3559","Type":"ContainerStarted","Data":"1af18349fb904d5b16ab19846602187a52d7d53a02664a2e48828a71d2e2d598"}
Jul 09 01:39:23.468739 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:23.466999    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7djfk"
Jul 09 01:39:23.476078 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:23.475643    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7djfk"
Jul 09 01:39:23.492657 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:23.491480    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-784d559c-28pzc" podStartSLOduration=1.074755055 podStartE2EDuration="5.491459811s" totalImagesPullingTime="4.416704756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:23.475912338 +0000 UTC m=+61.687564678" watchObservedRunningTime="2026-07-09 01:39:23.491459811 +0000 UTC m=+61.703112147"
Jul 09 01:39:23.492657 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:23.491604    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7djfk" podStartSLOduration=2.073571263 podStartE2EDuration="5.491598676s" totalImagesPullingTime="3.418027413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:23.490546796 +0000 UTC m=+61.702199133" watchObservedRunningTime="2026-07-09 01:39:23.491598676 +0000 UTC m=+61.703251014"
Jul 09 01:39:23.852659 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:23.852632    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:39:23.852773 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:23.852687    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:39:23.858561 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:23.858537    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:39:24.472429 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:24.472399    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2" event={"ID":"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c","Type":"ContainerStarted","Data":"120716d6cc1878d68eaf25cf3f4fa3378ea1b661f12d86c193bd4e58350ef982"}
Jul 09 01:39:24.474357 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:24.474330    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt" event={"ID":"285f78f2-08aa-455a-8613-e1b219ac3559","Type":"ContainerStarted","Data":"cd8443a6df38ac03f414d0d5b9391ca2c92efc51ea2ac1797a8c011defa1d01b"}
Jul 09 01:39:24.474482 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:24.474385    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt" event={"ID":"285f78f2-08aa-455a-8613-e1b219ac3559","Type":"ContainerStarted","Data":"278d5e59ea7057d3b0ce31a11a06f08031d9860999d690245281bf0bf5e2c6d6"}
Jul 09 01:39:24.477155 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:24.477130    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0657f127-9741-4fc2-bf9c-cc319c05017c","Type":"ContainerStarted","Data":"5d5bbbb0535cb216e558a8a407d07421ec73ff5f80f93b775393f49e3e2a75bc"}
Jul 09 01:39:24.477275 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:24.477195    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0657f127-9741-4fc2-bf9c-cc319c05017c","Type":"ContainerStarted","Data":"7e3692b83eb9d2897a3a56afd533e78dd201d2cb19b862f7b7e7eaa46e85189d"}
Jul 09 01:39:24.477275 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:24.477233    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0657f127-9741-4fc2-bf9c-cc319c05017c","Type":"ContainerStarted","Data":"fe2d3897e342161a7c388ecfee3d11ad4da2b18624ae433913603cbebf829ab0"}
Jul 09 01:39:24.477275 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:24.477259    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0657f127-9741-4fc2-bf9c-cc319c05017c","Type":"ContainerStarted","Data":"1c7b8c86a85b8906ba4dd65e35f329139518e6ab229bd2d6f0f3dcd3d83a4a37"}
Jul 09 01:39:24.478547 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:24.478525    2562 generic.go:356] "Generic (PLEG): container finished" podID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerID="b9fdc92199929cab5829fd513b7be9d0b512280080bfdf74d662476618c21eb1" exitCode=0
Jul 09 01:39:24.478657 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:24.478619    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70","Type":"ContainerDied","Data":"b9fdc92199929cab5829fd513b7be9d0b512280080bfdf74d662476618c21eb1"}
Jul 09 01:39:24.482894 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:24.482877    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:39:24.499288 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:24.499251    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5d84b66c64-56vbt" podStartSLOduration=1.920801366 podStartE2EDuration="5.499240029s" totalImagesPullingTime="3.578438663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:39:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:24.497801498 +0000 UTC m=+62.709453836" watchObservedRunningTime="2026-07-09 01:39:24.499240029 +0000 UTC m=+62.710892364"
Jul 09 01:39:25.303385 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:25.303349    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-699pt"
Jul 09 01:39:25.489563 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:25.489462    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0657f127-9741-4fc2-bf9c-cc319c05017c","Type":"ContainerStarted","Data":"95779af833c08d95aae6fdd817cf3e7b7266e55177176526c9fd37e43b74dd2d"}
Jul 09 01:39:25.493559 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:25.493529    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2" event={"ID":"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c","Type":"ContainerStarted","Data":"c16f1176c42f32c3a9798e8d65f2a9fa56a678f1d184235abd707a76d10a8599"}
Jul 09 01:39:25.493685 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:25.493600    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2" event={"ID":"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c","Type":"ContainerStarted","Data":"faf0aaa180821c828248d1d1d73e5210cbb407ca01e41c1aa8a569fa7ebfa298"}
Jul 09 01:39:25.493685 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:25.493640    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2" event={"ID":"a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c","Type":"ContainerStarted","Data":"205d24ff977686602058a4c6822f6152eb077bae9296934bda52c4222db1b223"}
Jul 09 01:39:25.517626 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:25.517572    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.71550216 podStartE2EDuration="11.517553128s" totalImagesPullingTime="6.780342821s" totalInitContainerRuntime="21.708147ms" isStatefulPod=false podCreationTimestamp="2026-07-09 01:39:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:25.516567651 +0000 UTC m=+63.728219990" watchObservedRunningTime="2026-07-09 01:39:25.517553128 +0000 UTC m=+63.729205469"
Jul 09 01:39:25.542691 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:25.542618    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2" podStartSLOduration=3.888529698 podStartE2EDuration="9.542604084s" totalImagesPullingTime="5.654074386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:39:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:25.540461304 +0000 UTC m=+63.752113655" watchObservedRunningTime="2026-07-09 01:39:25.542604084 +0000 UTC m=+63.754256419"
Jul 09 01:39:26.498701 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:26.498615    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:28.510682 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:28.510653    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70","Type":"ContainerStarted","Data":"ce2293a117f51b189b794abfba1ac76dc41509bc7336575c9d0b624b5e4803e2"}
Jul 09 01:39:28.511039 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:28.510726    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70","Type":"ContainerStarted","Data":"387d4147ad17c3e30eaebf9c814f95872c9c96daccf0e56b49e5c6c198debb7e"}
Jul 09 01:39:28.511039 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:28.510767    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70","Type":"ContainerStarted","Data":"ea6963015d10dda476473cbc763fee2a500bb778293cd499026233fd33ff52e7"}
Jul 09 01:39:28.511039 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:28.510810    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70","Type":"ContainerStarted","Data":"b39d93209ea95877c4eb48190ab8ad869c91f9e0a67529648b462cd7f0ad2f92"}
Jul 09 01:39:28.511039 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:28.510840    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70","Type":"ContainerStarted","Data":"b003cd8fe2dbd7ea5260db0cb5fd88ff3283292fd3eedfd1dad2cc24ae5b623b"}
Jul 09 01:39:28.511039 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:28.510865    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70","Type":"ContainerStarted","Data":"ddcc937eff92357dcb0ef13976c09b1833c33122eb49b41fbc0dfc0c8c9312e6"}
Jul 09 01:39:28.542467 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:28.542337    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.178183643 podStartE2EDuration="8.542320878s" totalImagesPullingTime="3.338446674s" totalInitContainerRuntime="25.690561ms" isStatefulPod=false podCreationTimestamp="2026-07-09 01:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:28.540684706 +0000 UTC m=+66.752337068" watchObservedRunningTime="2026-07-09 01:39:28.542320878 +0000 UTC m=+66.753973221"
Jul 09 01:39:29.453385 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.453356    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-db8769489-fmvq8"]
Jul 09 01:39:29.482393 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.482364    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-db8769489-fmvq8"]
Jul 09 01:39:29.482521 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.482466    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:29.490826 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.490806    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 09 01:39:29.609728 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.609698    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/211078c1-aa83-4e9e-9297-f70af758d22d-console-serving-cert\") pod \"console-db8769489-fmvq8\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") " pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:29.610272 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.609898    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/211078c1-aa83-4e9e-9297-f70af758d22d-console-oauth-config\") pod \"console-db8769489-fmvq8\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") " pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:29.610272 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.609967    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/211078c1-aa83-4e9e-9297-f70af758d22d-oauth-serving-cert\") pod \"console-db8769489-fmvq8\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") " pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:29.610388 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.610369    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbp7t\" (UniqueName: \"kubernetes.io/projected/211078c1-aa83-4e9e-9297-f70af758d22d-kube-api-access-jbp7t\") pod \"console-db8769489-fmvq8\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") " pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:29.610457 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.610439    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/211078c1-aa83-4e9e-9297-f70af758d22d-service-ca\") pod \"console-db8769489-fmvq8\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") " pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:29.610577 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.610557    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/211078c1-aa83-4e9e-9297-f70af758d22d-trusted-ca-bundle\") pod \"console-db8769489-fmvq8\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") " pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:29.610677 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.610660    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/211078c1-aa83-4e9e-9297-f70af758d22d-console-config\") pod \"console-db8769489-fmvq8\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") " pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:29.711619 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.711564    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/211078c1-aa83-4e9e-9297-f70af758d22d-console-oauth-config\") pod \"console-db8769489-fmvq8\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") " pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:29.711619 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.711596    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/211078c1-aa83-4e9e-9297-f70af758d22d-oauth-serving-cert\") pod \"console-db8769489-fmvq8\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") " pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:29.711619 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.711613    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbp7t\" (UniqueName: \"kubernetes.io/projected/211078c1-aa83-4e9e-9297-f70af758d22d-kube-api-access-jbp7t\") pod \"console-db8769489-fmvq8\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") " pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:29.711839 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.711634    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/211078c1-aa83-4e9e-9297-f70af758d22d-service-ca\") pod \"console-db8769489-fmvq8\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") " pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:29.711839 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.711750    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/211078c1-aa83-4e9e-9297-f70af758d22d-trusted-ca-bundle\") pod \"console-db8769489-fmvq8\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") " pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:29.711839 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.711806    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/211078c1-aa83-4e9e-9297-f70af758d22d-console-config\") pod \"console-db8769489-fmvq8\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") " pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:29.711989 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.711852    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/211078c1-aa83-4e9e-9297-f70af758d22d-console-serving-cert\") pod \"console-db8769489-fmvq8\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") " pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:29.712389 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.712360    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/211078c1-aa83-4e9e-9297-f70af758d22d-oauth-serving-cert\") pod \"console-db8769489-fmvq8\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") " pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:29.712489 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.712388    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/211078c1-aa83-4e9e-9297-f70af758d22d-service-ca\") pod \"console-db8769489-fmvq8\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") " pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:29.712536 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.712484    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/211078c1-aa83-4e9e-9297-f70af758d22d-console-config\") pod \"console-db8769489-fmvq8\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") " pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:29.712621 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.712600    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/211078c1-aa83-4e9e-9297-f70af758d22d-trusted-ca-bundle\") pod \"console-db8769489-fmvq8\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") " pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:29.713827 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.713800    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/211078c1-aa83-4e9e-9297-f70af758d22d-console-oauth-config\") pod \"console-db8769489-fmvq8\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") " pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:29.714184 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.714168    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/211078c1-aa83-4e9e-9297-f70af758d22d-console-serving-cert\") pod \"console-db8769489-fmvq8\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") " pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:29.720955 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.720936    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbp7t\" (UniqueName: \"kubernetes.io/projected/211078c1-aa83-4e9e-9297-f70af758d22d-kube-api-access-jbp7t\") pod \"console-db8769489-fmvq8\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") " pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:29.792966 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.792943    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:29.914677 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.914645    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-original-pull-secret\") pod \"global-pull-secret-syncer-xcs6g\" (UID: \"d934d4c6-1de4-4fce-8aca-e3a5a1cd14df\") " pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:39:29.914814 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.914792    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/354cfa30-e59e-4198-996a-62a7fd0b43dc-metrics-certs\") pod \"network-metrics-daemon-fbxl7\" (UID: \"354cfa30-e59e-4198-996a-62a7fd0b43dc\") " pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:39:29.917573 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.917551    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 01:39:29.917677 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.917551    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 01:39:29.927840 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.927817    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/354cfa30-e59e-4198-996a-62a7fd0b43dc-metrics-certs\") pod \"network-metrics-daemon-fbxl7\" (UID: \"354cfa30-e59e-4198-996a-62a7fd0b43dc\") " pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:39:29.927966 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.927944    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d934d4c6-1de4-4fce-8aca-e3a5a1cd14df-original-pull-secret\") pod \"global-pull-secret-syncer-xcs6g\" (UID: \"d934d4c6-1de4-4fce-8aca-e3a5a1cd14df\") " pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:39:29.951350 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:29.951327    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-db8769489-fmvq8"]
Jul 09 01:39:29.953077 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:39:29.953054    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod211078c1_aa83_4e9e_9297_f70af758d22d.slice/crio-9796bcfced3f18daf041fd46ff5f0415b8b3ca4d707315687e21aa65694a3d82 WatchSource:0}: Error finding container 9796bcfced3f18daf041fd46ff5f0415b8b3ca4d707315687e21aa65694a3d82: Status 404 returned error can't find the container with id 9796bcfced3f18daf041fd46ff5f0415b8b3ca4d707315687e21aa65694a3d82
Jul 09 01:39:30.015827 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:30.015804    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4rgj\" (UniqueName: \"kubernetes.io/projected/af2aded5-20b6-406c-a3a9-d9d4f3cd725a-kube-api-access-s4rgj\") pod \"network-check-target-gkjkz\" (UID: \"af2aded5-20b6-406c-a3a9-d9d4f3cd725a\") " pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:39:30.018535 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:30.018514    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 01:39:30.028670 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:30.028651    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 01:39:30.039360 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:30.039342    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4rgj\" (UniqueName: \"kubernetes.io/projected/af2aded5-20b6-406c-a3a9-d9d4f3cd725a-kube-api-access-s4rgj\") pod \"network-check-target-gkjkz\" (UID: \"af2aded5-20b6-406c-a3a9-d9d4f3cd725a\") " pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:39:30.166007 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:30.165980    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xcs6g"
Jul 09 01:39:30.174400 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:30.174385    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-npl7s\""
Jul 09 01:39:30.178670 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:30.178652    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9w8gn\""
Jul 09 01:39:30.182992 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:30.182978    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbxl7"
Jul 09 01:39:30.187246 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:30.187224    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:39:30.306442 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:30.306367    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xcs6g"]
Jul 09 01:39:30.309900 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:39:30.309872    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd934d4c6_1de4_4fce_8aca_e3a5a1cd14df.slice/crio-7bfc36d1f712b7c6ff04238fa7d644ce6f86f91ff21d840021545fcd96c5b780 WatchSource:0}: Error finding container 7bfc36d1f712b7c6ff04238fa7d644ce6f86f91ff21d840021545fcd96c5b780: Status 404 returned error can't find the container with id 7bfc36d1f712b7c6ff04238fa7d644ce6f86f91ff21d840021545fcd96c5b780
Jul 09 01:39:30.328275 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:30.328137    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fbxl7"]
Jul 09 01:39:30.330672 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:39:30.330647    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod354cfa30_e59e_4198_996a_62a7fd0b43dc.slice/crio-8ac3a938f5335ef8c57d5c1112e12a77e7d844cf993e8ad94f9b06bab7b6ffd1 WatchSource:0}: Error finding container 8ac3a938f5335ef8c57d5c1112e12a77e7d844cf993e8ad94f9b06bab7b6ffd1: Status 404 returned error can't find the container with id 8ac3a938f5335ef8c57d5c1112e12a77e7d844cf993e8ad94f9b06bab7b6ffd1
Jul 09 01:39:30.357444 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:30.357421    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gkjkz"]
Jul 09 01:39:30.360157 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:39:30.360134    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf2aded5_20b6_406c_a3a9_d9d4f3cd725a.slice/crio-8e0479c38e04969ab430f8ea73b7f6ab1657e5bf008d89daa508ba65b9a8a9f2 WatchSource:0}: Error finding container 8e0479c38e04969ab430f8ea73b7f6ab1657e5bf008d89daa508ba65b9a8a9f2: Status 404 returned error can't find the container with id 8e0479c38e04969ab430f8ea73b7f6ab1657e5bf008d89daa508ba65b9a8a9f2
Jul 09 01:39:30.480004 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:30.479979    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:30.520692 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:30.520633    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db8769489-fmvq8" event={"ID":"211078c1-aa83-4e9e-9297-f70af758d22d","Type":"ContainerStarted","Data":"a0fa7da0da8b40c3f2ba78ca85eb41edcfe0330fd9fa84dd1e70c8d1964d0eb9"}
Jul 09 01:39:30.520692 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:30.520677    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db8769489-fmvq8" event={"ID":"211078c1-aa83-4e9e-9297-f70af758d22d","Type":"ContainerStarted","Data":"9796bcfced3f18daf041fd46ff5f0415b8b3ca4d707315687e21aa65694a3d82"}
Jul 09 01:39:30.526905 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:30.526877    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gkjkz" event={"ID":"af2aded5-20b6-406c-a3a9-d9d4f3cd725a","Type":"ContainerStarted","Data":"8e0479c38e04969ab430f8ea73b7f6ab1657e5bf008d89daa508ba65b9a8a9f2"}
Jul 09 01:39:30.527973 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:30.527950    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbxl7" event={"ID":"354cfa30-e59e-4198-996a-62a7fd0b43dc","Type":"ContainerStarted","Data":"8ac3a938f5335ef8c57d5c1112e12a77e7d844cf993e8ad94f9b06bab7b6ffd1"}
Jul 09 01:39:30.528987 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:30.528962    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xcs6g" event={"ID":"d934d4c6-1de4-4fce-8aca-e3a5a1cd14df","Type":"ContainerStarted","Data":"7bfc36d1f712b7c6ff04238fa7d644ce6f86f91ff21d840021545fcd96c5b780"}
Jul 09 01:39:30.542121 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:30.542085    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-db8769489-fmvq8" podStartSLOduration=1.5420723010000001 podStartE2EDuration="1.542072301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:39:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:30.541529864 +0000 UTC m=+68.753182197" watchObservedRunningTime="2026-07-09 01:39:30.542072301 +0000 UTC m=+68.753724637"
Jul 09 01:39:32.511458 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:32.511427    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-79cb9dd7b7-thkn2"
Jul 09 01:39:32.545490 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:32.545446    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbxl7" event={"ID":"354cfa30-e59e-4198-996a-62a7fd0b43dc","Type":"ContainerStarted","Data":"d6475f998adc7e45fbd62e5bc8cb7255d289d39963221b031125feedc2e18963"}
Jul 09 01:39:32.545634 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:32.545515    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbxl7" event={"ID":"354cfa30-e59e-4198-996a-62a7fd0b43dc","Type":"ContainerStarted","Data":"5119f1058bdfb40ce8cb30d7c0dc35e66b698171d9dde0f76dd84766ad70c180"}
Jul 09 01:39:32.563135 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:32.563085    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fbxl7" podStartSLOduration=66.326810389 podStartE2EDuration="1m7.563063191s" totalImagesPullingTime="1.236252802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:32.561453256 +0000 UTC m=+70.773105615" watchObservedRunningTime="2026-07-09 01:39:32.563063191 +0000 UTC m=+70.774715534"
Jul 09 01:39:36.573827 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:36.573785    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gkjkz" event={"ID":"af2aded5-20b6-406c-a3a9-d9d4f3cd725a","Type":"ContainerStarted","Data":"8afbf2021703436f1bda1cef44f8fd869f0d048a5fa87dfd9aa12335d6d2a2a2"}
Jul 09 01:39:36.574332 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:36.573881    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:39:36.575305 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:36.575283    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xcs6g" event={"ID":"d934d4c6-1de4-4fce-8aca-e3a5a1cd14df","Type":"ContainerStarted","Data":"81b106897be33275980de4add50bf37e288538a24d951de22a2abe444aef3f87"}
Jul 09 01:39:36.591421 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:36.591376    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gkjkz" podStartSLOduration=66.435375659 podStartE2EDuration="1m11.591362587s" totalImagesPullingTime="5.155986928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:36.589668738 +0000 UTC m=+74.801321073" watchObservedRunningTime="2026-07-09 01:39:36.591362587 +0000 UTC m=+74.803014923"
Jul 09 01:39:36.604131 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:36.604079    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xcs6g" podStartSLOduration=66.393372431 podStartE2EDuration="1m11.604065277s" totalImagesPullingTime="5.210692846s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:36.603645509 +0000 UTC m=+74.815297847" watchObservedRunningTime="2026-07-09 01:39:36.604065277 +0000 UTC m=+74.815717610"
Jul 09 01:39:38.654989 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:38.654950    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:38.655381 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:38.655041    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:39.793273 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:39.793237    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:39.793676 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:39.793295    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:39.797796 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:39.797771    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:40.595062 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:40.595034    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:39:40.639954 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:40.639925    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-599658689f-nrqf2"]
Jul 09 01:39:55.934001 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:55.933883    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:55.990616 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:55.990588    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:56.676855 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:56.676831    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:39:58.659700 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:58.659666    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:39:58.663699 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:39:58.663675    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-784d559c-28pzc"
Jul 09 01:40:04.241065 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:04.241032    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 01:40:04.241529 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:04.241318    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="alertmanager" containerID="cri-o://3fc465d23d24fa0783f83b69d53c3c2e047acf0defdab8d5b624ec4c17254c3a" gracePeriod=120
Jul 09 01:40:04.241529 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:04.241452    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="config-reloader" containerID="cri-o://1c7b8c86a85b8906ba4dd65e35f329139518e6ab229bd2d6f0f3dcd3d83a4a37" gracePeriod=120
Jul 09 01:40:04.241529 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:04.241464    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="prom-label-proxy" containerID="cri-o://95779af833c08d95aae6fdd817cf3e7b7266e55177176526c9fd37e43b74dd2d" gracePeriod=120
Jul 09 01:40:04.241529 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:04.241439    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="kube-rbac-proxy-web" containerID="cri-o://fe2d3897e342161a7c388ecfee3d11ad4da2b18624ae433913603cbebf829ab0" gracePeriod=120
Jul 09 01:40:04.241753 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:04.241402    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="kube-rbac-proxy-metric" containerID="cri-o://5d5bbbb0535cb216e558a8a407d07421ec73ff5f80f93b775393f49e3e2a75bc" gracePeriod=120
Jul 09 01:40:04.241753 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:04.241450    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="kube-rbac-proxy" containerID="cri-o://7e3692b83eb9d2897a3a56afd533e78dd201d2cb19b862f7b7e7eaa46e85189d" gracePeriod=120
Jul 09 01:40:04.257135 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:40:04.257111    2562 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0657f127_9741_4fc2_bf9c_cc319c05017c.slice/crio-95779af833c08d95aae6fdd817cf3e7b7266e55177176526c9fd37e43b74dd2d.scope\": RecentStats: unable to find data in memory cache]"
Jul 09 01:40:04.695213 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:04.695184    2562 generic.go:356] "Generic (PLEG): container finished" podID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerID="95779af833c08d95aae6fdd817cf3e7b7266e55177176526c9fd37e43b74dd2d" exitCode=0
Jul 09 01:40:04.695213 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:04.695205    2562 generic.go:356] "Generic (PLEG): container finished" podID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerID="5d5bbbb0535cb216e558a8a407d07421ec73ff5f80f93b775393f49e3e2a75bc" exitCode=0
Jul 09 01:40:04.695213 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:04.695211    2562 generic.go:356] "Generic (PLEG): container finished" podID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerID="7e3692b83eb9d2897a3a56afd533e78dd201d2cb19b862f7b7e7eaa46e85189d" exitCode=0
Jul 09 01:40:04.695213 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:04.695216    2562 generic.go:356] "Generic (PLEG): container finished" podID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerID="1c7b8c86a85b8906ba4dd65e35f329139518e6ab229bd2d6f0f3dcd3d83a4a37" exitCode=0
Jul 09 01:40:04.695213 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:04.695221    2562 generic.go:356] "Generic (PLEG): container finished" podID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerID="3fc465d23d24fa0783f83b69d53c3c2e047acf0defdab8d5b624ec4c17254c3a" exitCode=0
Jul 09 01:40:04.695483 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:04.695247    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0657f127-9741-4fc2-bf9c-cc319c05017c","Type":"ContainerDied","Data":"95779af833c08d95aae6fdd817cf3e7b7266e55177176526c9fd37e43b74dd2d"}
Jul 09 01:40:04.695483 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:04.695308    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0657f127-9741-4fc2-bf9c-cc319c05017c","Type":"ContainerDied","Data":"5d5bbbb0535cb216e558a8a407d07421ec73ff5f80f93b775393f49e3e2a75bc"}
Jul 09 01:40:04.695483 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:04.695332    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0657f127-9741-4fc2-bf9c-cc319c05017c","Type":"ContainerDied","Data":"7e3692b83eb9d2897a3a56afd533e78dd201d2cb19b862f7b7e7eaa46e85189d"}
Jul 09 01:40:04.695483 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:04.695356    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0657f127-9741-4fc2-bf9c-cc319c05017c","Type":"ContainerDied","Data":"1c7b8c86a85b8906ba4dd65e35f329139518e6ab229bd2d6f0f3dcd3d83a4a37"}
Jul 09 01:40:04.695483 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:04.695379    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0657f127-9741-4fc2-bf9c-cc319c05017c","Type":"ContainerDied","Data":"3fc465d23d24fa0783f83b69d53c3c2e047acf0defdab8d5b624ec4c17254c3a"}
Jul 09 01:40:05.661095 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:05.660970    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-599658689f-nrqf2" podUID="aae0f151-38a0-4091-87a4-8825d5968cb7" containerName="console" containerID="cri-o://713bf0e488b48f0e294963f5c93f1d8c5791eb72e59f734b8b39869cf7ead690" gracePeriod=15
Jul 09 01:40:05.702801 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:05.702774    2562 generic.go:356] "Generic (PLEG): container finished" podID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerID="fe2d3897e342161a7c388ecfee3d11ad4da2b18624ae433913603cbebf829ab0" exitCode=0
Jul 09 01:40:05.702907 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:05.702829    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0657f127-9741-4fc2-bf9c-cc319c05017c","Type":"ContainerDied","Data":"fe2d3897e342161a7c388ecfee3d11ad4da2b18624ae433913603cbebf829ab0"}
Jul 09 01:40:05.948124 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:05.948098    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:40:06.009669 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.009649    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.013179 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.013160    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aae0f151-38a0-4091-87a4-8825d5968cb7-oauth-serving-cert\") pod \"aae0f151-38a0-4091-87a4-8825d5968cb7\" (UID: \"aae0f151-38a0-4091-87a4-8825d5968cb7\") "
Jul 09 01:40:06.013252 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.013201    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aae0f151-38a0-4091-87a4-8825d5968cb7-service-ca\") pod \"aae0f151-38a0-4091-87a4-8825d5968cb7\" (UID: \"aae0f151-38a0-4091-87a4-8825d5968cb7\") "
Jul 09 01:40:06.013288 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.013260    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aae0f151-38a0-4091-87a4-8825d5968cb7-console-oauth-config\") pod \"aae0f151-38a0-4091-87a4-8825d5968cb7\" (UID: \"aae0f151-38a0-4091-87a4-8825d5968cb7\") "
Jul 09 01:40:06.013339 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.013297    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aae0f151-38a0-4091-87a4-8825d5968cb7-console-config\") pod \"aae0f151-38a0-4091-87a4-8825d5968cb7\" (UID: \"aae0f151-38a0-4091-87a4-8825d5968cb7\") "
Jul 09 01:40:06.013339 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.013333    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aae0f151-38a0-4091-87a4-8825d5968cb7-console-serving-cert\") pod \"aae0f151-38a0-4091-87a4-8825d5968cb7\" (UID: \"aae0f151-38a0-4091-87a4-8825d5968cb7\") "
Jul 09 01:40:06.013435 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.013372    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrd2f\" (UniqueName: \"kubernetes.io/projected/aae0f151-38a0-4091-87a4-8825d5968cb7-kube-api-access-rrd2f\") pod \"aae0f151-38a0-4091-87a4-8825d5968cb7\" (UID: \"aae0f151-38a0-4091-87a4-8825d5968cb7\") "
Jul 09 01:40:06.013593 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.013568    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aae0f151-38a0-4091-87a4-8825d5968cb7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aae0f151-38a0-4091-87a4-8825d5968cb7" (UID: "aae0f151-38a0-4091-87a4-8825d5968cb7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:40:06.013674 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.013590    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aae0f151-38a0-4091-87a4-8825d5968cb7-service-ca" (OuterVolumeSpecName: "service-ca") pod "aae0f151-38a0-4091-87a4-8825d5968cb7" (UID: "aae0f151-38a0-4091-87a4-8825d5968cb7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:40:06.013729 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.013673    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aae0f151-38a0-4091-87a4-8825d5968cb7-oauth-serving-cert\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:06.013729 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.013705    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aae0f151-38a0-4091-87a4-8825d5968cb7-console-config" (OuterVolumeSpecName: "console-config") pod "aae0f151-38a0-4091-87a4-8825d5968cb7" (UID: "aae0f151-38a0-4091-87a4-8825d5968cb7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:40:06.013729 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.013724    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aae0f151-38a0-4091-87a4-8825d5968cb7-service-ca\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:06.015419 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.015393    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aae0f151-38a0-4091-87a4-8825d5968cb7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aae0f151-38a0-4091-87a4-8825d5968cb7" (UID: "aae0f151-38a0-4091-87a4-8825d5968cb7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:40:06.015509 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.015468    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aae0f151-38a0-4091-87a4-8825d5968cb7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aae0f151-38a0-4091-87a4-8825d5968cb7" (UID: "aae0f151-38a0-4091-87a4-8825d5968cb7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:40:06.015568 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.015524    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aae0f151-38a0-4091-87a4-8825d5968cb7-kube-api-access-rrd2f" (OuterVolumeSpecName: "kube-api-access-rrd2f") pod "aae0f151-38a0-4091-87a4-8825d5968cb7" (UID: "aae0f151-38a0-4091-87a4-8825d5968cb7"). InnerVolumeSpecName "kube-api-access-rrd2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:40:06.114454 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.114426    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0657f127-9741-4fc2-bf9c-cc319c05017c-tls-assets\") pod \"0657f127-9741-4fc2-bf9c-cc319c05017c\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") "
Jul 09 01:40:06.114589 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.114465    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0657f127-9741-4fc2-bf9c-cc319c05017c-config-out\") pod \"0657f127-9741-4fc2-bf9c-cc319c05017c\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") "
Jul 09 01:40:06.114589 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.114488    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0657f127-9741-4fc2-bf9c-cc319c05017c-alertmanager-main-db\") pod \"0657f127-9741-4fc2-bf9c-cc319c05017c\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") "
Jul 09 01:40:06.114589 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.114505    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-secret-alertmanager-kube-rbac-proxy\") pod \"0657f127-9741-4fc2-bf9c-cc319c05017c\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") "
Jul 09 01:40:06.114589 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.114540    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lw927\" (UniqueName: \"kubernetes.io/projected/0657f127-9741-4fc2-bf9c-cc319c05017c-kube-api-access-lw927\") pod \"0657f127-9741-4fc2-bf9c-cc319c05017c\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") "
Jul 09 01:40:06.114589 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.114557    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-web-config\") pod \"0657f127-9741-4fc2-bf9c-cc319c05017c\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") "
Jul 09 01:40:06.114589 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.114578    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0657f127-9741-4fc2-bf9c-cc319c05017c-metrics-client-ca\") pod \"0657f127-9741-4fc2-bf9c-cc319c05017c\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") "
Jul 09 01:40:06.114869 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.114609    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0657f127-9741-4fc2-bf9c-cc319c05017c\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") "
Jul 09 01:40:06.114869 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.114632    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-cluster-tls-config\") pod \"0657f127-9741-4fc2-bf9c-cc319c05017c\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") "
Jul 09 01:40:06.114869 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.114689    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-secret-alertmanager-kube-rbac-proxy-web\") pod \"0657f127-9741-4fc2-bf9c-cc319c05017c\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") "
Jul 09 01:40:06.114869 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.114742    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-secret-alertmanager-main-tls\") pod \"0657f127-9741-4fc2-bf9c-cc319c05017c\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") "
Jul 09 01:40:06.114869 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.114776    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0657f127-9741-4fc2-bf9c-cc319c05017c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0657f127-9741-4fc2-bf9c-cc319c05017c" (UID: "0657f127-9741-4fc2-bf9c-cc319c05017c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:40:06.114869 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.114787    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0657f127-9741-4fc2-bf9c-cc319c05017c-alertmanager-trusted-ca-bundle\") pod \"0657f127-9741-4fc2-bf9c-cc319c05017c\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") "
Jul 09 01:40:06.114869 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.114861    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-config-volume\") pod \"0657f127-9741-4fc2-bf9c-cc319c05017c\" (UID: \"0657f127-9741-4fc2-bf9c-cc319c05017c\") "
Jul 09 01:40:06.115246 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.115151    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0657f127-9741-4fc2-bf9c-cc319c05017c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0657f127-9741-4fc2-bf9c-cc319c05017c" (UID: "0657f127-9741-4fc2-bf9c-cc319c05017c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:40:06.115246 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.115221    2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0657f127-9741-4fc2-bf9c-cc319c05017c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:06.115246 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.115246    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aae0f151-38a0-4091-87a4-8825d5968cb7-console-oauth-config\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:06.115399 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.115260    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aae0f151-38a0-4091-87a4-8825d5968cb7-console-config\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:06.115399 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.115274    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aae0f151-38a0-4091-87a4-8825d5968cb7-console-serving-cert\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:06.115399 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.115287    2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0657f127-9741-4fc2-bf9c-cc319c05017c-alertmanager-main-db\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:06.115399 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.115299    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrd2f\" (UniqueName: \"kubernetes.io/projected/aae0f151-38a0-4091-87a4-8825d5968cb7-kube-api-access-rrd2f\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:06.116677 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.116635    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0657f127-9741-4fc2-bf9c-cc319c05017c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0657f127-9741-4fc2-bf9c-cc319c05017c" (UID: "0657f127-9741-4fc2-bf9c-cc319c05017c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:40:06.117684 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.117647    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0657f127-9741-4fc2-bf9c-cc319c05017c" (UID: "0657f127-9741-4fc2-bf9c-cc319c05017c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:40:06.117684 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.117669    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0657f127-9741-4fc2-bf9c-cc319c05017c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0657f127-9741-4fc2-bf9c-cc319c05017c" (UID: "0657f127-9741-4fc2-bf9c-cc319c05017c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:40:06.117843 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.117682    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0657f127-9741-4fc2-bf9c-cc319c05017c-config-out" (OuterVolumeSpecName: "config-out") pod "0657f127-9741-4fc2-bf9c-cc319c05017c" (UID: "0657f127-9741-4fc2-bf9c-cc319c05017c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:40:06.118047 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.118005    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0657f127-9741-4fc2-bf9c-cc319c05017c" (UID: "0657f127-9741-4fc2-bf9c-cc319c05017c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:40:06.118152 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.118117    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0657f127-9741-4fc2-bf9c-cc319c05017c-kube-api-access-lw927" (OuterVolumeSpecName: "kube-api-access-lw927") pod "0657f127-9741-4fc2-bf9c-cc319c05017c" (UID: "0657f127-9741-4fc2-bf9c-cc319c05017c"). InnerVolumeSpecName "kube-api-access-lw927". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:40:06.118152 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.118133    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-config-volume" (OuterVolumeSpecName: "config-volume") pod "0657f127-9741-4fc2-bf9c-cc319c05017c" (UID: "0657f127-9741-4fc2-bf9c-cc319c05017c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:40:06.118677 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.118654    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0657f127-9741-4fc2-bf9c-cc319c05017c" (UID: "0657f127-9741-4fc2-bf9c-cc319c05017c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:40:06.118895 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.118875    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0657f127-9741-4fc2-bf9c-cc319c05017c" (UID: "0657f127-9741-4fc2-bf9c-cc319c05017c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:40:06.122452 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.122430    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0657f127-9741-4fc2-bf9c-cc319c05017c" (UID: "0657f127-9741-4fc2-bf9c-cc319c05017c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:40:06.127961 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.127940    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-web-config" (OuterVolumeSpecName: "web-config") pod "0657f127-9741-4fc2-bf9c-cc319c05017c" (UID: "0657f127-9741-4fc2-bf9c-cc319c05017c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:40:06.216163 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.216133    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-secret-alertmanager-main-tls\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:06.216163 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.216159    2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-config-volume\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:06.216163 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.216167    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0657f127-9741-4fc2-bf9c-cc319c05017c-tls-assets\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:06.216341 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.216175    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0657f127-9741-4fc2-bf9c-cc319c05017c-config-out\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:06.216341 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.216184    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:06.216341 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.216193    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lw927\" (UniqueName: \"kubernetes.io/projected/0657f127-9741-4fc2-bf9c-cc319c05017c-kube-api-access-lw927\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:06.216341 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.216218    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-web-config\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:06.216341 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.216228    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0657f127-9741-4fc2-bf9c-cc319c05017c-metrics-client-ca\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:06.216341 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.216236    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:06.216341 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.216246    2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-cluster-tls-config\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:06.216341 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.216255    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0657f127-9741-4fc2-bf9c-cc319c05017c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:06.710345 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.710326    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.710710 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.710339    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0657f127-9741-4fc2-bf9c-cc319c05017c","Type":"ContainerDied","Data":"f60c54cda799d1ffee66f302f35294cda348665a9efe69b17b1c9f19a62bf579"}
Jul 09 01:40:06.710710 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.710435    2562 scope.go:117] "RemoveContainer" containerID="95779af833c08d95aae6fdd817cf3e7b7266e55177176526c9fd37e43b74dd2d"
Jul 09 01:40:06.711893 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.711707    2562 generic.go:356] "Generic (PLEG): container finished" podID="aae0f151-38a0-4091-87a4-8825d5968cb7" containerID="713bf0e488b48f0e294963f5c93f1d8c5791eb72e59f734b8b39869cf7ead690" exitCode=0
Jul 09 01:40:06.711893 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.711747    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-599658689f-nrqf2"
Jul 09 01:40:06.711893 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.711757    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-599658689f-nrqf2" event={"ID":"aae0f151-38a0-4091-87a4-8825d5968cb7","Type":"ContainerDied","Data":"713bf0e488b48f0e294963f5c93f1d8c5791eb72e59f734b8b39869cf7ead690"}
Jul 09 01:40:06.711893 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.711880    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-599658689f-nrqf2" event={"ID":"aae0f151-38a0-4091-87a4-8825d5968cb7","Type":"ContainerDied","Data":"afe1acbb3914684b7cf17f40352c7563beaa3d8fb9df236fc0e01444694da583"}
Jul 09 01:40:06.718502 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.718484    2562 scope.go:117] "RemoveContainer" containerID="5d5bbbb0535cb216e558a8a407d07421ec73ff5f80f93b775393f49e3e2a75bc"
Jul 09 01:40:06.725198 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.725182    2562 scope.go:117] "RemoveContainer" containerID="7e3692b83eb9d2897a3a56afd533e78dd201d2cb19b862f7b7e7eaa46e85189d"
Jul 09 01:40:06.731651 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.731631    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 01:40:06.737417 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.737394    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 01:40:06.738875 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.738859    2562 scope.go:117] "RemoveContainer" containerID="fe2d3897e342161a7c388ecfee3d11ad4da2b18624ae433913603cbebf829ab0"
Jul 09 01:40:06.747281 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.747261    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-599658689f-nrqf2"]
Jul 09 01:40:06.748082 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.748068    2562 scope.go:117] "RemoveContainer" containerID="1c7b8c86a85b8906ba4dd65e35f329139518e6ab229bd2d6f0f3dcd3d83a4a37"
Jul 09 01:40:06.750716 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.750697    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-599658689f-nrqf2"]
Jul 09 01:40:06.755620 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.755602    2562 scope.go:117] "RemoveContainer" containerID="3fc465d23d24fa0783f83b69d53c3c2e047acf0defdab8d5b624ec4c17254c3a"
Jul 09 01:40:06.761315 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.761298    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 01:40:06.761590 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.761579    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="prom-label-proxy"
Jul 09 01:40:06.761630 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.761592    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="prom-label-proxy"
Jul 09 01:40:06.761630 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.761604    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aae0f151-38a0-4091-87a4-8825d5968cb7" containerName="console"
Jul 09 01:40:06.761630 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.761609    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="aae0f151-38a0-4091-87a4-8825d5968cb7" containerName="console"
Jul 09 01:40:06.761630 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.761621    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="kube-rbac-proxy-web"
Jul 09 01:40:06.761630 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.761627    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="kube-rbac-proxy-web"
Jul 09 01:40:06.761764 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.761634    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="kube-rbac-proxy-metric"
Jul 09 01:40:06.761764 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.761640    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="kube-rbac-proxy-metric"
Jul 09 01:40:06.761764 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.761648    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="init-config-reloader"
Jul 09 01:40:06.761764 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.761653    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="init-config-reloader"
Jul 09 01:40:06.761764 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.761658    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="config-reloader"
Jul 09 01:40:06.761764 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.761663    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="config-reloader"
Jul 09 01:40:06.761764 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.761672    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="kube-rbac-proxy"
Jul 09 01:40:06.761764 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.761677    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="kube-rbac-proxy"
Jul 09 01:40:06.761764 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.761683    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="alertmanager"
Jul 09 01:40:06.761764 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.761688    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="alertmanager"
Jul 09 01:40:06.761764 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.761732    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="kube-rbac-proxy-metric"
Jul 09 01:40:06.761764 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.761739    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="aae0f151-38a0-4091-87a4-8825d5968cb7" containerName="console"
Jul 09 01:40:06.761764 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.761744    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="kube-rbac-proxy"
Jul 09 01:40:06.761764 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.761750    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="prom-label-proxy"
Jul 09 01:40:06.761764 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.761755    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="kube-rbac-proxy-web"
Jul 09 01:40:06.761764 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.761761    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="alertmanager"
Jul 09 01:40:06.761764 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.761767    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" containerName="config-reloader"
Jul 09 01:40:06.763109 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.763089    2562 scope.go:117] "RemoveContainer" containerID="61c8024b63ad942d051f048fdbe2539b437bf9c814c3c5f744081e500d84e466"
Jul 09 01:40:06.771431 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.770102    2562 scope.go:117] "RemoveContainer" containerID="713bf0e488b48f0e294963f5c93f1d8c5791eb72e59f734b8b39869cf7ead690"
Jul 09 01:40:06.777738 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.777424    2562 scope.go:117] "RemoveContainer" containerID="713bf0e488b48f0e294963f5c93f1d8c5791eb72e59f734b8b39869cf7ead690"
Jul 09 01:40:06.777789 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:40:06.777755    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"713bf0e488b48f0e294963f5c93f1d8c5791eb72e59f734b8b39869cf7ead690\": container with ID starting with 713bf0e488b48f0e294963f5c93f1d8c5791eb72e59f734b8b39869cf7ead690 not found: ID does not exist" containerID="713bf0e488b48f0e294963f5c93f1d8c5791eb72e59f734b8b39869cf7ead690"
Jul 09 01:40:06.777833 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.777779    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"713bf0e488b48f0e294963f5c93f1d8c5791eb72e59f734b8b39869cf7ead690"} err="failed to get container status \"713bf0e488b48f0e294963f5c93f1d8c5791eb72e59f734b8b39869cf7ead690\": rpc error: code = NotFound desc = could not find container \"713bf0e488b48f0e294963f5c93f1d8c5791eb72e59f734b8b39869cf7ead690\": container with ID starting with 713bf0e488b48f0e294963f5c93f1d8c5791eb72e59f734b8b39869cf7ead690 not found: ID does not exist"
Jul 09 01:40:06.785775 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.785755    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 01:40:06.785887 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.785876    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.788675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.788654    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 09 01:40:06.788795 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.788776    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 09 01:40:06.788924 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.788910    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 09 01:40:06.788996 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.788958    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 09 01:40:06.789223 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.789206    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nh6bw\""
Jul 09 01:40:06.789304 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.789287    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 09 01:40:06.789507 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.789487    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 09 01:40:06.789622 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.789534    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 09 01:40:06.789622 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.789534    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 09 01:40:06.796948 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.796925    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 09 01:40:06.822851 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.822826    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bb908ac5-6a99-4744-bb88-32883f6c2b77-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.822948 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.822862    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bb908ac5-6a99-4744-bb88-32883f6c2b77-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.822948 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.822879    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bb908ac5-6a99-4744-bb88-32883f6c2b77-config-volume\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.822948 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.822901    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb908ac5-6a99-4744-bb88-32883f6c2b77-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.822948 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.822935    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-624pg\" (UniqueName: \"kubernetes.io/projected/bb908ac5-6a99-4744-bb88-32883f6c2b77-kube-api-access-624pg\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.823119 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.822982    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bb908ac5-6a99-4744-bb88-32883f6c2b77-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.823119 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.823081    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bb908ac5-6a99-4744-bb88-32883f6c2b77-config-out\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.823119 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.823099    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bb908ac5-6a99-4744-bb88-32883f6c2b77-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.823119 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.823116    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bb908ac5-6a99-4744-bb88-32883f6c2b77-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.823293 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.823136    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb908ac5-6a99-4744-bb88-32883f6c2b77-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.823293 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.823191    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bb908ac5-6a99-4744-bb88-32883f6c2b77-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.823293 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.823208    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bb908ac5-6a99-4744-bb88-32883f6c2b77-web-config\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.823293 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.823237    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bb908ac5-6a99-4744-bb88-32883f6c2b77-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.923620 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.923592    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bb908ac5-6a99-4744-bb88-32883f6c2b77-config-out\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.923696 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.923624    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bb908ac5-6a99-4744-bb88-32883f6c2b77-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.923696 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.923641    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bb908ac5-6a99-4744-bb88-32883f6c2b77-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.923696 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.923658    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb908ac5-6a99-4744-bb88-32883f6c2b77-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.923696 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.923681    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bb908ac5-6a99-4744-bb88-32883f6c2b77-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.923896 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.923704    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bb908ac5-6a99-4744-bb88-32883f6c2b77-web-config\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.923896 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.923741    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bb908ac5-6a99-4744-bb88-32883f6c2b77-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.923896 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.923776    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bb908ac5-6a99-4744-bb88-32883f6c2b77-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.923896 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.923813    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bb908ac5-6a99-4744-bb88-32883f6c2b77-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.923896 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.923839    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bb908ac5-6a99-4744-bb88-32883f6c2b77-config-volume\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.923896 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.923864    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb908ac5-6a99-4744-bb88-32883f6c2b77-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.923896 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.923888    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-624pg\" (UniqueName: \"kubernetes.io/projected/bb908ac5-6a99-4744-bb88-32883f6c2b77-kube-api-access-624pg\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.924263 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.923925    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bb908ac5-6a99-4744-bb88-32883f6c2b77-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.924263 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.924129    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bb908ac5-6a99-4744-bb88-32883f6c2b77-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.925053 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.924844    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb908ac5-6a99-4744-bb88-32883f6c2b77-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.926398 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.926369    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bb908ac5-6a99-4744-bb88-32883f6c2b77-config-out\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.926611 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.926564    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bb908ac5-6a99-4744-bb88-32883f6c2b77-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.926720 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.926681    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bb908ac5-6a99-4744-bb88-32883f6c2b77-web-config\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.927168 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.926771    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bb908ac5-6a99-4744-bb88-32883f6c2b77-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.927168 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.927126    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bb908ac5-6a99-4744-bb88-32883f6c2b77-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.927308 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.927229    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bb908ac5-6a99-4744-bb88-32883f6c2b77-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.927308 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.927281    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bb908ac5-6a99-4744-bb88-32883f6c2b77-config-volume\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.927477 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.927459    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bb908ac5-6a99-4744-bb88-32883f6c2b77-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.927536 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.927487    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb908ac5-6a99-4744-bb88-32883f6c2b77-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.928549 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.928533    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bb908ac5-6a99-4744-bb88-32883f6c2b77-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:06.934838 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:06.934817    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-624pg\" (UniqueName: \"kubernetes.io/projected/bb908ac5-6a99-4744-bb88-32883f6c2b77-kube-api-access-624pg\") pod \"alertmanager-main-0\" (UID: \"bb908ac5-6a99-4744-bb88-32883f6c2b77\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:07.096723 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:07.096701    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 01:40:07.280926 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:07.280900    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 01:40:07.282716 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:40:07.282685    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb908ac5_6a99_4744_bb88_32883f6c2b77.slice/crio-097367810b0b7cf1bd88854bb812c2a9c4e9f5728d2a9feb9181355f79322bbf WatchSource:0}: Error finding container 097367810b0b7cf1bd88854bb812c2a9c4e9f5728d2a9feb9181355f79322bbf: Status 404 returned error can't find the container with id 097367810b0b7cf1bd88854bb812c2a9c4e9f5728d2a9feb9181355f79322bbf
Jul 09 01:40:07.582133 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:07.582107    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gkjkz"
Jul 09 01:40:07.717282 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:07.717208    2562 generic.go:356] "Generic (PLEG): container finished" podID="bb908ac5-6a99-4744-bb88-32883f6c2b77" containerID="2cf6281e058d9bb14fa9d60a451fd5f77b06007f4421b4091fa3a350229d54cc" exitCode=0
Jul 09 01:40:07.717675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:07.717296    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb908ac5-6a99-4744-bb88-32883f6c2b77","Type":"ContainerDied","Data":"2cf6281e058d9bb14fa9d60a451fd5f77b06007f4421b4091fa3a350229d54cc"}
Jul 09 01:40:07.717675 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:07.717386    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb908ac5-6a99-4744-bb88-32883f6c2b77","Type":"ContainerStarted","Data":"097367810b0b7cf1bd88854bb812c2a9c4e9f5728d2a9feb9181355f79322bbf"}
Jul 09 01:40:08.156905 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.156871    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0657f127-9741-4fc2-bf9c-cc319c05017c" path="/var/lib/kubelet/pods/0657f127-9741-4fc2-bf9c-cc319c05017c/volumes"
Jul 09 01:40:08.157548 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.157529    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aae0f151-38a0-4091-87a4-8825d5968cb7" path="/var/lib/kubelet/pods/aae0f151-38a0-4091-87a4-8825d5968cb7/volumes"
Jul 09 01:40:08.497865 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.497788    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 01:40:08.498219 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.498178    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="prometheus" containerID="cri-o://ddcc937eff92357dcb0ef13976c09b1833c33122eb49b41fbc0dfc0c8c9312e6" gracePeriod=600
Jul 09 01:40:08.498314 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.498249    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="kube-rbac-proxy" containerID="cri-o://387d4147ad17c3e30eaebf9c814f95872c9c96daccf0e56b49e5c6c198debb7e" gracePeriod=600
Jul 09 01:40:08.498314 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.498267    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="thanos-sidecar" containerID="cri-o://b39d93209ea95877c4eb48190ab8ad869c91f9e0a67529648b462cd7f0ad2f92" gracePeriod=600
Jul 09 01:40:08.498449 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.498353    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="config-reloader" containerID="cri-o://b003cd8fe2dbd7ea5260db0cb5fd88ff3283292fd3eedfd1dad2cc24ae5b623b" gracePeriod=600
Jul 09 01:40:08.498449 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.498374    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="kube-rbac-proxy-thanos" containerID="cri-o://ce2293a117f51b189b794abfba1ac76dc41509bc7336575c9d0b624b5e4803e2" gracePeriod=600
Jul 09 01:40:08.498449 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.498402    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="kube-rbac-proxy-web" containerID="cri-o://ea6963015d10dda476473cbc763fee2a500bb778293cd499026233fd33ff52e7" gracePeriod=600
Jul 09 01:40:08.726325 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.726290    2562 generic.go:356] "Generic (PLEG): container finished" podID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerID="ce2293a117f51b189b794abfba1ac76dc41509bc7336575c9d0b624b5e4803e2" exitCode=0
Jul 09 01:40:08.726325 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.726322    2562 generic.go:356] "Generic (PLEG): container finished" podID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerID="387d4147ad17c3e30eaebf9c814f95872c9c96daccf0e56b49e5c6c198debb7e" exitCode=0
Jul 09 01:40:08.726325 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.726330    2562 generic.go:356] "Generic (PLEG): container finished" podID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerID="ea6963015d10dda476473cbc763fee2a500bb778293cd499026233fd33ff52e7" exitCode=0
Jul 09 01:40:08.726840 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.726338    2562 generic.go:356] "Generic (PLEG): container finished" podID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerID="b39d93209ea95877c4eb48190ab8ad869c91f9e0a67529648b462cd7f0ad2f92" exitCode=0
Jul 09 01:40:08.726840 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.726346    2562 generic.go:356] "Generic (PLEG): container finished" podID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerID="b003cd8fe2dbd7ea5260db0cb5fd88ff3283292fd3eedfd1dad2cc24ae5b623b" exitCode=0
Jul 09 01:40:08.726840 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.726353    2562 generic.go:356] "Generic (PLEG): container finished" podID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerID="ddcc937eff92357dcb0ef13976c09b1833c33122eb49b41fbc0dfc0c8c9312e6" exitCode=0
Jul 09 01:40:08.726840 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.726358    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70","Type":"ContainerDied","Data":"ce2293a117f51b189b794abfba1ac76dc41509bc7336575c9d0b624b5e4803e2"}
Jul 09 01:40:08.726840 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.726484    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70","Type":"ContainerDied","Data":"387d4147ad17c3e30eaebf9c814f95872c9c96daccf0e56b49e5c6c198debb7e"}
Jul 09 01:40:08.726840 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.726528    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70","Type":"ContainerDied","Data":"ea6963015d10dda476473cbc763fee2a500bb778293cd499026233fd33ff52e7"}
Jul 09 01:40:08.726840 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.726568    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70","Type":"ContainerDied","Data":"b39d93209ea95877c4eb48190ab8ad869c91f9e0a67529648b462cd7f0ad2f92"}
Jul 09 01:40:08.726840 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.726608    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70","Type":"ContainerDied","Data":"b003cd8fe2dbd7ea5260db0cb5fd88ff3283292fd3eedfd1dad2cc24ae5b623b"}
Jul 09 01:40:08.726840 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.726649    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70","Type":"ContainerDied","Data":"ddcc937eff92357dcb0ef13976c09b1833c33122eb49b41fbc0dfc0c8c9312e6"}
Jul 09 01:40:08.730132 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.730108    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb908ac5-6a99-4744-bb88-32883f6c2b77","Type":"ContainerStarted","Data":"189c299265c75102c0afa842b569927f66c4817d26b1f6182124d64a7dddf117"}
Jul 09 01:40:08.730247 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.730169    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb908ac5-6a99-4744-bb88-32883f6c2b77","Type":"ContainerStarted","Data":"69f3df959568eacb485c04a476b5338f6d8d71a27144eaa3567246b274de8629"}
Jul 09 01:40:08.730247 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.730195    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb908ac5-6a99-4744-bb88-32883f6c2b77","Type":"ContainerStarted","Data":"0e56bbbc53cc0679e8b17a5ece5f169666317a52044c5997a25ea728f0b545e2"}
Jul 09 01:40:08.730247 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.730218    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb908ac5-6a99-4744-bb88-32883f6c2b77","Type":"ContainerStarted","Data":"80a38267b5d6a9792e7213dc96d9af4ffd40ebcd81506c308696d6b746295233"}
Jul 09 01:40:08.730247 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.730247    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb908ac5-6a99-4744-bb88-32883f6c2b77","Type":"ContainerStarted","Data":"c3a5ca224af6620b2b2660fbcb60d45095042cf8bc1f49f0a06c88f1d0d88e7e"}
Jul 09 01:40:08.730428 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.730275    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb908ac5-6a99-4744-bb88-32883f6c2b77","Type":"ContainerStarted","Data":"ef9176122f87eb51a239ba687549de9a8e6066ff68fcd9ae9e27bcdc91ae8261"}
Jul 09 01:40:08.756251 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.755956    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.742350083 podStartE2EDuration="2.755938665s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.588582ms" isStatefulPod=false podCreationTimestamp="2026-07-09 01:40:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:40:08.755472411 +0000 UTC m=+106.967124746" watchObservedRunningTime="2026-07-09 01:40:08.755938665 +0000 UTC m=+106.967591003"
Jul 09 01:40:08.756575 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.756552    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:08.839196 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.839170    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-config-out\") pod \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") "
Jul 09 01:40:08.839368 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.839220    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-grpc-tls\") pod \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") "
Jul 09 01:40:08.839368 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.839267    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-config\") pod \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") "
Jul 09 01:40:08.839368 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.839291    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") "
Jul 09 01:40:08.839559 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.839535    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") "
Jul 09 01:40:08.839618 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.839582    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-tls-assets\") pod \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") "
Jul 09 01:40:08.839618 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.839605    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dlsr\" (UniqueName: \"kubernetes.io/projected/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-kube-api-access-4dlsr\") pod \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") "
Jul 09 01:40:08.839722 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.839629    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-web-config\") pod \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") "
Jul 09 01:40:08.839722 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.839655    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-k8s-rulefiles-1\") pod \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") "
Jul 09 01:40:08.839722 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.839694    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-trusted-ca-bundle\") pod \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") "
Jul 09 01:40:08.839891 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.839719    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-thanos-prometheus-http-client-file\") pod \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") "
Jul 09 01:40:08.839891 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.839747    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-configmap-metrics-client-ca\") pod \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") "
Jul 09 01:40:08.839891 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.839785    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-metrics-client-certs\") pod \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") "
Jul 09 01:40:08.839891 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.839841    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-kube-rbac-proxy\") pod \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") "
Jul 09 01:40:08.839891 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.839867    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-configmap-kubelet-serving-ca-bundle\") pod \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") "
Jul 09 01:40:08.840165 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.839895    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-k8s-rulefiles-0\") pod \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") "
Jul 09 01:40:08.840165 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.839928    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-k8s-rulefiles-2\") pod \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") "
Jul 09 01:40:08.840165 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.839977    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-k8s-db\") pod \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") "
Jul 09 01:40:08.840165 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.840035    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-configmap-serving-certs-ca-bundle\") pod \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") "
Jul 09 01:40:08.840165 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.840070    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-prometheus-k8s-tls\") pod \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\" (UID: \"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70\") "
Jul 09 01:40:08.841456 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.841301    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" (UID: "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:40:08.841806 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.841757    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" (UID: "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:40:08.842284 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.841946    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" (UID: "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:40:08.842284 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.842107    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" (UID: "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:40:08.842284 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.842190    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" (UID: "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:40:08.842855 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.842757    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" (UID: "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:40:08.842855 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.842785    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" (UID: "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:40:08.842995 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.842874    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" (UID: "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:40:08.843068 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.843037    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" (UID: "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:40:08.843127 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.843068    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-config-out" (OuterVolumeSpecName: "config-out") pod "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" (UID: "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:40:08.843184 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.843163    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" (UID: "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:40:08.843252 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.843230    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" (UID: "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:40:08.844057 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.844004    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" (UID: "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:40:08.844156 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.844054    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-config" (OuterVolumeSpecName: "config") pod "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" (UID: "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:40:08.844367 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.844338    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" (UID: "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:40:08.844446 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.844400    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" (UID: "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:40:08.844622 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.844594    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" (UID: "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:40:08.845205 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.845181    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" (UID: "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:40:08.845429 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.845405    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-kube-api-access-4dlsr" (OuterVolumeSpecName: "kube-api-access-4dlsr") pod "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" (UID: "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70"). InnerVolumeSpecName "kube-api-access-4dlsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:40:08.854907 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.854884    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-web-config" (OuterVolumeSpecName: "web-config") pod "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" (UID: "ba6ff2b3-4a2c-412b-9a68-dea7da2acd70"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:40:08.941253 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.941228    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:08.941253 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.941250    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-tls-assets\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:08.941356 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.941260    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dlsr\" (UniqueName: \"kubernetes.io/projected/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-kube-api-access-4dlsr\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:08.941356 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.941269    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-web-config\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:08.941356 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.941277    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:08.941356 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.941285    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:08.941356 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.941294    2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:08.941356 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.941302    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-configmap-metrics-client-ca\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:08.941356 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.941310    2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-metrics-client-certs\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:08.941356 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.941318    2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-kube-rbac-proxy\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:08.941356 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.941326    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:08.941356 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.941333    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:08.941356 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.941340    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:08.941356 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.941348    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-prometheus-k8s-db\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:08.941356 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.941356    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:08.941704 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.941364    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:08.941704 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.941372    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-config-out\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:08.941704 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.941380    2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-grpc-tls\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:08.941704 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.941388    2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-config\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:08.941704 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:08.941395    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:09.739540 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.739467    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba6ff2b3-4a2c-412b-9a68-dea7da2acd70","Type":"ContainerDied","Data":"eb1819100ed9019960ed68371975f942e63723ffbdaf375413ac3ee7c4890c9f"}
Jul 09 01:40:09.739985 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.739546    2562 scope.go:117] "RemoveContainer" containerID="ce2293a117f51b189b794abfba1ac76dc41509bc7336575c9d0b624b5e4803e2"
Jul 09 01:40:09.739985 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.739478    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.747368 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.747145    2562 scope.go:117] "RemoveContainer" containerID="387d4147ad17c3e30eaebf9c814f95872c9c96daccf0e56b49e5c6c198debb7e"
Jul 09 01:40:09.754002 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.753986    2562 scope.go:117] "RemoveContainer" containerID="ea6963015d10dda476473cbc763fee2a500bb778293cd499026233fd33ff52e7"
Jul 09 01:40:09.760468 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.760447    2562 scope.go:117] "RemoveContainer" containerID="b39d93209ea95877c4eb48190ab8ad869c91f9e0a67529648b462cd7f0ad2f92"
Jul 09 01:40:09.767596 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.767226    2562 scope.go:117] "RemoveContainer" containerID="b003cd8fe2dbd7ea5260db0cb5fd88ff3283292fd3eedfd1dad2cc24ae5b623b"
Jul 09 01:40:09.768046 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.767953    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 01:40:09.772776 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.772754    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 01:40:09.774743 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.774729    2562 scope.go:117] "RemoveContainer" containerID="ddcc937eff92357dcb0ef13976c09b1833c33122eb49b41fbc0dfc0c8c9312e6"
Jul 09 01:40:09.781756 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.781741    2562 scope.go:117] "RemoveContainer" containerID="b9fdc92199929cab5829fd513b7be9d0b512280080bfdf74d662476618c21eb1"
Jul 09 01:40:09.801055 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.801031    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 01:40:09.801345 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.801333    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="kube-rbac-proxy-thanos"
Jul 09 01:40:09.801390 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.801348    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="kube-rbac-proxy-thanos"
Jul 09 01:40:09.801390 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.801359    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="thanos-sidecar"
Jul 09 01:40:09.801390 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.801365    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="thanos-sidecar"
Jul 09 01:40:09.801390 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.801372    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="kube-rbac-proxy"
Jul 09 01:40:09.801390 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.801377    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="kube-rbac-proxy"
Jul 09 01:40:09.801390 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.801384    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="init-config-reloader"
Jul 09 01:40:09.801390 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.801389    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="init-config-reloader"
Jul 09 01:40:09.801583 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.801395    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="config-reloader"
Jul 09 01:40:09.801583 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.801400    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="config-reloader"
Jul 09 01:40:09.801583 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.801413    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="kube-rbac-proxy-web"
Jul 09 01:40:09.801583 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.801418    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="kube-rbac-proxy-web"
Jul 09 01:40:09.801583 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.801429    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="prometheus"
Jul 09 01:40:09.801583 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.801434    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="prometheus"
Jul 09 01:40:09.801583 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.801484    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="kube-rbac-proxy-web"
Jul 09 01:40:09.801583 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.801492    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="prometheus"
Jul 09 01:40:09.801583 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.801497    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="config-reloader"
Jul 09 01:40:09.801583 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.801503    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="thanos-sidecar"
Jul 09 01:40:09.801583 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.801508    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="kube-rbac-proxy"
Jul 09 01:40:09.801583 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.801514    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" containerName="kube-rbac-proxy-thanos"
Jul 09 01:40:09.805303 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.805289    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.808567 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.808435    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 09 01:40:09.808567 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.808443    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 09 01:40:09.808567 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.808474    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 09 01:40:09.808567 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.808443    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 09 01:40:09.808888 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.808435    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 09 01:40:09.808888 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.808694    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-49cq6\""
Jul 09 01:40:09.808888 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.808752    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 09 01:40:09.808888 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.808835    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-l9a470a1fd22\""
Jul 09 01:40:09.809180 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.808975    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 09 01:40:09.809180 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.809040    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 09 01:40:09.809180 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.809118    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 09 01:40:09.809357 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.809188    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 09 01:40:09.809357 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.809322    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 09 01:40:09.810110 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.810094    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 09 01:40:09.814963 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.814938    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 09 01:40:09.816382 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.816359    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 09 01:40:09.824145 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.824126    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 01:40:09.849433 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.849410    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-web-config\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.849516 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.849440    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30742dc0-f132-40e7-a800-b685b9605b1d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.849516 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.849468    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/30742dc0-f132-40e7-a800-b685b9605b1d-config-out\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.849699 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.849679    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30742dc0-f132-40e7-a800-b685b9605b1d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.849800 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.849771    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/30742dc0-f132-40e7-a800-b685b9605b1d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.849906 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.849886    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/30742dc0-f132-40e7-a800-b685b9605b1d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.849986 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.849933    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.849986 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.849966    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/30742dc0-f132-40e7-a800-b685b9605b1d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.850113 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.850043    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30742dc0-f132-40e7-a800-b685b9605b1d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.850113 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.850088    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.850237 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.850124    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/30742dc0-f132-40e7-a800-b685b9605b1d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.850237 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.850149    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.850237 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.850187    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.850450 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.850235    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30742dc0-f132-40e7-a800-b685b9605b1d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.850450 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.850315    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-config\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.850450 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.850360    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.850450 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.850382    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqtmk\" (UniqueName: \"kubernetes.io/projected/30742dc0-f132-40e7-a800-b685b9605b1d-kube-api-access-nqtmk\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.850712 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.850450    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.850712 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.850474    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/30742dc0-f132-40e7-a800-b685b9605b1d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.850712 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.850508    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.950930 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.950909    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-config\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.951053 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.950948    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.951053 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.950971    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqtmk\" (UniqueName: \"kubernetes.io/projected/30742dc0-f132-40e7-a800-b685b9605b1d-kube-api-access-nqtmk\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.951053 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.951006    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.951053 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.951051    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/30742dc0-f132-40e7-a800-b685b9605b1d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.951262 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.951082    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.951262 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.951115    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-web-config\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.951262 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.951142    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30742dc0-f132-40e7-a800-b685b9605b1d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.951262 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.951168    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/30742dc0-f132-40e7-a800-b685b9605b1d-config-out\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.951262 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.951196    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30742dc0-f132-40e7-a800-b685b9605b1d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.951262 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.951221    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/30742dc0-f132-40e7-a800-b685b9605b1d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.951262 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.951259    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/30742dc0-f132-40e7-a800-b685b9605b1d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.951579 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.951282    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.951579 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.951312    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/30742dc0-f132-40e7-a800-b685b9605b1d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.951579 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.951339    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30742dc0-f132-40e7-a800-b685b9605b1d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.951579 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.951368    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.951579 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.951393    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/30742dc0-f132-40e7-a800-b685b9605b1d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.951579 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.951421    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.951579 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.951445    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.951579 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.951446    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/30742dc0-f132-40e7-a800-b685b9605b1d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.951579 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.951469    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30742dc0-f132-40e7-a800-b685b9605b1d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.952045 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.951834    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30742dc0-f132-40e7-a800-b685b9605b1d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.952045 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.951928    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/30742dc0-f132-40e7-a800-b685b9605b1d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.953171 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.952201    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30742dc0-f132-40e7-a800-b685b9605b1d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.953171 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.952855    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30742dc0-f132-40e7-a800-b685b9605b1d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.954184 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.953985    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.954184 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.954073    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.954184 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.954089    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-config\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.954184 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.954174    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.954778 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.954492    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/30742dc0-f132-40e7-a800-b685b9605b1d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.954778 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.954594    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/30742dc0-f132-40e7-a800-b685b9605b1d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.955482 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.955453    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.955645 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.955622    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30742dc0-f132-40e7-a800-b685b9605b1d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.955714 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.955678    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/30742dc0-f132-40e7-a800-b685b9605b1d-config-out\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.955923 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.955901    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/30742dc0-f132-40e7-a800-b685b9605b1d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.956509 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.956484    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.956583 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.956568    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-web-config\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.956841 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.956824    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.957616 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.957596    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/30742dc0-f132-40e7-a800-b685b9605b1d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:09.959085 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:09.959065    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqtmk\" (UniqueName: \"kubernetes.io/projected/30742dc0-f132-40e7-a800-b685b9605b1d-kube-api-access-nqtmk\") pod \"prometheus-k8s-0\" (UID: \"30742dc0-f132-40e7-a800-b685b9605b1d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:10.121100 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:10.121071    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:10.157085 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:10.157061    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba6ff2b3-4a2c-412b-9a68-dea7da2acd70" path="/var/lib/kubelet/pods/ba6ff2b3-4a2c-412b-9a68-dea7da2acd70/volumes"
Jul 09 01:40:10.249818 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:10.249744    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 01:40:10.253349 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:40:10.253322    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30742dc0_f132_40e7_a800_b685b9605b1d.slice/crio-f1e8e03963563c4742d0e10fb602706af2c2b6006d152c7f6b7abe367adcf0de WatchSource:0}: Error finding container f1e8e03963563c4742d0e10fb602706af2c2b6006d152c7f6b7abe367adcf0de: Status 404 returned error can't find the container with id f1e8e03963563c4742d0e10fb602706af2c2b6006d152c7f6b7abe367adcf0de
Jul 09 01:40:10.746734 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:10.746706    2562 generic.go:356] "Generic (PLEG): container finished" podID="30742dc0-f132-40e7-a800-b685b9605b1d" containerID="8a762b44eb7a9360771a5d4227e1608862fab3099d3846a9541e64194742d8dd" exitCode=0
Jul 09 01:40:10.747079 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:10.746779    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30742dc0-f132-40e7-a800-b685b9605b1d","Type":"ContainerDied","Data":"8a762b44eb7a9360771a5d4227e1608862fab3099d3846a9541e64194742d8dd"}
Jul 09 01:40:10.747079 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:10.746832    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30742dc0-f132-40e7-a800-b685b9605b1d","Type":"ContainerStarted","Data":"f1e8e03963563c4742d0e10fb602706af2c2b6006d152c7f6b7abe367adcf0de"}
Jul 09 01:40:11.649411 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:11.649378    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-db8769489-fmvq8"]
Jul 09 01:40:11.754300 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:11.754264    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30742dc0-f132-40e7-a800-b685b9605b1d","Type":"ContainerStarted","Data":"5bf67120ec88754bc6fb2e6856e3ef9f733d2c6723ff0778553fcd9f4878e509"}
Jul 09 01:40:11.754618 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:11.754343    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30742dc0-f132-40e7-a800-b685b9605b1d","Type":"ContainerStarted","Data":"8e3bd0ca4a10f14fbfb98f127d5ceab110f0ef7a7c057e2f46d40f540dc80b13"}
Jul 09 01:40:11.754618 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:11.754385    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30742dc0-f132-40e7-a800-b685b9605b1d","Type":"ContainerStarted","Data":"7500592a6705ffbf640f17fe19766059cc5ee9e53c3b4eb6bc43cf0f41bb763c"}
Jul 09 01:40:11.754618 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:11.754420    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30742dc0-f132-40e7-a800-b685b9605b1d","Type":"ContainerStarted","Data":"71cad23558dd0ed4573beeb98711114ff56870c498cf9d2c9df197f54f734034"}
Jul 09 01:40:11.754618 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:11.754454    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30742dc0-f132-40e7-a800-b685b9605b1d","Type":"ContainerStarted","Data":"52f5598163f3866e1d79d12a2f3096f9cd87d30eee47e5650064acf64c2a0063"}
Jul 09 01:40:11.754618 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:11.754490    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30742dc0-f132-40e7-a800-b685b9605b1d","Type":"ContainerStarted","Data":"2d15e34444c991fbe55bb482ceed3e9b7d3f6073c049d7137be13f563ef525b1"}
Jul 09 01:40:11.785481 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:11.785434    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.767181522 podStartE2EDuration="2.785419272s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.23775ms" isStatefulPod=false podCreationTimestamp="2026-07-09 01:40:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:40:11.782618415 +0000 UTC m=+109.994270757" watchObservedRunningTime="2026-07-09 01:40:11.785419272 +0000 UTC m=+109.997071608"
Jul 09 01:40:15.121765 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:15.121736    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:40:36.669278 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:36.669239    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-db8769489-fmvq8" podUID="211078c1-aa83-4e9e-9297-f70af758d22d" containerName="console" containerID="cri-o://a0fa7da0da8b40c3f2ba78ca85eb41edcfe0330fd9fa84dd1e70c8d1964d0eb9" gracePeriod=15
Jul 09 01:40:36.858368 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:36.858342    2562 generic.go:356] "Generic (PLEG): container finished" podID="211078c1-aa83-4e9e-9297-f70af758d22d" containerID="a0fa7da0da8b40c3f2ba78ca85eb41edcfe0330fd9fa84dd1e70c8d1964d0eb9" exitCode=0
Jul 09 01:40:36.858472 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:36.858415    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db8769489-fmvq8" event={"ID":"211078c1-aa83-4e9e-9297-f70af758d22d","Type":"ContainerDied","Data":"a0fa7da0da8b40c3f2ba78ca85eb41edcfe0330fd9fa84dd1e70c8d1964d0eb9"}
Jul 09 01:40:36.916201 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:36.916177    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:40:37.053180 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.053123    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/211078c1-aa83-4e9e-9297-f70af758d22d-console-serving-cert\") pod \"211078c1-aa83-4e9e-9297-f70af758d22d\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") "
Jul 09 01:40:37.053180 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.053157    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/211078c1-aa83-4e9e-9297-f70af758d22d-oauth-serving-cert\") pod \"211078c1-aa83-4e9e-9297-f70af758d22d\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") "
Jul 09 01:40:37.053180 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.053175    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbp7t\" (UniqueName: \"kubernetes.io/projected/211078c1-aa83-4e9e-9297-f70af758d22d-kube-api-access-jbp7t\") pod \"211078c1-aa83-4e9e-9297-f70af758d22d\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") "
Jul 09 01:40:37.053392 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.053196    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/211078c1-aa83-4e9e-9297-f70af758d22d-trusted-ca-bundle\") pod \"211078c1-aa83-4e9e-9297-f70af758d22d\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") "
Jul 09 01:40:37.053392 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.053222    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/211078c1-aa83-4e9e-9297-f70af758d22d-console-oauth-config\") pod \"211078c1-aa83-4e9e-9297-f70af758d22d\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") "
Jul 09 01:40:37.053392 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.053347    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/211078c1-aa83-4e9e-9297-f70af758d22d-service-ca\") pod \"211078c1-aa83-4e9e-9297-f70af758d22d\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") "
Jul 09 01:40:37.053550 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.053396    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/211078c1-aa83-4e9e-9297-f70af758d22d-console-config\") pod \"211078c1-aa83-4e9e-9297-f70af758d22d\" (UID: \"211078c1-aa83-4e9e-9297-f70af758d22d\") "
Jul 09 01:40:37.053663 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.053624    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/211078c1-aa83-4e9e-9297-f70af758d22d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "211078c1-aa83-4e9e-9297-f70af758d22d" (UID: "211078c1-aa83-4e9e-9297-f70af758d22d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:40:37.053799 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.053752    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/211078c1-aa83-4e9e-9297-f70af758d22d-service-ca" (OuterVolumeSpecName: "service-ca") pod "211078c1-aa83-4e9e-9297-f70af758d22d" (UID: "211078c1-aa83-4e9e-9297-f70af758d22d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:40:37.053857 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.053812    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/211078c1-aa83-4e9e-9297-f70af758d22d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "211078c1-aa83-4e9e-9297-f70af758d22d" (UID: "211078c1-aa83-4e9e-9297-f70af758d22d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:40:37.053904 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.053861    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/211078c1-aa83-4e9e-9297-f70af758d22d-console-config" (OuterVolumeSpecName: "console-config") pod "211078c1-aa83-4e9e-9297-f70af758d22d" (UID: "211078c1-aa83-4e9e-9297-f70af758d22d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:40:37.055304 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.055281    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/211078c1-aa83-4e9e-9297-f70af758d22d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "211078c1-aa83-4e9e-9297-f70af758d22d" (UID: "211078c1-aa83-4e9e-9297-f70af758d22d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:40:37.055396 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.055364    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/211078c1-aa83-4e9e-9297-f70af758d22d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "211078c1-aa83-4e9e-9297-f70af758d22d" (UID: "211078c1-aa83-4e9e-9297-f70af758d22d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:40:37.055396 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.055371    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/211078c1-aa83-4e9e-9297-f70af758d22d-kube-api-access-jbp7t" (OuterVolumeSpecName: "kube-api-access-jbp7t") pod "211078c1-aa83-4e9e-9297-f70af758d22d" (UID: "211078c1-aa83-4e9e-9297-f70af758d22d"). InnerVolumeSpecName "kube-api-access-jbp7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:40:37.154030 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.153997    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/211078c1-aa83-4e9e-9297-f70af758d22d-console-serving-cert\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:37.154030 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.154030    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/211078c1-aa83-4e9e-9297-f70af758d22d-oauth-serving-cert\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:37.154142 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.154040    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbp7t\" (UniqueName: \"kubernetes.io/projected/211078c1-aa83-4e9e-9297-f70af758d22d-kube-api-access-jbp7t\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:37.154142 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.154060    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/211078c1-aa83-4e9e-9297-f70af758d22d-trusted-ca-bundle\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:37.154142 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.154069    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/211078c1-aa83-4e9e-9297-f70af758d22d-console-oauth-config\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:37.154142 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.154077    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/211078c1-aa83-4e9e-9297-f70af758d22d-service-ca\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:37.154142 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.154086    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/211078c1-aa83-4e9e-9297-f70af758d22d-console-config\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:40:37.864493 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.864467    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db8769489-fmvq8"
Jul 09 01:40:37.864493 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.864474    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db8769489-fmvq8" event={"ID":"211078c1-aa83-4e9e-9297-f70af758d22d","Type":"ContainerDied","Data":"9796bcfced3f18daf041fd46ff5f0415b8b3ca4d707315687e21aa65694a3d82"}
Jul 09 01:40:37.864963 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.864533    2562 scope.go:117] "RemoveContainer" containerID="a0fa7da0da8b40c3f2ba78ca85eb41edcfe0330fd9fa84dd1e70c8d1964d0eb9"
Jul 09 01:40:37.885962 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.885936    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-db8769489-fmvq8"]
Jul 09 01:40:37.889891 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:37.889872    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-db8769489-fmvq8"]
Jul 09 01:40:38.157436 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:40:38.157378    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="211078c1-aa83-4e9e-9297-f70af758d22d" path="/var/lib/kubelet/pods/211078c1-aa83-4e9e-9297-f70af758d22d/volumes"
Jul 09 01:41:10.121337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:10.121303    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:41:10.136309 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:10.136289    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:41:11.011469 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:11.011443    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 01:41:37.030391 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:37.030355    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-6s79x"]
Jul 09 01:41:37.031039 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:37.030720    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="211078c1-aa83-4e9e-9297-f70af758d22d" containerName="console"
Jul 09 01:41:37.031039 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:37.030732    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="211078c1-aa83-4e9e-9297-f70af758d22d" containerName="console"
Jul 09 01:41:37.031039 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:37.030788    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="211078c1-aa83-4e9e-9297-f70af758d22d" containerName="console"
Jul 09 01:41:37.033149 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:37.033133    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6s79x"
Jul 09 01:41:37.037219 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:37.037200    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 01:41:37.037336 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:37.037251    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-dvxcv\""
Jul 09 01:41:37.038475 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:37.038445    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 01:41:37.042514 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:37.042492    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-6s79x"]
Jul 09 01:41:37.093970 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:37.093941    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sfbj\" (UniqueName: \"kubernetes.io/projected/7d6c00de-40af-4b57-b8cc-0cd81cf4345f-kube-api-access-6sfbj\") pod \"cert-manager-cainjector-559cdd8c87-6s79x\" (UID: \"7d6c00de-40af-4b57-b8cc-0cd81cf4345f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6s79x"
Jul 09 01:41:37.094100 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:37.093993    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d6c00de-40af-4b57-b8cc-0cd81cf4345f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-6s79x\" (UID: \"7d6c00de-40af-4b57-b8cc-0cd81cf4345f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6s79x"
Jul 09 01:41:37.194770 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:37.194746    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sfbj\" (UniqueName: \"kubernetes.io/projected/7d6c00de-40af-4b57-b8cc-0cd81cf4345f-kube-api-access-6sfbj\") pod \"cert-manager-cainjector-559cdd8c87-6s79x\" (UID: \"7d6c00de-40af-4b57-b8cc-0cd81cf4345f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6s79x"
Jul 09 01:41:37.194858 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:37.194792    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d6c00de-40af-4b57-b8cc-0cd81cf4345f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-6s79x\" (UID: \"7d6c00de-40af-4b57-b8cc-0cd81cf4345f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6s79x"
Jul 09 01:41:37.203382 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:37.203358    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d6c00de-40af-4b57-b8cc-0cd81cf4345f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-6s79x\" (UID: \"7d6c00de-40af-4b57-b8cc-0cd81cf4345f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6s79x"
Jul 09 01:41:37.203550 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:37.203524    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sfbj\" (UniqueName: \"kubernetes.io/projected/7d6c00de-40af-4b57-b8cc-0cd81cf4345f-kube-api-access-6sfbj\") pod \"cert-manager-cainjector-559cdd8c87-6s79x\" (UID: \"7d6c00de-40af-4b57-b8cc-0cd81cf4345f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6s79x"
Jul 09 01:41:37.353154 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:37.353134    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6s79x"
Jul 09 01:41:37.474940 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:37.474913    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-6s79x"]
Jul 09 01:41:37.477382 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:41:37.477359    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d6c00de_40af_4b57_b8cc_0cd81cf4345f.slice/crio-96d9d9826f58350dd672d397330f94ed4d014079eccb16a9f5822bf0405cfebf WatchSource:0}: Error finding container 96d9d9826f58350dd672d397330f94ed4d014079eccb16a9f5822bf0405cfebf: Status 404 returned error can't find the container with id 96d9d9826f58350dd672d397330f94ed4d014079eccb16a9f5822bf0405cfebf
Jul 09 01:41:38.101393 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:38.101357    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6s79x" event={"ID":"7d6c00de-40af-4b57-b8cc-0cd81cf4345f","Type":"ContainerStarted","Data":"96d9d9826f58350dd672d397330f94ed4d014079eccb16a9f5822bf0405cfebf"}
Jul 09 01:41:41.116396 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:41.116359    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6s79x" event={"ID":"7d6c00de-40af-4b57-b8cc-0cd81cf4345f","Type":"ContainerStarted","Data":"e8e3dee5db430527a04bbd1680e9cb6b15279585cddc04cc2c17538b8f77ba1c"}
Jul 09 01:41:41.135293 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:41.135248    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6s79x" podStartSLOduration=0.945742636 podStartE2EDuration="4.135234927s" totalImagesPullingTime="3.189492291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:41:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:41:41.132682799 +0000 UTC m=+199.344335135" watchObservedRunningTime="2026-07-09 01:41:41.135234927 +0000 UTC m=+199.346887260"
Jul 09 01:41:49.434385 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:49.434335    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-998xb"]
Jul 09 01:41:49.437437 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:49.437422    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-998xb"
Jul 09 01:41:49.440274 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:49.440253    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-p6wms\""
Jul 09 01:41:49.446988 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:49.446965    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-998xb"]
Jul 09 01:41:49.599307 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:49.599270    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fvc6\" (UniqueName: \"kubernetes.io/projected/d613166a-2d57-4dde-a2b3-0a3a7cd0b8c4-kube-api-access-9fvc6\") pod \"cert-manager-55b4d954d5-998xb\" (UID: \"d613166a-2d57-4dde-a2b3-0a3a7cd0b8c4\") " pod="cert-manager/cert-manager-55b4d954d5-998xb"
Jul 09 01:41:49.599472 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:49.599324    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d613166a-2d57-4dde-a2b3-0a3a7cd0b8c4-bound-sa-token\") pod \"cert-manager-55b4d954d5-998xb\" (UID: \"d613166a-2d57-4dde-a2b3-0a3a7cd0b8c4\") " pod="cert-manager/cert-manager-55b4d954d5-998xb"
Jul 09 01:41:49.700733 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:49.700657    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fvc6\" (UniqueName: \"kubernetes.io/projected/d613166a-2d57-4dde-a2b3-0a3a7cd0b8c4-kube-api-access-9fvc6\") pod \"cert-manager-55b4d954d5-998xb\" (UID: \"d613166a-2d57-4dde-a2b3-0a3a7cd0b8c4\") " pod="cert-manager/cert-manager-55b4d954d5-998xb"
Jul 09 01:41:49.700733 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:49.700705    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d613166a-2d57-4dde-a2b3-0a3a7cd0b8c4-bound-sa-token\") pod \"cert-manager-55b4d954d5-998xb\" (UID: \"d613166a-2d57-4dde-a2b3-0a3a7cd0b8c4\") " pod="cert-manager/cert-manager-55b4d954d5-998xb"
Jul 09 01:41:49.708903 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:49.708872    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d613166a-2d57-4dde-a2b3-0a3a7cd0b8c4-bound-sa-token\") pod \"cert-manager-55b4d954d5-998xb\" (UID: \"d613166a-2d57-4dde-a2b3-0a3a7cd0b8c4\") " pod="cert-manager/cert-manager-55b4d954d5-998xb"
Jul 09 01:41:49.709077 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:49.709059    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fvc6\" (UniqueName: \"kubernetes.io/projected/d613166a-2d57-4dde-a2b3-0a3a7cd0b8c4-kube-api-access-9fvc6\") pod \"cert-manager-55b4d954d5-998xb\" (UID: \"d613166a-2d57-4dde-a2b3-0a3a7cd0b8c4\") " pod="cert-manager/cert-manager-55b4d954d5-998xb"
Jul 09 01:41:49.746672 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:49.746644    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-998xb"
Jul 09 01:41:49.887241 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:49.887096    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-998xb"]
Jul 09 01:41:49.889911 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:41:49.889883    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd613166a_2d57_4dde_a2b3_0a3a7cd0b8c4.slice/crio-0392d985536554e02e6f140f0af360cb60024b19c08339e80a94f01bdcc9bba2 WatchSource:0}: Error finding container 0392d985536554e02e6f140f0af360cb60024b19c08339e80a94f01bdcc9bba2: Status 404 returned error can't find the container with id 0392d985536554e02e6f140f0af360cb60024b19c08339e80a94f01bdcc9bba2
Jul 09 01:41:50.160325 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:50.160290    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-998xb" event={"ID":"d613166a-2d57-4dde-a2b3-0a3a7cd0b8c4","Type":"ContainerStarted","Data":"fcf3e3566c7b12ec4a75026bfdc13f2104b217738eb792cde2610d19f458cd10"}
Jul 09 01:41:50.160325 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:50.160328    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-998xb" event={"ID":"d613166a-2d57-4dde-a2b3-0a3a7cd0b8c4","Type":"ContainerStarted","Data":"0392d985536554e02e6f140f0af360cb60024b19c08339e80a94f01bdcc9bba2"}
Jul 09 01:41:50.170070 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:41:50.170010    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-998xb" podStartSLOduration=1.169996193 podStartE2EDuration="1.169996193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:41:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:41:50.169212033 +0000 UTC m=+208.380864380" watchObservedRunningTime="2026-07-09 01:41:50.169996193 +0000 UTC m=+208.381648527"
Jul 09 01:42:09.049858 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:09.049786    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6489dc67d-7dl45"]
Jul 09 01:42:09.053158 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:09.053141    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6489dc67d-7dl45"
Jul 09 01:42:09.056533 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:09.056515    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 09 01:42:09.057747 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:09.057725    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 09 01:42:09.057837 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:09.057789    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 09 01:42:09.057893 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:09.057842    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 01:42:09.057893 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:09.057792    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wbqgm\""
Jul 09 01:42:09.057997 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:09.057937    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 01:42:09.058737 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:09.058720    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d15fe60a-5950-4aa5-9612-a7f4376e2d47-cert\") pod \"lws-controller-manager-6489dc67d-7dl45\" (UID: \"d15fe60a-5950-4aa5-9612-a7f4376e2d47\") " pod="openshift-lws-operator/lws-controller-manager-6489dc67d-7dl45"
Jul 09 01:42:09.058823 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:09.058766    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d15fe60a-5950-4aa5-9612-a7f4376e2d47-manager-config\") pod \"lws-controller-manager-6489dc67d-7dl45\" (UID: \"d15fe60a-5950-4aa5-9612-a7f4376e2d47\") " pod="openshift-lws-operator/lws-controller-manager-6489dc67d-7dl45"
Jul 09 01:42:09.058823 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:09.058793    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d15fe60a-5950-4aa5-9612-a7f4376e2d47-metrics-cert\") pod \"lws-controller-manager-6489dc67d-7dl45\" (UID: \"d15fe60a-5950-4aa5-9612-a7f4376e2d47\") " pod="openshift-lws-operator/lws-controller-manager-6489dc67d-7dl45"
Jul 09 01:42:09.058985 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:09.058875    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82mqm\" (UniqueName: \"kubernetes.io/projected/d15fe60a-5950-4aa5-9612-a7f4376e2d47-kube-api-access-82mqm\") pod \"lws-controller-manager-6489dc67d-7dl45\" (UID: \"d15fe60a-5950-4aa5-9612-a7f4376e2d47\") " pod="openshift-lws-operator/lws-controller-manager-6489dc67d-7dl45"
Jul 09 01:42:09.064622 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:09.064600    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6489dc67d-7dl45"]
Jul 09 01:42:09.159555 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:09.159522    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82mqm\" (UniqueName: \"kubernetes.io/projected/d15fe60a-5950-4aa5-9612-a7f4376e2d47-kube-api-access-82mqm\") pod \"lws-controller-manager-6489dc67d-7dl45\" (UID: \"d15fe60a-5950-4aa5-9612-a7f4376e2d47\") " pod="openshift-lws-operator/lws-controller-manager-6489dc67d-7dl45"
Jul 09 01:42:09.159771 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:09.159688    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d15fe60a-5950-4aa5-9612-a7f4376e2d47-cert\") pod \"lws-controller-manager-6489dc67d-7dl45\" (UID: \"d15fe60a-5950-4aa5-9612-a7f4376e2d47\") " pod="openshift-lws-operator/lws-controller-manager-6489dc67d-7dl45"
Jul 09 01:42:09.159771 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:09.159751    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d15fe60a-5950-4aa5-9612-a7f4376e2d47-manager-config\") pod \"lws-controller-manager-6489dc67d-7dl45\" (UID: \"d15fe60a-5950-4aa5-9612-a7f4376e2d47\") " pod="openshift-lws-operator/lws-controller-manager-6489dc67d-7dl45"
Jul 09 01:42:09.159913 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:09.159778    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d15fe60a-5950-4aa5-9612-a7f4376e2d47-metrics-cert\") pod \"lws-controller-manager-6489dc67d-7dl45\" (UID: \"d15fe60a-5950-4aa5-9612-a7f4376e2d47\") " pod="openshift-lws-operator/lws-controller-manager-6489dc67d-7dl45"
Jul 09 01:42:09.160453 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:09.160431    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d15fe60a-5950-4aa5-9612-a7f4376e2d47-manager-config\") pod \"lws-controller-manager-6489dc67d-7dl45\" (UID: \"d15fe60a-5950-4aa5-9612-a7f4376e2d47\") " pod="openshift-lws-operator/lws-controller-manager-6489dc67d-7dl45"
Jul 09 01:42:09.162196 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:09.162177    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d15fe60a-5950-4aa5-9612-a7f4376e2d47-metrics-cert\") pod \"lws-controller-manager-6489dc67d-7dl45\" (UID: \"d15fe60a-5950-4aa5-9612-a7f4376e2d47\") " pod="openshift-lws-operator/lws-controller-manager-6489dc67d-7dl45"
Jul 09 01:42:09.162279 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:09.162200    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d15fe60a-5950-4aa5-9612-a7f4376e2d47-cert\") pod \"lws-controller-manager-6489dc67d-7dl45\" (UID: \"d15fe60a-5950-4aa5-9612-a7f4376e2d47\") " pod="openshift-lws-operator/lws-controller-manager-6489dc67d-7dl45"
Jul 09 01:42:09.173334 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:09.173317    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82mqm\" (UniqueName: \"kubernetes.io/projected/d15fe60a-5950-4aa5-9612-a7f4376e2d47-kube-api-access-82mqm\") pod \"lws-controller-manager-6489dc67d-7dl45\" (UID: \"d15fe60a-5950-4aa5-9612-a7f4376e2d47\") " pod="openshift-lws-operator/lws-controller-manager-6489dc67d-7dl45"
Jul 09 01:42:09.362795 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:09.362766    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6489dc67d-7dl45"
Jul 09 01:42:09.520228 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:09.520199    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6489dc67d-7dl45"]
Jul 09 01:42:09.523031 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:42:09.522994    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd15fe60a_5950_4aa5_9612_a7f4376e2d47.slice/crio-88195106d72c7c8ea56aa38aca0429377aac84f38e27a64e8709d12172892009 WatchSource:0}: Error finding container 88195106d72c7c8ea56aa38aca0429377aac84f38e27a64e8709d12172892009: Status 404 returned error can't find the container with id 88195106d72c7c8ea56aa38aca0429377aac84f38e27a64e8709d12172892009
Jul 09 01:42:10.241561 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.241521    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6489dc67d-7dl45" event={"ID":"d15fe60a-5950-4aa5-9612-a7f4376e2d47","Type":"ContainerStarted","Data":"88195106d72c7c8ea56aa38aca0429377aac84f38e27a64e8709d12172892009"}
Jul 09 01:42:10.492819 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.492742    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk"]
Jul 09 01:42:10.497049 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.497009    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk"
Jul 09 01:42:10.503748 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.503443    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 01:42:10.503829 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.503792    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 01:42:10.504085 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.504059    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jb862\""
Jul 09 01:42:10.504176 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.504088    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 01:42:10.504176 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.504147    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 01:42:10.521169 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.521145    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk"]
Jul 09 01:42:10.574739 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.574707    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/44379a51-ccfd-47f1-97e5-e69b25aa5a74-manifests\") pod \"opendatahub-operator-controller-manager-b4b98c894-zkllk\" (UID: \"44379a51-ccfd-47f1-97e5-e69b25aa5a74\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk"
Jul 09 01:42:10.574867 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.574749    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44379a51-ccfd-47f1-97e5-e69b25aa5a74-tmp\") pod \"opendatahub-operator-controller-manager-b4b98c894-zkllk\" (UID: \"44379a51-ccfd-47f1-97e5-e69b25aa5a74\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk"
Jul 09 01:42:10.574867 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.574811    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44379a51-ccfd-47f1-97e5-e69b25aa5a74-webhook-cert\") pod \"opendatahub-operator-controller-manager-b4b98c894-zkllk\" (UID: \"44379a51-ccfd-47f1-97e5-e69b25aa5a74\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk"
Jul 09 01:42:10.574867 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.574849    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/44379a51-ccfd-47f1-97e5-e69b25aa5a74-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b4b98c894-zkllk\" (UID: \"44379a51-ccfd-47f1-97e5-e69b25aa5a74\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk"
Jul 09 01:42:10.574967 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.574884    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vwnw\" (UniqueName: \"kubernetes.io/projected/44379a51-ccfd-47f1-97e5-e69b25aa5a74-kube-api-access-7vwnw\") pod \"opendatahub-operator-controller-manager-b4b98c894-zkllk\" (UID: \"44379a51-ccfd-47f1-97e5-e69b25aa5a74\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk"
Jul 09 01:42:10.676120 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.676073    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vwnw\" (UniqueName: \"kubernetes.io/projected/44379a51-ccfd-47f1-97e5-e69b25aa5a74-kube-api-access-7vwnw\") pod \"opendatahub-operator-controller-manager-b4b98c894-zkllk\" (UID: \"44379a51-ccfd-47f1-97e5-e69b25aa5a74\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk"
Jul 09 01:42:10.676328 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.676162    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/44379a51-ccfd-47f1-97e5-e69b25aa5a74-manifests\") pod \"opendatahub-operator-controller-manager-b4b98c894-zkllk\" (UID: \"44379a51-ccfd-47f1-97e5-e69b25aa5a74\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk"
Jul 09 01:42:10.676328 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.676193    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44379a51-ccfd-47f1-97e5-e69b25aa5a74-tmp\") pod \"opendatahub-operator-controller-manager-b4b98c894-zkllk\" (UID: \"44379a51-ccfd-47f1-97e5-e69b25aa5a74\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk"
Jul 09 01:42:10.676328 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.676229    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44379a51-ccfd-47f1-97e5-e69b25aa5a74-webhook-cert\") pod \"opendatahub-operator-controller-manager-b4b98c894-zkllk\" (UID: \"44379a51-ccfd-47f1-97e5-e69b25aa5a74\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk"
Jul 09 01:42:10.676328 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.676247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/44379a51-ccfd-47f1-97e5-e69b25aa5a74-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b4b98c894-zkllk\" (UID: \"44379a51-ccfd-47f1-97e5-e69b25aa5a74\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk"
Jul 09 01:42:10.676600 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.676581    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/44379a51-ccfd-47f1-97e5-e69b25aa5a74-manifests\") pod \"opendatahub-operator-controller-manager-b4b98c894-zkllk\" (UID: \"44379a51-ccfd-47f1-97e5-e69b25aa5a74\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk"
Jul 09 01:42:10.678457 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.678438    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44379a51-ccfd-47f1-97e5-e69b25aa5a74-tmp\") pod \"opendatahub-operator-controller-manager-b4b98c894-zkllk\" (UID: \"44379a51-ccfd-47f1-97e5-e69b25aa5a74\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk"
Jul 09 01:42:10.678713 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.678695    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44379a51-ccfd-47f1-97e5-e69b25aa5a74-webhook-cert\") pod \"opendatahub-operator-controller-manager-b4b98c894-zkllk\" (UID: \"44379a51-ccfd-47f1-97e5-e69b25aa5a74\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk"
Jul 09 01:42:10.678778 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.678766    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/44379a51-ccfd-47f1-97e5-e69b25aa5a74-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b4b98c894-zkllk\" (UID: \"44379a51-ccfd-47f1-97e5-e69b25aa5a74\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk"
Jul 09 01:42:10.684697 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.684673    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vwnw\" (UniqueName: \"kubernetes.io/projected/44379a51-ccfd-47f1-97e5-e69b25aa5a74-kube-api-access-7vwnw\") pod \"opendatahub-operator-controller-manager-b4b98c894-zkllk\" (UID: \"44379a51-ccfd-47f1-97e5-e69b25aa5a74\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk"
Jul 09 01:42:10.807038 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.806967    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk"
Jul 09 01:42:10.971665 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:10.971612    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk"]
Jul 09 01:42:10.979756 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:42:10.979726    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44379a51_ccfd_47f1_97e5_e69b25aa5a74.slice/crio-5fd5390dc52d12ee1589fec2ce67f1c881a4a413e8e790cd17379fc7a7b86014 WatchSource:0}: Error finding container 5fd5390dc52d12ee1589fec2ce67f1c881a4a413e8e790cd17379fc7a7b86014: Status 404 returned error can't find the container with id 5fd5390dc52d12ee1589fec2ce67f1c881a4a413e8e790cd17379fc7a7b86014
Jul 09 01:42:11.250524 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:11.250434    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk" event={"ID":"44379a51-ccfd-47f1-97e5-e69b25aa5a74","Type":"ContainerStarted","Data":"5fd5390dc52d12ee1589fec2ce67f1c881a4a413e8e790cd17379fc7a7b86014"}
Jul 09 01:42:15.271906 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:15.271865    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6489dc67d-7dl45" event={"ID":"d15fe60a-5950-4aa5-9612-a7f4376e2d47","Type":"ContainerStarted","Data":"b04f50d799d0cae2e1641d88d1390ffb777b103411339dd2c3ebd677dad62471"}
Jul 09 01:42:15.272396 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:15.272078    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6489dc67d-7dl45"
Jul 09 01:42:15.273455 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:15.273433    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk" event={"ID":"44379a51-ccfd-47f1-97e5-e69b25aa5a74","Type":"ContainerStarted","Data":"2ddf8ebe78d3231d7caefc7616133c10edc99e03af803a131ebfdc4022d6efc9"}
Jul 09 01:42:15.288049 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:15.287988    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6489dc67d-7dl45" podStartSLOduration=1.333379985 podStartE2EDuration="6.28797426s" totalImagesPullingTime="4.954594275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:42:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:42:15.287234049 +0000 UTC m=+233.498886384" watchObservedRunningTime="2026-07-09 01:42:15.28797426 +0000 UTC m=+233.499626596"
Jul 09 01:42:16.279858 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:16.279823    2562 generic.go:356] "Generic (PLEG): container finished" podID="44379a51-ccfd-47f1-97e5-e69b25aa5a74" containerID="2ddf8ebe78d3231d7caefc7616133c10edc99e03af803a131ebfdc4022d6efc9" exitCode=0
Jul 09 01:42:16.280331 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:16.279902    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk" event={"ID":"44379a51-ccfd-47f1-97e5-e69b25aa5a74","Type":"ContainerDied","Data":"2ddf8ebe78d3231d7caefc7616133c10edc99e03af803a131ebfdc4022d6efc9"}
Jul 09 01:42:17.285968 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:17.285933    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk" event={"ID":"44379a51-ccfd-47f1-97e5-e69b25aa5a74","Type":"ContainerStarted","Data":"6b0cbf369130d895c78fffb520d385217fc8f7b2e1486fedea65a3109d3e6c4c"}
Jul 09 01:42:17.286409 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:17.286067    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk"
Jul 09 01:42:17.309844 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:17.309797    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk" podStartSLOduration=2.449057164 podStartE2EDuration="7.309783079s" totalImagesPullingTime="3.831630077s" totalInitContainerRuntime="1.029095838s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:42:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:42:17.307418567 +0000 UTC m=+235.519070924" watchObservedRunningTime="2026-07-09 01:42:17.309783079 +0000 UTC m=+235.521435413"
Jul 09 01:42:26.282559 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:26.282531    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6489dc67d-7dl45"
Jul 09 01:42:28.293241 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:28.293213    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-zkllk"
Jul 09 01:42:30.920503 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:30.920468    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5dd66d5ffd-dbsph"]
Jul 09 01:42:30.927086 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:30.927066    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-dbsph"
Jul 09 01:42:30.931220 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:30.931196    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-hz776\""
Jul 09 01:42:30.931403 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:30.931238    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 01:42:30.931403 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:30.931271    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 09 01:42:30.931403 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:30.931240    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 01:42:30.931403 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:30.931343    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 09 01:42:30.940750 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:30.940727    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dd66d5ffd-dbsph"]
Jul 09 01:42:31.054288 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:31.054256    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c1b21c5-6a99-4792-9e8d-6c986a74f97c-tmp\") pod \"kube-auth-proxy-5dd66d5ffd-dbsph\" (UID: \"5c1b21c5-6a99-4792-9e8d-6c986a74f97c\") " pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-dbsph"
Jul 09 01:42:31.054445 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:31.054362    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht64p\" (UniqueName: \"kubernetes.io/projected/5c1b21c5-6a99-4792-9e8d-6c986a74f97c-kube-api-access-ht64p\") pod \"kube-auth-proxy-5dd66d5ffd-dbsph\" (UID: \"5c1b21c5-6a99-4792-9e8d-6c986a74f97c\") " pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-dbsph"
Jul 09 01:42:31.054445 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:31.054433    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c1b21c5-6a99-4792-9e8d-6c986a74f97c-tls-certs\") pod \"kube-auth-proxy-5dd66d5ffd-dbsph\" (UID: \"5c1b21c5-6a99-4792-9e8d-6c986a74f97c\") " pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-dbsph"
Jul 09 01:42:31.154907 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:31.154878    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht64p\" (UniqueName: \"kubernetes.io/projected/5c1b21c5-6a99-4792-9e8d-6c986a74f97c-kube-api-access-ht64p\") pod \"kube-auth-proxy-5dd66d5ffd-dbsph\" (UID: \"5c1b21c5-6a99-4792-9e8d-6c986a74f97c\") " pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-dbsph"
Jul 09 01:42:31.155063 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:31.154924    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c1b21c5-6a99-4792-9e8d-6c986a74f97c-tls-certs\") pod \"kube-auth-proxy-5dd66d5ffd-dbsph\" (UID: \"5c1b21c5-6a99-4792-9e8d-6c986a74f97c\") " pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-dbsph"
Jul 09 01:42:31.155063 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:31.154975    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c1b21c5-6a99-4792-9e8d-6c986a74f97c-tmp\") pod \"kube-auth-proxy-5dd66d5ffd-dbsph\" (UID: \"5c1b21c5-6a99-4792-9e8d-6c986a74f97c\") " pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-dbsph"
Jul 09 01:42:31.157049 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:31.157010    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c1b21c5-6a99-4792-9e8d-6c986a74f97c-tmp\") pod \"kube-auth-proxy-5dd66d5ffd-dbsph\" (UID: \"5c1b21c5-6a99-4792-9e8d-6c986a74f97c\") " pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-dbsph"
Jul 09 01:42:31.157341 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:31.157324    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c1b21c5-6a99-4792-9e8d-6c986a74f97c-tls-certs\") pod \"kube-auth-proxy-5dd66d5ffd-dbsph\" (UID: \"5c1b21c5-6a99-4792-9e8d-6c986a74f97c\") " pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-dbsph"
Jul 09 01:42:31.162736 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:31.162713    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht64p\" (UniqueName: \"kubernetes.io/projected/5c1b21c5-6a99-4792-9e8d-6c986a74f97c-kube-api-access-ht64p\") pod \"kube-auth-proxy-5dd66d5ffd-dbsph\" (UID: \"5c1b21c5-6a99-4792-9e8d-6c986a74f97c\") " pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-dbsph"
Jul 09 01:42:31.236871 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:31.236797    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-dbsph"
Jul 09 01:42:31.386123 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:31.386096    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dd66d5ffd-dbsph"]
Jul 09 01:42:31.388168 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:42:31.388141    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c1b21c5_6a99_4792_9e8d_6c986a74f97c.slice/crio-11b35c0a11e6158e243213866cd7ff631998fe2d520db018f7b0ed50b0049622 WatchSource:0}: Error finding container 11b35c0a11e6158e243213866cd7ff631998fe2d520db018f7b0ed50b0049622: Status 404 returned error can't find the container with id 11b35c0a11e6158e243213866cd7ff631998fe2d520db018f7b0ed50b0049622
Jul 09 01:42:32.354444 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:32.354411    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-dbsph" event={"ID":"5c1b21c5-6a99-4792-9e8d-6c986a74f97c","Type":"ContainerStarted","Data":"11b35c0a11e6158e243213866cd7ff631998fe2d520db018f7b0ed50b0049622"}
Jul 09 01:42:34.365306 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:34.365277    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-dbsph" event={"ID":"5c1b21c5-6a99-4792-9e8d-6c986a74f97c","Type":"ContainerStarted","Data":"a8f46a43b704fd9a415e574067f08f16e9b407de044c0b08ee05ab09e1d94756"}
Jul 09 01:42:34.381995 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:42:34.381939    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-dbsph" podStartSLOduration=1.498558313 podStartE2EDuration="4.381920355s" totalImagesPullingTime="2.883362042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:42:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:42:34.381502172 +0000 UTC m=+252.593154512" watchObservedRunningTime="2026-07-09 01:42:34.381920355 +0000 UTC m=+252.593572692"
Jul 09 01:43:23.975222 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:43:23.975195    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 01:44:11.949789 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:11.949756    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7ngf5"]
Jul 09 01:44:11.951998 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:11.951984    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7ngf5"
Jul 09 01:44:11.954655 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:11.954634    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 01:44:11.955962 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:11.955943    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 01:44:11.956039 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:11.955943    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-4b5r6\""
Jul 09 01:44:11.962645 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:11.962616    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7ngf5"]
Jul 09 01:44:12.077801 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:12.077767    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpzb8\" (UniqueName: \"kubernetes.io/projected/3e5d2973-03cc-4735-b10a-e8058c6ac603-kube-api-access-jpzb8\") pod \"authorino-operator-75cc8d5cb7-7ngf5\" (UID: \"3e5d2973-03cc-4735-b10a-e8058c6ac603\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7ngf5"
Jul 09 01:44:12.178984 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:12.178945    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpzb8\" (UniqueName: \"kubernetes.io/projected/3e5d2973-03cc-4735-b10a-e8058c6ac603-kube-api-access-jpzb8\") pod \"authorino-operator-75cc8d5cb7-7ngf5\" (UID: \"3e5d2973-03cc-4735-b10a-e8058c6ac603\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7ngf5"
Jul 09 01:44:12.192462 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:12.192437    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpzb8\" (UniqueName: \"kubernetes.io/projected/3e5d2973-03cc-4735-b10a-e8058c6ac603-kube-api-access-jpzb8\") pod \"authorino-operator-75cc8d5cb7-7ngf5\" (UID: \"3e5d2973-03cc-4735-b10a-e8058c6ac603\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7ngf5"
Jul 09 01:44:12.262488 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:12.262423    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7ngf5"
Jul 09 01:44:12.398766 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:12.398741    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7ngf5"]
Jul 09 01:44:12.400473 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:44:12.400442    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e5d2973_03cc_4735_b10a_e8058c6ac603.slice/crio-51a5f2ecfe84ef744db9b57ff11775c3aa8a45aae878741f94be803cce5d3706 WatchSource:0}: Error finding container 51a5f2ecfe84ef744db9b57ff11775c3aa8a45aae878741f94be803cce5d3706: Status 404 returned error can't find the container with id 51a5f2ecfe84ef744db9b57ff11775c3aa8a45aae878741f94be803cce5d3706
Jul 09 01:44:12.402761 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:12.402745    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 01:44:12.796125 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:12.796087    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7ngf5" event={"ID":"3e5d2973-03cc-4735-b10a-e8058c6ac603","Type":"ContainerStarted","Data":"51a5f2ecfe84ef744db9b57ff11775c3aa8a45aae878741f94be803cce5d3706"}
Jul 09 01:44:14.806916 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:14.806882    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7ngf5" event={"ID":"3e5d2973-03cc-4735-b10a-e8058c6ac603","Type":"ContainerStarted","Data":"702a1473926a6fc3ac233a7cc7b3ef265f8c267dc66a3e3bf7f7be18c6766c4f"}
Jul 09 01:44:14.807267 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:14.807068    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7ngf5"
Jul 09 01:44:14.824506 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:14.824464    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7ngf5" podStartSLOduration=1.691652941 podStartE2EDuration="3.824452056s" totalImagesPullingTime="2.132799115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:44:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:44:14.822767053 +0000 UTC m=+353.034419389" watchObservedRunningTime="2026-07-09 01:44:14.824452056 +0000 UTC m=+353.036104452"
Jul 09 01:44:25.813869 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:25.813841    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7ngf5"
Jul 09 01:44:32.584209 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.584177    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55d595d777-7bnf9"]
Jul 09 01:44:32.586666 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.586647    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:32.589554 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.589534    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 01:44:32.589660 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.589585    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 01:44:32.589660 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.589543    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 01:44:32.590032 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.589996    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 01:44:32.591260 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.591240    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 01:44:32.591367 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.591261    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 01:44:32.591433 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.591396    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 01:44:32.591433 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.591411    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9x9t2\""
Jul 09 01:44:32.595487 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.595465    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 09 01:44:32.600158 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.600139    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55d595d777-7bnf9"]
Jul 09 01:44:32.740141 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.740102    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34d3de22-63bd-4726-99ff-b3497f8ca879-console-config\") pod \"console-55d595d777-7bnf9\" (UID: \"34d3de22-63bd-4726-99ff-b3497f8ca879\") " pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:32.740268 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.740150    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34d3de22-63bd-4726-99ff-b3497f8ca879-console-oauth-config\") pod \"console-55d595d777-7bnf9\" (UID: \"34d3de22-63bd-4726-99ff-b3497f8ca879\") " pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:32.740268 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.740170    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34d3de22-63bd-4726-99ff-b3497f8ca879-trusted-ca-bundle\") pod \"console-55d595d777-7bnf9\" (UID: \"34d3de22-63bd-4726-99ff-b3497f8ca879\") " pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:32.740268 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.740189    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jpzv\" (UniqueName: \"kubernetes.io/projected/34d3de22-63bd-4726-99ff-b3497f8ca879-kube-api-access-2jpzv\") pod \"console-55d595d777-7bnf9\" (UID: \"34d3de22-63bd-4726-99ff-b3497f8ca879\") " pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:32.740268 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.740248    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34d3de22-63bd-4726-99ff-b3497f8ca879-oauth-serving-cert\") pod \"console-55d595d777-7bnf9\" (UID: \"34d3de22-63bd-4726-99ff-b3497f8ca879\") " pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:32.740438 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.740284    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34d3de22-63bd-4726-99ff-b3497f8ca879-console-serving-cert\") pod \"console-55d595d777-7bnf9\" (UID: \"34d3de22-63bd-4726-99ff-b3497f8ca879\") " pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:32.740438 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.740325    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34d3de22-63bd-4726-99ff-b3497f8ca879-service-ca\") pod \"console-55d595d777-7bnf9\" (UID: \"34d3de22-63bd-4726-99ff-b3497f8ca879\") " pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:32.840886 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.840795    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34d3de22-63bd-4726-99ff-b3497f8ca879-service-ca\") pod \"console-55d595d777-7bnf9\" (UID: \"34d3de22-63bd-4726-99ff-b3497f8ca879\") " pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:32.840886 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.840840    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34d3de22-63bd-4726-99ff-b3497f8ca879-console-config\") pod \"console-55d595d777-7bnf9\" (UID: \"34d3de22-63bd-4726-99ff-b3497f8ca879\") " pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:32.840886 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.840882    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34d3de22-63bd-4726-99ff-b3497f8ca879-console-oauth-config\") pod \"console-55d595d777-7bnf9\" (UID: \"34d3de22-63bd-4726-99ff-b3497f8ca879\") " pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:32.841133 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.840990    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34d3de22-63bd-4726-99ff-b3497f8ca879-trusted-ca-bundle\") pod \"console-55d595d777-7bnf9\" (UID: \"34d3de22-63bd-4726-99ff-b3497f8ca879\") " pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:32.841133 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.841055    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jpzv\" (UniqueName: \"kubernetes.io/projected/34d3de22-63bd-4726-99ff-b3497f8ca879-kube-api-access-2jpzv\") pod \"console-55d595d777-7bnf9\" (UID: \"34d3de22-63bd-4726-99ff-b3497f8ca879\") " pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:32.841133 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.841098    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34d3de22-63bd-4726-99ff-b3497f8ca879-oauth-serving-cert\") pod \"console-55d595d777-7bnf9\" (UID: \"34d3de22-63bd-4726-99ff-b3497f8ca879\") " pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:32.841279 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.841140    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34d3de22-63bd-4726-99ff-b3497f8ca879-console-serving-cert\") pod \"console-55d595d777-7bnf9\" (UID: \"34d3de22-63bd-4726-99ff-b3497f8ca879\") " pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:32.841725 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.841701    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34d3de22-63bd-4726-99ff-b3497f8ca879-service-ca\") pod \"console-55d595d777-7bnf9\" (UID: \"34d3de22-63bd-4726-99ff-b3497f8ca879\") " pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:32.841836 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.841782    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34d3de22-63bd-4726-99ff-b3497f8ca879-oauth-serving-cert\") pod \"console-55d595d777-7bnf9\" (UID: \"34d3de22-63bd-4726-99ff-b3497f8ca879\") " pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:32.842052 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.842035    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34d3de22-63bd-4726-99ff-b3497f8ca879-trusted-ca-bundle\") pod \"console-55d595d777-7bnf9\" (UID: \"34d3de22-63bd-4726-99ff-b3497f8ca879\") " pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:32.842135 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.842101    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34d3de22-63bd-4726-99ff-b3497f8ca879-console-config\") pod \"console-55d595d777-7bnf9\" (UID: \"34d3de22-63bd-4726-99ff-b3497f8ca879\") " pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:32.843716 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.843692    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34d3de22-63bd-4726-99ff-b3497f8ca879-console-oauth-config\") pod \"console-55d595d777-7bnf9\" (UID: \"34d3de22-63bd-4726-99ff-b3497f8ca879\") " pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:32.843915 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.843894    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34d3de22-63bd-4726-99ff-b3497f8ca879-console-serving-cert\") pod \"console-55d595d777-7bnf9\" (UID: \"34d3de22-63bd-4726-99ff-b3497f8ca879\") " pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:32.854703 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.854684    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jpzv\" (UniqueName: \"kubernetes.io/projected/34d3de22-63bd-4726-99ff-b3497f8ca879-kube-api-access-2jpzv\") pod \"console-55d595d777-7bnf9\" (UID: \"34d3de22-63bd-4726-99ff-b3497f8ca879\") " pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:32.896436 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:32.896413    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:33.024557 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:33.024531    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55d595d777-7bnf9"]
Jul 09 01:44:33.026312 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:44:33.026288    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34d3de22_63bd_4726_99ff_b3497f8ca879.slice/crio-59b3db64b6396c5c38cec7d9f956cd0b1083d1e62a2af1f6cf53f1825a7845de WatchSource:0}: Error finding container 59b3db64b6396c5c38cec7d9f956cd0b1083d1e62a2af1f6cf53f1825a7845de: Status 404 returned error can't find the container with id 59b3db64b6396c5c38cec7d9f956cd0b1083d1e62a2af1f6cf53f1825a7845de
Jul 09 01:44:33.893023 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:33.892982    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55d595d777-7bnf9" event={"ID":"34d3de22-63bd-4726-99ff-b3497f8ca879","Type":"ContainerStarted","Data":"9d67b45c306fb80e5e2fdd0bbca0f0e1c05b73c3eb95f837b8e8dfebcb30e551"}
Jul 09 01:44:33.893354 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:33.893043    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55d595d777-7bnf9" event={"ID":"34d3de22-63bd-4726-99ff-b3497f8ca879","Type":"ContainerStarted","Data":"59b3db64b6396c5c38cec7d9f956cd0b1083d1e62a2af1f6cf53f1825a7845de"}
Jul 09 01:44:33.911873 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:33.911826    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55d595d777-7bnf9" podStartSLOduration=1.911810777 podStartE2EDuration="1.911810777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:44:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:44:33.909696634 +0000 UTC m=+372.121348969" watchObservedRunningTime="2026-07-09 01:44:33.911810777 +0000 UTC m=+372.123463114"
Jul 09 01:44:42.896960 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:42.896923    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:42.897442 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:42.896984    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:42.901319 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:42.901300    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:44:42.934784 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:44:42.934762    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55d595d777-7bnf9"
Jul 09 01:45:13.014859 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:13.014820    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-g9qk7"]
Jul 09 01:45:13.022010 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:13.021985    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g9qk7"
Jul 09 01:45:13.024782 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:13.024756    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lgdvc\""
Jul 09 01:45:13.025534 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:13.025506    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-g9qk7"]
Jul 09 01:45:13.083007 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:13.082974    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwq9r\" (UniqueName: \"kubernetes.io/projected/ac068489-3c7b-45fa-95b4-2f8eb66837ff-kube-api-access-nwq9r\") pod \"authorino-58cd955675-g9qk7\" (UID: \"ac068489-3c7b-45fa-95b4-2f8eb66837ff\") " pod="kuadrant-system/authorino-58cd955675-g9qk7"
Jul 09 01:45:13.184031 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:13.183983    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwq9r\" (UniqueName: \"kubernetes.io/projected/ac068489-3c7b-45fa-95b4-2f8eb66837ff-kube-api-access-nwq9r\") pod \"authorino-58cd955675-g9qk7\" (UID: \"ac068489-3c7b-45fa-95b4-2f8eb66837ff\") " pod="kuadrant-system/authorino-58cd955675-g9qk7"
Jul 09 01:45:13.197570 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:13.197541    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwq9r\" (UniqueName: \"kubernetes.io/projected/ac068489-3c7b-45fa-95b4-2f8eb66837ff-kube-api-access-nwq9r\") pod \"authorino-58cd955675-g9qk7\" (UID: \"ac068489-3c7b-45fa-95b4-2f8eb66837ff\") " pod="kuadrant-system/authorino-58cd955675-g9qk7"
Jul 09 01:45:13.284642 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:13.284575    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-v2556"]
Jul 09 01:45:13.288164 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:13.288145    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-v2556"
Jul 09 01:45:13.296490 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:13.296354    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-v2556"]
Jul 09 01:45:13.333389 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:13.333363    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g9qk7"
Jul 09 01:45:13.385780 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:13.385754    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scqgw\" (UniqueName: \"kubernetes.io/projected/8aae53f6-74f0-4b50-8695-1b98b7b1ca2a-kube-api-access-scqgw\") pod \"authorino-75d556bd77-v2556\" (UID: \"8aae53f6-74f0-4b50-8695-1b98b7b1ca2a\") " pod="kuadrant-system/authorino-75d556bd77-v2556"
Jul 09 01:45:13.462296 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:13.462269    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-g9qk7"]
Jul 09 01:45:13.464695 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:45:13.464659    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac068489_3c7b_45fa_95b4_2f8eb66837ff.slice/crio-507c195a0cbc9762ee2ed08ee612ac13e470e06aa02a868489878b02bdb01ac4 WatchSource:0}: Error finding container 507c195a0cbc9762ee2ed08ee612ac13e470e06aa02a868489878b02bdb01ac4: Status 404 returned error can't find the container with id 507c195a0cbc9762ee2ed08ee612ac13e470e06aa02a868489878b02bdb01ac4
Jul 09 01:45:13.486604 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:13.486578    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scqgw\" (UniqueName: \"kubernetes.io/projected/8aae53f6-74f0-4b50-8695-1b98b7b1ca2a-kube-api-access-scqgw\") pod \"authorino-75d556bd77-v2556\" (UID: \"8aae53f6-74f0-4b50-8695-1b98b7b1ca2a\") " pod="kuadrant-system/authorino-75d556bd77-v2556"
Jul 09 01:45:13.494633 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:13.494607    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scqgw\" (UniqueName: \"kubernetes.io/projected/8aae53f6-74f0-4b50-8695-1b98b7b1ca2a-kube-api-access-scqgw\") pod \"authorino-75d556bd77-v2556\" (UID: \"8aae53f6-74f0-4b50-8695-1b98b7b1ca2a\") " pod="kuadrant-system/authorino-75d556bd77-v2556"
Jul 09 01:45:13.599488 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:13.599466    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-v2556"
Jul 09 01:45:13.726442 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:13.726419    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-v2556"]
Jul 09 01:45:13.727959 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:45:13.727935    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8aae53f6_74f0_4b50_8695_1b98b7b1ca2a.slice/crio-6dbcf03458fdee6bc543165babef0c7fc1baef636cd5ad85d15dfb66a2388286 WatchSource:0}: Error finding container 6dbcf03458fdee6bc543165babef0c7fc1baef636cd5ad85d15dfb66a2388286: Status 404 returned error can't find the container with id 6dbcf03458fdee6bc543165babef0c7fc1baef636cd5ad85d15dfb66a2388286
Jul 09 01:45:14.074673 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:14.074634    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-v2556" event={"ID":"8aae53f6-74f0-4b50-8695-1b98b7b1ca2a","Type":"ContainerStarted","Data":"6dbcf03458fdee6bc543165babef0c7fc1baef636cd5ad85d15dfb66a2388286"}
Jul 09 01:45:14.076426 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:14.076368    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g9qk7" event={"ID":"ac068489-3c7b-45fa-95b4-2f8eb66837ff","Type":"ContainerStarted","Data":"507c195a0cbc9762ee2ed08ee612ac13e470e06aa02a868489878b02bdb01ac4"}
Jul 09 01:45:17.093784 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:17.093748    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g9qk7" event={"ID":"ac068489-3c7b-45fa-95b4-2f8eb66837ff","Type":"ContainerStarted","Data":"3e230d8913457a3ade9286013fbe1870a4eba456f77845c624629352db77d860"}
Jul 09 01:45:17.095231 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:17.095208    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-v2556" event={"ID":"8aae53f6-74f0-4b50-8695-1b98b7b1ca2a","Type":"ContainerStarted","Data":"302e92b48aa5f327b696d58611a5e4e1ca42ff8d1d267623d87874759bba7abe"}
Jul 09 01:45:17.110940 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:17.110899    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-g9qk7" podStartSLOduration=0.68705584 podStartE2EDuration="4.110884405s" totalImagesPullingTime="3.423828565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:45:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:45:17.10913264 +0000 UTC m=+415.320784976" watchObservedRunningTime="2026-07-09 01:45:17.110884405 +0000 UTC m=+415.322536740"
Jul 09 01:45:17.129506 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:17.129463    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-v2556" podStartSLOduration=0.957932089 podStartE2EDuration="4.129450441s" totalImagesPullingTime="3.171518352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:45:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:45:17.128383295 +0000 UTC m=+415.340035632" watchObservedRunningTime="2026-07-09 01:45:17.129450441 +0000 UTC m=+415.341102776"
Jul 09 01:45:17.152912 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:17.152839    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-g9qk7"]
Jul 09 01:45:19.104177 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:19.104137    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-g9qk7" podUID="ac068489-3c7b-45fa-95b4-2f8eb66837ff" containerName="authorino" containerID="cri-o://3e230d8913457a3ade9286013fbe1870a4eba456f77845c624629352db77d860" gracePeriod=30
Jul 09 01:45:19.347554 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:19.347528    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g9qk7"
Jul 09 01:45:19.440595 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:19.440540    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwq9r\" (UniqueName: \"kubernetes.io/projected/ac068489-3c7b-45fa-95b4-2f8eb66837ff-kube-api-access-nwq9r\") pod \"ac068489-3c7b-45fa-95b4-2f8eb66837ff\" (UID: \"ac068489-3c7b-45fa-95b4-2f8eb66837ff\") "
Jul 09 01:45:19.442523 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:19.442500    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac068489-3c7b-45fa-95b4-2f8eb66837ff-kube-api-access-nwq9r" (OuterVolumeSpecName: "kube-api-access-nwq9r") pod "ac068489-3c7b-45fa-95b4-2f8eb66837ff" (UID: "ac068489-3c7b-45fa-95b4-2f8eb66837ff"). InnerVolumeSpecName "kube-api-access-nwq9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:45:19.542069 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:19.542038    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwq9r\" (UniqueName: \"kubernetes.io/projected/ac068489-3c7b-45fa-95b4-2f8eb66837ff-kube-api-access-nwq9r\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:45:20.110196 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:20.110157    2562 generic.go:356] "Generic (PLEG): container finished" podID="ac068489-3c7b-45fa-95b4-2f8eb66837ff" containerID="3e230d8913457a3ade9286013fbe1870a4eba456f77845c624629352db77d860" exitCode=0
Jul 09 01:45:20.110594 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:20.110198    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g9qk7"
Jul 09 01:45:20.110594 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:20.110243    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g9qk7" event={"ID":"ac068489-3c7b-45fa-95b4-2f8eb66837ff","Type":"ContainerDied","Data":"3e230d8913457a3ade9286013fbe1870a4eba456f77845c624629352db77d860"}
Jul 09 01:45:20.110594 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:20.110285    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g9qk7" event={"ID":"ac068489-3c7b-45fa-95b4-2f8eb66837ff","Type":"ContainerDied","Data":"507c195a0cbc9762ee2ed08ee612ac13e470e06aa02a868489878b02bdb01ac4"}
Jul 09 01:45:20.110594 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:20.110306    2562 scope.go:117] "RemoveContainer" containerID="3e230d8913457a3ade9286013fbe1870a4eba456f77845c624629352db77d860"
Jul 09 01:45:20.119704 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:20.119689    2562 scope.go:117] "RemoveContainer" containerID="3e230d8913457a3ade9286013fbe1870a4eba456f77845c624629352db77d860"
Jul 09 01:45:20.119932 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:45:20.119915    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e230d8913457a3ade9286013fbe1870a4eba456f77845c624629352db77d860\": container with ID starting with 3e230d8913457a3ade9286013fbe1870a4eba456f77845c624629352db77d860 not found: ID does not exist" containerID="3e230d8913457a3ade9286013fbe1870a4eba456f77845c624629352db77d860"
Jul 09 01:45:20.119981 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:20.119939    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e230d8913457a3ade9286013fbe1870a4eba456f77845c624629352db77d860"} err="failed to get container status \"3e230d8913457a3ade9286013fbe1870a4eba456f77845c624629352db77d860\": rpc error: code = NotFound desc = could not find container \"3e230d8913457a3ade9286013fbe1870a4eba456f77845c624629352db77d860\": container with ID starting with 3e230d8913457a3ade9286013fbe1870a4eba456f77845c624629352db77d860 not found: ID does not exist"
Jul 09 01:45:20.131162 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:20.131144    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-g9qk7"]
Jul 09 01:45:20.134632 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:20.134608    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-g9qk7"]
Jul 09 01:45:20.157571 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:20.157539    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac068489-3c7b-45fa-95b4-2f8eb66837ff" path="/var/lib/kubelet/pods/ac068489-3c7b-45fa-95b4-2f8eb66837ff/volumes"
Jul 09 01:45:43.917927 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:43.917898    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cv9d8"]
Jul 09 01:45:43.918393 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:43.918270    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac068489-3c7b-45fa-95b4-2f8eb66837ff" containerName="authorino"
Jul 09 01:45:43.918393 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:43.918281    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac068489-3c7b-45fa-95b4-2f8eb66837ff" containerName="authorino"
Jul 09 01:45:43.918393 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:43.918335    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac068489-3c7b-45fa-95b4-2f8eb66837ff" containerName="authorino"
Jul 09 01:45:43.922605 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:43.922587    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cv9d8"
Jul 09 01:45:43.930824 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:43.930795    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cv9d8"]
Jul 09 01:45:43.949676 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:43.949649    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbhw5\" (UniqueName: \"kubernetes.io/projected/a86bbe5d-f3cb-43cf-8797-f7f7102ca072-kube-api-access-nbhw5\") pod \"authorino-5d4b67c446-cv9d8\" (UID: \"a86bbe5d-f3cb-43cf-8797-f7f7102ca072\") " pod="kuadrant-system/authorino-5d4b67c446-cv9d8"
Jul 09 01:45:44.050726 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:44.050663    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbhw5\" (UniqueName: \"kubernetes.io/projected/a86bbe5d-f3cb-43cf-8797-f7f7102ca072-kube-api-access-nbhw5\") pod \"authorino-5d4b67c446-cv9d8\" (UID: \"a86bbe5d-f3cb-43cf-8797-f7f7102ca072\") " pod="kuadrant-system/authorino-5d4b67c446-cv9d8"
Jul 09 01:45:44.058889 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:44.058860    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbhw5\" (UniqueName: \"kubernetes.io/projected/a86bbe5d-f3cb-43cf-8797-f7f7102ca072-kube-api-access-nbhw5\") pod \"authorino-5d4b67c446-cv9d8\" (UID: \"a86bbe5d-f3cb-43cf-8797-f7f7102ca072\") " pod="kuadrant-system/authorino-5d4b67c446-cv9d8"
Jul 09 01:45:44.156525 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:44.156499    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cv9d8"]
Jul 09 01:45:44.156737 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:44.156721    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cv9d8"
Jul 09 01:45:44.170996 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:44.170942    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58c97d84c9-5tqv7"]
Jul 09 01:45:44.174625 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:44.174607    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58c97d84c9-5tqv7"
Jul 09 01:45:44.179807 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:44.179787    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58c97d84c9-5tqv7"]
Jul 09 01:45:44.252431 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:44.252401    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q544d\" (UniqueName: \"kubernetes.io/projected/6f3d89a9-c31c-4679-9bc4-0f478077d1d4-kube-api-access-q544d\") pod \"authorino-58c97d84c9-5tqv7\" (UID: \"6f3d89a9-c31c-4679-9bc4-0f478077d1d4\") " pod="kuadrant-system/authorino-58c97d84c9-5tqv7"
Jul 09 01:45:44.287902 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:44.287880    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cv9d8"]
Jul 09 01:45:44.290341 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:45:44.290310    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda86bbe5d_f3cb_43cf_8797_f7f7102ca072.slice/crio-59894b41f3ffe47f4e34c066b2ea7deb81f35e281d9a2a6386a266953bfc6c91 WatchSource:0}: Error finding container 59894b41f3ffe47f4e34c066b2ea7deb81f35e281d9a2a6386a266953bfc6c91: Status 404 returned error can't find the container with id 59894b41f3ffe47f4e34c066b2ea7deb81f35e281d9a2a6386a266953bfc6c91
Jul 09 01:45:44.292002 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:44.291982    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58c97d84c9-5tqv7"]
Jul 09 01:45:44.292262 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:45:44.292241    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-q544d], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-58c97d84c9-5tqv7" podUID="6f3d89a9-c31c-4679-9bc4-0f478077d1d4"
Jul 09 01:45:44.316547 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:44.316528    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-55766c4f59-wsjrk"]
Jul 09 01:45:44.320070 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:44.320055    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55766c4f59-wsjrk"
Jul 09 01:45:44.322574 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:44.322557    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 09 01:45:44.327233 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:44.327215    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55766c4f59-wsjrk"]
Jul 09 01:45:44.353472 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:44.353446    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q544d\" (UniqueName: \"kubernetes.io/projected/6f3d89a9-c31c-4679-9bc4-0f478077d1d4-kube-api-access-q544d\") pod \"authorino-58c97d84c9-5tqv7\" (UID: \"6f3d89a9-c31c-4679-9bc4-0f478077d1d4\") " pod="kuadrant-system/authorino-58c97d84c9-5tqv7"
Jul 09 01:45:44.353562 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:44.353481    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcb5v\" (UniqueName: \"kubernetes.io/projected/bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b-kube-api-access-fcb5v\") pod \"authorino-55766c4f59-wsjrk\" (UID: \"bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b\") " pod="kuadrant-system/authorino-55766c4f59-wsjrk"
Jul 09 01:45:44.353562 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:44.353534    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b-tls-cert\") pod \"authorino-55766c4f59-wsjrk\" (UID: \"bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b\") " pod="kuadrant-system/authorino-55766c4f59-wsjrk"
Jul 09 01:45:44.362722 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:44.362702    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q544d\" (UniqueName: \"kubernetes.io/projected/6f3d89a9-c31c-4679-9bc4-0f478077d1d4-kube-api-access-q544d\") pod \"authorino-58c97d84c9-5tqv7\" (UID: \"6f3d89a9-c31c-4679-9bc4-0f478077d1d4\") " pod="kuadrant-system/authorino-58c97d84c9-5tqv7"
Jul 09 01:45:44.454654 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:44.454600    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcb5v\" (UniqueName: \"kubernetes.io/projected/bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b-kube-api-access-fcb5v\") pod \"authorino-55766c4f59-wsjrk\" (UID: \"bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b\") " pod="kuadrant-system/authorino-55766c4f59-wsjrk"
Jul 09 01:45:44.454654 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:44.454649    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b-tls-cert\") pod \"authorino-55766c4f59-wsjrk\" (UID: \"bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b\") " pod="kuadrant-system/authorino-55766c4f59-wsjrk"
Jul 09 01:45:44.456979 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:44.456957    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b-tls-cert\") pod \"authorino-55766c4f59-wsjrk\" (UID: \"bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b\") " pod="kuadrant-system/authorino-55766c4f59-wsjrk"
Jul 09 01:45:44.465879 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:44.465860    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcb5v\" (UniqueName: \"kubernetes.io/projected/bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b-kube-api-access-fcb5v\") pod \"authorino-55766c4f59-wsjrk\" (UID: \"bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b\") " pod="kuadrant-system/authorino-55766c4f59-wsjrk"
Jul 09 01:45:44.630055 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:44.630028    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55766c4f59-wsjrk"
Jul 09 01:45:44.755803 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:44.755779    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55766c4f59-wsjrk"]
Jul 09 01:45:44.756572 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:45:44.756545    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf980975_36ed_4a0a_b53f_5ecf8c7c1a6b.slice/crio-345b56c735a91744bd8772ec9fd3a3f21fba4c7622a2067389e15ba80dc43959 WatchSource:0}: Error finding container 345b56c735a91744bd8772ec9fd3a3f21fba4c7622a2067389e15ba80dc43959: Status 404 returned error can't find the container with id 345b56c735a91744bd8772ec9fd3a3f21fba4c7622a2067389e15ba80dc43959
Jul 09 01:45:45.225543 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:45.225491    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55766c4f59-wsjrk" event={"ID":"bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b","Type":"ContainerStarted","Data":"f4896631ec40dc4cd3446016cb8ae2fb8cfd7fd36acd20cacfe2d0582ba908cb"}
Jul 09 01:45:45.226206 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:45.225552    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55766c4f59-wsjrk" event={"ID":"bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b","Type":"ContainerStarted","Data":"345b56c735a91744bd8772ec9fd3a3f21fba4c7622a2067389e15ba80dc43959"}
Jul 09 01:45:45.227328 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:45.227302    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cv9d8" event={"ID":"a86bbe5d-f3cb-43cf-8797-f7f7102ca072","Type":"ContainerStarted","Data":"c590d0eec424dcc91cd422cbb2380a16cdcbe3c476e41ad9bcc1bfec0dbd1c87"}
Jul 09 01:45:45.227446 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:45.227343    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cv9d8" event={"ID":"a86bbe5d-f3cb-43cf-8797-f7f7102ca072","Type":"ContainerStarted","Data":"59894b41f3ffe47f4e34c066b2ea7deb81f35e281d9a2a6386a266953bfc6c91"}
Jul 09 01:45:45.227446 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:45.227366    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58c97d84c9-5tqv7"
Jul 09 01:45:45.227446 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:45.227391    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-cv9d8" podUID="a86bbe5d-f3cb-43cf-8797-f7f7102ca072" containerName="authorino" containerID="cri-o://c590d0eec424dcc91cd422cbb2380a16cdcbe3c476e41ad9bcc1bfec0dbd1c87" gracePeriod=30
Jul 09 01:45:45.235747 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:45.235724    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58c97d84c9-5tqv7"
Jul 09 01:45:45.241328 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:45.241287    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-55766c4f59-wsjrk" podStartSLOduration=0.885045509 podStartE2EDuration="1.241272607s" totalImagesPullingTime="356.227098ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:45:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:45:45.240106074 +0000 UTC m=+443.451758414" watchObservedRunningTime="2026-07-09 01:45:45.241272607 +0000 UTC m=+443.452924944"
Jul 09 01:45:45.261583 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:45.261140    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q544d\" (UniqueName: \"kubernetes.io/projected/6f3d89a9-c31c-4679-9bc4-0f478077d1d4-kube-api-access-q544d\") pod \"6f3d89a9-c31c-4679-9bc4-0f478077d1d4\" (UID: \"6f3d89a9-c31c-4679-9bc4-0f478077d1d4\") "
Jul 09 01:45:45.264138 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:45.264109    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f3d89a9-c31c-4679-9bc4-0f478077d1d4-kube-api-access-q544d" (OuterVolumeSpecName: "kube-api-access-q544d") pod "6f3d89a9-c31c-4679-9bc4-0f478077d1d4" (UID: "6f3d89a9-c31c-4679-9bc4-0f478077d1d4"). InnerVolumeSpecName "kube-api-access-q544d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:45:45.265956 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:45.265934    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-v2556"]
Jul 09 01:45:45.266165 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:45.266144    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-v2556" podUID="8aae53f6-74f0-4b50-8695-1b98b7b1ca2a" containerName="authorino" containerID="cri-o://302e92b48aa5f327b696d58611a5e4e1ca42ff8d1d267623d87874759bba7abe" gracePeriod=30
Jul 09 01:45:45.270429 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:45.270361    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-cv9d8" podStartSLOduration=1.8510169319999998 podStartE2EDuration="2.27034233s" totalImagesPullingTime="419.325398ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:45:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:45:45.269616771 +0000 UTC m=+443.481269107" watchObservedRunningTime="2026-07-09 01:45:45.27034233 +0000 UTC m=+443.481994667"
Jul 09 01:45:45.362189 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:45.362165    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q544d\" (UniqueName: \"kubernetes.io/projected/6f3d89a9-c31c-4679-9bc4-0f478077d1d4-kube-api-access-q544d\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:45:45.519184 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:45.519160    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cv9d8"
Jul 09 01:45:45.523709 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:45.523692    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-v2556"
Jul 09 01:45:45.563548 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:45.563522    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbhw5\" (UniqueName: \"kubernetes.io/projected/a86bbe5d-f3cb-43cf-8797-f7f7102ca072-kube-api-access-nbhw5\") pod \"a86bbe5d-f3cb-43cf-8797-f7f7102ca072\" (UID: \"a86bbe5d-f3cb-43cf-8797-f7f7102ca072\") "
Jul 09 01:45:45.563701 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:45.563571    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scqgw\" (UniqueName: \"kubernetes.io/projected/8aae53f6-74f0-4b50-8695-1b98b7b1ca2a-kube-api-access-scqgw\") pod \"8aae53f6-74f0-4b50-8695-1b98b7b1ca2a\" (UID: \"8aae53f6-74f0-4b50-8695-1b98b7b1ca2a\") "
Jul 09 01:45:45.565599 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:45.565563    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8aae53f6-74f0-4b50-8695-1b98b7b1ca2a-kube-api-access-scqgw" (OuterVolumeSpecName: "kube-api-access-scqgw") pod "8aae53f6-74f0-4b50-8695-1b98b7b1ca2a" (UID: "8aae53f6-74f0-4b50-8695-1b98b7b1ca2a"). InnerVolumeSpecName "kube-api-access-scqgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:45:45.565599 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:45.565575    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a86bbe5d-f3cb-43cf-8797-f7f7102ca072-kube-api-access-nbhw5" (OuterVolumeSpecName: "kube-api-access-nbhw5") pod "a86bbe5d-f3cb-43cf-8797-f7f7102ca072" (UID: "a86bbe5d-f3cb-43cf-8797-f7f7102ca072"). InnerVolumeSpecName "kube-api-access-nbhw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:45:45.664490 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:45.664411    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbhw5\" (UniqueName: \"kubernetes.io/projected/a86bbe5d-f3cb-43cf-8797-f7f7102ca072-kube-api-access-nbhw5\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:45:45.664490 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:45.664439    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scqgw\" (UniqueName: \"kubernetes.io/projected/8aae53f6-74f0-4b50-8695-1b98b7b1ca2a-kube-api-access-scqgw\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:45:46.236054 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:46.235982    2562 generic.go:356] "Generic (PLEG): container finished" podID="8aae53f6-74f0-4b50-8695-1b98b7b1ca2a" containerID="302e92b48aa5f327b696d58611a5e4e1ca42ff8d1d267623d87874759bba7abe" exitCode=0
Jul 09 01:45:46.236718 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:46.236063    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-v2556" event={"ID":"8aae53f6-74f0-4b50-8695-1b98b7b1ca2a","Type":"ContainerDied","Data":"302e92b48aa5f327b696d58611a5e4e1ca42ff8d1d267623d87874759bba7abe"}
Jul 09 01:45:46.236718 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:46.236114    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-v2556"
Jul 09 01:45:46.236718 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:46.236123    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-v2556" event={"ID":"8aae53f6-74f0-4b50-8695-1b98b7b1ca2a","Type":"ContainerDied","Data":"6dbcf03458fdee6bc543165babef0c7fc1baef636cd5ad85d15dfb66a2388286"}
Jul 09 01:45:46.236718 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:46.236147    2562 scope.go:117] "RemoveContainer" containerID="302e92b48aa5f327b696d58611a5e4e1ca42ff8d1d267623d87874759bba7abe"
Jul 09 01:45:46.239730 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:46.238754    2562 generic.go:356] "Generic (PLEG): container finished" podID="a86bbe5d-f3cb-43cf-8797-f7f7102ca072" containerID="c590d0eec424dcc91cd422cbb2380a16cdcbe3c476e41ad9bcc1bfec0dbd1c87" exitCode=0
Jul 09 01:45:46.239730 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:46.238850    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58c97d84c9-5tqv7"
Jul 09 01:45:46.239730 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:46.238893    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cv9d8" event={"ID":"a86bbe5d-f3cb-43cf-8797-f7f7102ca072","Type":"ContainerDied","Data":"c590d0eec424dcc91cd422cbb2380a16cdcbe3c476e41ad9bcc1bfec0dbd1c87"}
Jul 09 01:45:46.239730 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:46.238936    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cv9d8" event={"ID":"a86bbe5d-f3cb-43cf-8797-f7f7102ca072","Type":"ContainerDied","Data":"59894b41f3ffe47f4e34c066b2ea7deb81f35e281d9a2a6386a266953bfc6c91"}
Jul 09 01:45:46.239730 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:46.239638    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cv9d8"
Jul 09 01:45:46.249613 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:46.249593    2562 scope.go:117] "RemoveContainer" containerID="302e92b48aa5f327b696d58611a5e4e1ca42ff8d1d267623d87874759bba7abe"
Jul 09 01:45:46.249947 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:45:46.249930    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"302e92b48aa5f327b696d58611a5e4e1ca42ff8d1d267623d87874759bba7abe\": container with ID starting with 302e92b48aa5f327b696d58611a5e4e1ca42ff8d1d267623d87874759bba7abe not found: ID does not exist" containerID="302e92b48aa5f327b696d58611a5e4e1ca42ff8d1d267623d87874759bba7abe"
Jul 09 01:45:46.250067 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:46.249955    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"302e92b48aa5f327b696d58611a5e4e1ca42ff8d1d267623d87874759bba7abe"} err="failed to get container status \"302e92b48aa5f327b696d58611a5e4e1ca42ff8d1d267623d87874759bba7abe\": rpc error: code = NotFound desc = could not find container \"302e92b48aa5f327b696d58611a5e4e1ca42ff8d1d267623d87874759bba7abe\": container with ID starting with 302e92b48aa5f327b696d58611a5e4e1ca42ff8d1d267623d87874759bba7abe not found: ID does not exist"
Jul 09 01:45:46.250067 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:46.249972    2562 scope.go:117] "RemoveContainer" containerID="c590d0eec424dcc91cd422cbb2380a16cdcbe3c476e41ad9bcc1bfec0dbd1c87"
Jul 09 01:45:46.260452 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:46.260234    2562 scope.go:117] "RemoveContainer" containerID="c590d0eec424dcc91cd422cbb2380a16cdcbe3c476e41ad9bcc1bfec0dbd1c87"
Jul 09 01:45:46.260659 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:45:46.260629    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c590d0eec424dcc91cd422cbb2380a16cdcbe3c476e41ad9bcc1bfec0dbd1c87\": container with ID starting with c590d0eec424dcc91cd422cbb2380a16cdcbe3c476e41ad9bcc1bfec0dbd1c87 not found: ID does not exist" containerID="c590d0eec424dcc91cd422cbb2380a16cdcbe3c476e41ad9bcc1bfec0dbd1c87"
Jul 09 01:45:46.260834 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:46.260669    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c590d0eec424dcc91cd422cbb2380a16cdcbe3c476e41ad9bcc1bfec0dbd1c87"} err="failed to get container status \"c590d0eec424dcc91cd422cbb2380a16cdcbe3c476e41ad9bcc1bfec0dbd1c87\": rpc error: code = NotFound desc = could not find container \"c590d0eec424dcc91cd422cbb2380a16cdcbe3c476e41ad9bcc1bfec0dbd1c87\": container with ID starting with c590d0eec424dcc91cd422cbb2380a16cdcbe3c476e41ad9bcc1bfec0dbd1c87 not found: ID does not exist"
Jul 09 01:45:46.260834 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:46.260796    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-v2556"]
Jul 09 01:45:46.262513 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:46.262494    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-v2556"]
Jul 09 01:45:46.277748 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:46.277705    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cv9d8"]
Jul 09 01:45:46.277748 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:46.277750    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cv9d8"]
Jul 09 01:45:46.298663 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:46.298610    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58c97d84c9-5tqv7"]
Jul 09 01:45:46.301843 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:46.301813    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58c97d84c9-5tqv7"]
Jul 09 01:45:48.157073 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:48.157039    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f3d89a9-c31c-4679-9bc4-0f478077d1d4" path="/var/lib/kubelet/pods/6f3d89a9-c31c-4679-9bc4-0f478077d1d4/volumes"
Jul 09 01:45:48.157412 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:48.157297    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8aae53f6-74f0-4b50-8695-1b98b7b1ca2a" path="/var/lib/kubelet/pods/8aae53f6-74f0-4b50-8695-1b98b7b1ca2a/volumes"
Jul 09 01:45:48.157598 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:45:48.157585    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a86bbe5d-f3cb-43cf-8797-f7f7102ca072" path="/var/lib/kubelet/pods/a86bbe5d-f3cb-43cf-8797-f7f7102ca072/volumes"
Jul 09 01:46:25.897735 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:25.897696    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-jp6pj"]
Jul 09 01:46:25.898178 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:25.898104    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a86bbe5d-f3cb-43cf-8797-f7f7102ca072" containerName="authorino"
Jul 09 01:46:25.898178 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:25.898117    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a86bbe5d-f3cb-43cf-8797-f7f7102ca072" containerName="authorino"
Jul 09 01:46:25.898178 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:25.898132    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aae53f6-74f0-4b50-8695-1b98b7b1ca2a" containerName="authorino"
Jul 09 01:46:25.898178 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:25.898138    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aae53f6-74f0-4b50-8695-1b98b7b1ca2a" containerName="authorino"
Jul 09 01:46:25.898360 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:25.898200    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a86bbe5d-f3cb-43cf-8797-f7f7102ca072" containerName="authorino"
Jul 09 01:46:25.898360 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:25.898208    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8aae53f6-74f0-4b50-8695-1b98b7b1ca2a" containerName="authorino"
Jul 09 01:46:25.902551 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:25.902535    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-jp6pj"
Jul 09 01:46:25.905249 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:25.905228    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-x87hv\""
Jul 09 01:46:25.905372 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:25.905230    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 09 01:46:25.910991 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:25.910967    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-jp6pj"]
Jul 09 01:46:25.931643 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:25.931599    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c87da6b1-1098-48e0-838c-2f0ab998d08b-plugins-config-volume\") pod \"payload-pre-processing-7964457696-jp6pj\" (UID: \"c87da6b1-1098-48e0-838c-2f0ab998d08b\") " pod="openshift-ingress/payload-pre-processing-7964457696-jp6pj"
Jul 09 01:46:25.931763 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:25.931659    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92xpv\" (UniqueName: \"kubernetes.io/projected/c87da6b1-1098-48e0-838c-2f0ab998d08b-kube-api-access-92xpv\") pod \"payload-pre-processing-7964457696-jp6pj\" (UID: \"c87da6b1-1098-48e0-838c-2f0ab998d08b\") " pod="openshift-ingress/payload-pre-processing-7964457696-jp6pj"
Jul 09 01:46:26.032822 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:26.032789    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c87da6b1-1098-48e0-838c-2f0ab998d08b-plugins-config-volume\") pod \"payload-pre-processing-7964457696-jp6pj\" (UID: \"c87da6b1-1098-48e0-838c-2f0ab998d08b\") " pod="openshift-ingress/payload-pre-processing-7964457696-jp6pj"
Jul 09 01:46:26.032986 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:26.032847    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92xpv\" (UniqueName: \"kubernetes.io/projected/c87da6b1-1098-48e0-838c-2f0ab998d08b-kube-api-access-92xpv\") pod \"payload-pre-processing-7964457696-jp6pj\" (UID: \"c87da6b1-1098-48e0-838c-2f0ab998d08b\") " pod="openshift-ingress/payload-pre-processing-7964457696-jp6pj"
Jul 09 01:46:26.033610 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:26.033583    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c87da6b1-1098-48e0-838c-2f0ab998d08b-plugins-config-volume\") pod \"payload-pre-processing-7964457696-jp6pj\" (UID: \"c87da6b1-1098-48e0-838c-2f0ab998d08b\") " pod="openshift-ingress/payload-pre-processing-7964457696-jp6pj"
Jul 09 01:46:26.041394 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:26.041374    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92xpv\" (UniqueName: \"kubernetes.io/projected/c87da6b1-1098-48e0-838c-2f0ab998d08b-kube-api-access-92xpv\") pod \"payload-pre-processing-7964457696-jp6pj\" (UID: \"c87da6b1-1098-48e0-838c-2f0ab998d08b\") " pod="openshift-ingress/payload-pre-processing-7964457696-jp6pj"
Jul 09 01:46:26.213799 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:26.213711    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-jp6pj"
Jul 09 01:46:26.339112 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:26.339088    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-jp6pj"]
Jul 09 01:46:26.341051 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:46:26.340994    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc87da6b1_1098_48e0_838c_2f0ab998d08b.slice/crio-2ec6f5862c5bb8137a186300b47d902f9c305870201a9823df26515cdf70ea68 WatchSource:0}: Error finding container 2ec6f5862c5bb8137a186300b47d902f9c305870201a9823df26515cdf70ea68: Status 404 returned error can't find the container with id 2ec6f5862c5bb8137a186300b47d902f9c305870201a9823df26515cdf70ea68
Jul 09 01:46:26.436240 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:26.436201    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-jp6pj" event={"ID":"c87da6b1-1098-48e0-838c-2f0ab998d08b","Type":"ContainerStarted","Data":"2ec6f5862c5bb8137a186300b47d902f9c305870201a9823df26515cdf70ea68"}
Jul 09 01:46:28.447211 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:28.447169    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-jp6pj" event={"ID":"c87da6b1-1098-48e0-838c-2f0ab998d08b","Type":"ContainerStarted","Data":"d5fb2606568b9a7375f7909362718ea7edf7bccdf88d0dbe3539834b0dc09d24"}
Jul 09 01:46:28.447635 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:28.447293    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-jp6pj"
Jul 09 01:46:28.464555 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:28.464509    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-jp6pj" podStartSLOduration=2.156698642 podStartE2EDuration="3.464495365s" totalImagesPullingTime="1.307796723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:46:28.462407537 +0000 UTC m=+486.674059875" watchObservedRunningTime="2026-07-09 01:46:28.464495365 +0000 UTC m=+486.676147718"
Jul 09 01:46:39.453193 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:39.453159    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-jp6pj"
Jul 09 01:46:47.645592 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.645557    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"]
Jul 09 01:46:47.649245 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.649225    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"
Jul 09 01:46:47.654270 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.654048    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 01:46:47.655391 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.654773    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wtkjc\""
Jul 09 01:46:47.655391 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.655156    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 01:46:47.655582 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.655562    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 09 01:46:47.660599 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.660576    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"]
Jul 09 01:46:47.728769 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.728731    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl47c\" (UniqueName: \"kubernetes.io/projected/c91ee496-548e-4d22-9eb5-2cf75776708c-kube-api-access-wl47c\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb\" (UID: \"c91ee496-548e-4d22-9eb5-2cf75776708c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"
Jul 09 01:46:47.728924 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.728786    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c91ee496-548e-4d22-9eb5-2cf75776708c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb\" (UID: \"c91ee496-548e-4d22-9eb5-2cf75776708c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"
Jul 09 01:46:47.728924 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.728869    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c91ee496-548e-4d22-9eb5-2cf75776708c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb\" (UID: \"c91ee496-548e-4d22-9eb5-2cf75776708c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"
Jul 09 01:46:47.728924 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.728912    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c91ee496-548e-4d22-9eb5-2cf75776708c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb\" (UID: \"c91ee496-548e-4d22-9eb5-2cf75776708c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"
Jul 09 01:46:47.729053 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.728934    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c91ee496-548e-4d22-9eb5-2cf75776708c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb\" (UID: \"c91ee496-548e-4d22-9eb5-2cf75776708c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"
Jul 09 01:46:47.729053 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.728983    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c91ee496-548e-4d22-9eb5-2cf75776708c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb\" (UID: \"c91ee496-548e-4d22-9eb5-2cf75776708c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"
Jul 09 01:46:47.830061 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.830008    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c91ee496-548e-4d22-9eb5-2cf75776708c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb\" (UID: \"c91ee496-548e-4d22-9eb5-2cf75776708c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"
Jul 09 01:46:47.830220 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.830079    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c91ee496-548e-4d22-9eb5-2cf75776708c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb\" (UID: \"c91ee496-548e-4d22-9eb5-2cf75776708c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"
Jul 09 01:46:47.830220 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.830118    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c91ee496-548e-4d22-9eb5-2cf75776708c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb\" (UID: \"c91ee496-548e-4d22-9eb5-2cf75776708c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"
Jul 09 01:46:47.830220 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.830150    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c91ee496-548e-4d22-9eb5-2cf75776708c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb\" (UID: \"c91ee496-548e-4d22-9eb5-2cf75776708c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"
Jul 09 01:46:47.830220 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.830183    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c91ee496-548e-4d22-9eb5-2cf75776708c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb\" (UID: \"c91ee496-548e-4d22-9eb5-2cf75776708c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"
Jul 09 01:46:47.830423 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.830315    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl47c\" (UniqueName: \"kubernetes.io/projected/c91ee496-548e-4d22-9eb5-2cf75776708c-kube-api-access-wl47c\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb\" (UID: \"c91ee496-548e-4d22-9eb5-2cf75776708c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"
Jul 09 01:46:47.830486 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.830470    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c91ee496-548e-4d22-9eb5-2cf75776708c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb\" (UID: \"c91ee496-548e-4d22-9eb5-2cf75776708c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"
Jul 09 01:46:47.830567 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.830548    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c91ee496-548e-4d22-9eb5-2cf75776708c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb\" (UID: \"c91ee496-548e-4d22-9eb5-2cf75776708c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"
Jul 09 01:46:47.830692 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.830662    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c91ee496-548e-4d22-9eb5-2cf75776708c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb\" (UID: \"c91ee496-548e-4d22-9eb5-2cf75776708c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"
Jul 09 01:46:47.832445 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.832420    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c91ee496-548e-4d22-9eb5-2cf75776708c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb\" (UID: \"c91ee496-548e-4d22-9eb5-2cf75776708c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"
Jul 09 01:46:47.832684 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.832669    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c91ee496-548e-4d22-9eb5-2cf75776708c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb\" (UID: \"c91ee496-548e-4d22-9eb5-2cf75776708c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"
Jul 09 01:46:47.837787 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.837766    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl47c\" (UniqueName: \"kubernetes.io/projected/c91ee496-548e-4d22-9eb5-2cf75776708c-kube-api-access-wl47c\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb\" (UID: \"c91ee496-548e-4d22-9eb5-2cf75776708c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"
Jul 09 01:46:47.964352 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:47.964263    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"
Jul 09 01:46:48.097831 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:48.097681    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"]
Jul 09 01:46:48.100505 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:46:48.100468    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc91ee496_548e_4d22_9eb5_2cf75776708c.slice/crio-e648ca06f2df7418a00d2e50cb4da7e4d4a33d425bdfcacf8a9485757768488e WatchSource:0}: Error finding container e648ca06f2df7418a00d2e50cb4da7e4d4a33d425bdfcacf8a9485757768488e: Status 404 returned error can't find the container with id e648ca06f2df7418a00d2e50cb4da7e4d4a33d425bdfcacf8a9485757768488e
Jul 09 01:46:48.543280 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:48.543183    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb" event={"ID":"c91ee496-548e-4d22-9eb5-2cf75776708c","Type":"ContainerStarted","Data":"e648ca06f2df7418a00d2e50cb4da7e4d4a33d425bdfcacf8a9485757768488e"}
Jul 09 01:46:49.550436 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:49.550403    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb" event={"ID":"c91ee496-548e-4d22-9eb5-2cf75776708c","Type":"ContainerStarted","Data":"8952dc5848f15c4de19323426d813830c9930999d01894c05ebf1109de93dd0c"}
Jul 09 01:46:49.570976 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:49.570871    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb" podStartSLOduration=1.355938375 podStartE2EDuration="2.570848707s" totalImagesPullingTime="1.214910332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:46:49.569345327 +0000 UTC m=+507.780997675" watchObservedRunningTime="2026-07-09 01:46:49.570848707 +0000 UTC m=+507.782501044"
Jul 09 01:46:57.964715 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:57.964666    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"
Jul 09 01:46:57.965359 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:57.964756    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"
Jul 09 01:46:57.977796 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:57.977763    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"
Jul 09 01:46:58.603216 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:46:58.603186    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb"
Jul 09 01:47:47.369709 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:47.369608    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"]
Jul 09 01:47:47.373115 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:47.373092    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"
Jul 09 01:47:47.375844 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:47.375823    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 09 01:47:47.382264 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:47.382242    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"]
Jul 09 01:47:47.559343 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:47.559284    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg\" (UID: \"1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"
Jul 09 01:47:47.559526 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:47.559373    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg\" (UID: \"1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"
Jul 09 01:47:47.559526 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:47.559419    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg\" (UID: \"1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"
Jul 09 01:47:47.559526 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:47.559435    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfw6n\" (UniqueName: \"kubernetes.io/projected/1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d-kube-api-access-zfw6n\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg\" (UID: \"1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"
Jul 09 01:47:47.559526 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:47.559489    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg\" (UID: \"1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"
Jul 09 01:47:47.559526 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:47.559511    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg\" (UID: \"1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"
Jul 09 01:47:47.660286 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:47.660180    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg\" (UID: \"1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"
Jul 09 01:47:47.660286 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:47.660236    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfw6n\" (UniqueName: \"kubernetes.io/projected/1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d-kube-api-access-zfw6n\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg\" (UID: \"1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"
Jul 09 01:47:47.660286 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:47.660272    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg\" (UID: \"1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"
Jul 09 01:47:47.660583 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:47.660374    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg\" (UID: \"1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"
Jul 09 01:47:47.660583 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:47.660443    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg\" (UID: \"1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"
Jul 09 01:47:47.660583 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:47.660512    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg\" (UID: \"1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"
Jul 09 01:47:47.660731 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:47.660689    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg\" (UID: \"1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"
Jul 09 01:47:47.660791 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:47.660767    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg\" (UID: \"1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"
Jul 09 01:47:47.660841 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:47.660824    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg\" (UID: \"1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"
Jul 09 01:47:47.662601 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:47.662576    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg\" (UID: \"1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"
Jul 09 01:47:47.662835 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:47.662816    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg\" (UID: \"1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"
Jul 09 01:47:47.668912 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:47.668886    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfw6n\" (UniqueName: \"kubernetes.io/projected/1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d-kube-api-access-zfw6n\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg\" (UID: \"1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"
Jul 09 01:47:47.684651 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:47.684620    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"
Jul 09 01:47:47.817803 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:47.817769    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"]
Jul 09 01:47:47.820182 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:47:47.820158    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b4d62d4_1f91_455d_b8ec_9a37bc8fc06d.slice/crio-2dfa98dc7c8149eb2c2ddc488fdef21f558e9a55cf77ae64a173466b405bcff0 WatchSource:0}: Error finding container 2dfa98dc7c8149eb2c2ddc488fdef21f558e9a55cf77ae64a173466b405bcff0: Status 404 returned error can't find the container with id 2dfa98dc7c8149eb2c2ddc488fdef21f558e9a55cf77ae64a173466b405bcff0
Jul 09 01:47:48.824314 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:48.824277    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg" event={"ID":"1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d","Type":"ContainerStarted","Data":"3d90ff15c1afaf9da730c530328c3935fc6ee0aec64b69a5309a0b4b240d2d6d"}
Jul 09 01:47:48.824314 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:48.824319    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg" event={"ID":"1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d","Type":"ContainerStarted","Data":"2dfa98dc7c8149eb2c2ddc488fdef21f558e9a55cf77ae64a173466b405bcff0"}
Jul 09 01:47:48.841540 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:48.841490    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg" podStartSLOduration=1.665148222 podStartE2EDuration="1.841474554s" totalImagesPullingTime="176.326332ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:47:48.83998444 +0000 UTC m=+567.051636775" watchObservedRunningTime="2026-07-09 01:47:48.841474554 +0000 UTC m=+567.053126889"
Jul 09 01:47:57.685438 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:57.685399    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"
Jul 09 01:47:57.685922 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:57.685459    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"
Jul 09 01:47:57.697537 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:57.697506    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"
Jul 09 01:47:57.877786 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:47:57.877763    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg"
Jul 09 01:48:46.691673 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:46.691601    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557ccdfbdb-xqd44"]
Jul 09 01:48:46.695205 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:46.695186    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557ccdfbdb-xqd44"
Jul 09 01:48:46.701784 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:46.701761    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557ccdfbdb-xqd44"]
Jul 09 01:48:46.749081 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:46.749047    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2131b1c9-fb62-441f-9a94-3e6925034e86-tls-cert\") pod \"authorino-557ccdfbdb-xqd44\" (UID: \"2131b1c9-fb62-441f-9a94-3e6925034e86\") " pod="kuadrant-system/authorino-557ccdfbdb-xqd44"
Jul 09 01:48:46.749223 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:46.749093    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfdjv\" (UniqueName: \"kubernetes.io/projected/2131b1c9-fb62-441f-9a94-3e6925034e86-kube-api-access-tfdjv\") pod \"authorino-557ccdfbdb-xqd44\" (UID: \"2131b1c9-fb62-441f-9a94-3e6925034e86\") " pod="kuadrant-system/authorino-557ccdfbdb-xqd44"
Jul 09 01:48:46.849855 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:46.849819    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfdjv\" (UniqueName: \"kubernetes.io/projected/2131b1c9-fb62-441f-9a94-3e6925034e86-kube-api-access-tfdjv\") pod \"authorino-557ccdfbdb-xqd44\" (UID: \"2131b1c9-fb62-441f-9a94-3e6925034e86\") " pod="kuadrant-system/authorino-557ccdfbdb-xqd44"
Jul 09 01:48:46.850050 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:46.849932    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2131b1c9-fb62-441f-9a94-3e6925034e86-tls-cert\") pod \"authorino-557ccdfbdb-xqd44\" (UID: \"2131b1c9-fb62-441f-9a94-3e6925034e86\") " pod="kuadrant-system/authorino-557ccdfbdb-xqd44"
Jul 09 01:48:46.852241 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:46.852218    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2131b1c9-fb62-441f-9a94-3e6925034e86-tls-cert\") pod \"authorino-557ccdfbdb-xqd44\" (UID: \"2131b1c9-fb62-441f-9a94-3e6925034e86\") " pod="kuadrant-system/authorino-557ccdfbdb-xqd44"
Jul 09 01:48:46.859574 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:46.859554    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfdjv\" (UniqueName: \"kubernetes.io/projected/2131b1c9-fb62-441f-9a94-3e6925034e86-kube-api-access-tfdjv\") pod \"authorino-557ccdfbdb-xqd44\" (UID: \"2131b1c9-fb62-441f-9a94-3e6925034e86\") " pod="kuadrant-system/authorino-557ccdfbdb-xqd44"
Jul 09 01:48:47.004612 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:47.004541    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557ccdfbdb-xqd44"
Jul 09 01:48:47.135068 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:47.135043    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557ccdfbdb-xqd44"]
Jul 09 01:48:47.137524 ip-10-0-138-200 kubenswrapper[2562]: W0709 01:48:47.137496    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2131b1c9_fb62_441f_9a94_3e6925034e86.slice/crio-6bf4ca37ddc6a98ade957aa58f65460e7b070cd8006c06c903e8fdf1789cc190 WatchSource:0}: Error finding container 6bf4ca37ddc6a98ade957aa58f65460e7b070cd8006c06c903e8fdf1789cc190: Status 404 returned error can't find the container with id 6bf4ca37ddc6a98ade957aa58f65460e7b070cd8006c06c903e8fdf1789cc190
Jul 09 01:48:48.105832 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:48.105786    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557ccdfbdb-xqd44" event={"ID":"2131b1c9-fb62-441f-9a94-3e6925034e86","Type":"ContainerStarted","Data":"7c6f4dbf9705ca2532682c1e2a701ec7bc1acbdf1f222e7a557a04f7b19c1f93"}
Jul 09 01:48:48.106337 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:48.105844    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557ccdfbdb-xqd44" event={"ID":"2131b1c9-fb62-441f-9a94-3e6925034e86","Type":"ContainerStarted","Data":"6bf4ca37ddc6a98ade957aa58f65460e7b070cd8006c06c903e8fdf1789cc190"}
Jul 09 01:48:48.126309 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:48.126255    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-557ccdfbdb-xqd44" podStartSLOduration=1.712333747 podStartE2EDuration="2.126238711s" totalImagesPullingTime="413.904964ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:48:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:48:48.124087301 +0000 UTC m=+626.335739649" watchObservedRunningTime="2026-07-09 01:48:48.126238711 +0000 UTC m=+626.337891080"
Jul 09 01:48:48.164775 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:48.164737    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-55766c4f59-wsjrk"]
Jul 09 01:48:48.164967 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:48.164941    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-55766c4f59-wsjrk" podUID="bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b" containerName="authorino" containerID="cri-o://f4896631ec40dc4cd3446016cb8ae2fb8cfd7fd36acd20cacfe2d0582ba908cb" gracePeriod=30
Jul 09 01:48:48.425707 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:48.425677    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55766c4f59-wsjrk"
Jul 09 01:48:48.466829 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:48.466793    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b-tls-cert\") pod \"bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b\" (UID: \"bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b\") "
Jul 09 01:48:48.467011 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:48.466874    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcb5v\" (UniqueName: \"kubernetes.io/projected/bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b-kube-api-access-fcb5v\") pod \"bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b\" (UID: \"bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b\") "
Jul 09 01:48:48.468960 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:48.468921    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b-kube-api-access-fcb5v" (OuterVolumeSpecName: "kube-api-access-fcb5v") pod "bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b" (UID: "bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b"). InnerVolumeSpecName "kube-api-access-fcb5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:48:48.477713 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:48.477684    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b" (UID: "bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:48:48.568258 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:48.568212    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcb5v\" (UniqueName: \"kubernetes.io/projected/bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b-kube-api-access-fcb5v\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:48:48.568258 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:48.568255    2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b-tls-cert\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 01:48:49.112560 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:49.112468    2562 generic.go:356] "Generic (PLEG): container finished" podID="bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b" containerID="f4896631ec40dc4cd3446016cb8ae2fb8cfd7fd36acd20cacfe2d0582ba908cb" exitCode=0
Jul 09 01:48:49.112560 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:49.112513    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55766c4f59-wsjrk"
Jul 09 01:48:49.113010 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:49.112554    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55766c4f59-wsjrk" event={"ID":"bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b","Type":"ContainerDied","Data":"f4896631ec40dc4cd3446016cb8ae2fb8cfd7fd36acd20cacfe2d0582ba908cb"}
Jul 09 01:48:49.113010 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:49.112597    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55766c4f59-wsjrk" event={"ID":"bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b","Type":"ContainerDied","Data":"345b56c735a91744bd8772ec9fd3a3f21fba4c7622a2067389e15ba80dc43959"}
Jul 09 01:48:49.113010 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:49.112613    2562 scope.go:117] "RemoveContainer" containerID="f4896631ec40dc4cd3446016cb8ae2fb8cfd7fd36acd20cacfe2d0582ba908cb"
Jul 09 01:48:49.122264 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:49.122247    2562 scope.go:117] "RemoveContainer" containerID="f4896631ec40dc4cd3446016cb8ae2fb8cfd7fd36acd20cacfe2d0582ba908cb"
Jul 09 01:48:49.122525 ip-10-0-138-200 kubenswrapper[2562]: E0709 01:48:49.122504    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4896631ec40dc4cd3446016cb8ae2fb8cfd7fd36acd20cacfe2d0582ba908cb\": container with ID starting with f4896631ec40dc4cd3446016cb8ae2fb8cfd7fd36acd20cacfe2d0582ba908cb not found: ID does not exist" containerID="f4896631ec40dc4cd3446016cb8ae2fb8cfd7fd36acd20cacfe2d0582ba908cb"
Jul 09 01:48:49.122591 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:49.122534    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4896631ec40dc4cd3446016cb8ae2fb8cfd7fd36acd20cacfe2d0582ba908cb"} err="failed to get container status \"f4896631ec40dc4cd3446016cb8ae2fb8cfd7fd36acd20cacfe2d0582ba908cb\": rpc error: code = NotFound desc = could not find container \"f4896631ec40dc4cd3446016cb8ae2fb8cfd7fd36acd20cacfe2d0582ba908cb\": container with ID starting with f4896631ec40dc4cd3446016cb8ae2fb8cfd7fd36acd20cacfe2d0582ba908cb not found: ID does not exist"
Jul 09 01:48:49.135633 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:49.135605    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-55766c4f59-wsjrk"]
Jul 09 01:48:49.139568 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:49.139545    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-55766c4f59-wsjrk"]
Jul 09 01:48:50.158415 ip-10-0-138-200 kubenswrapper[2562]: I0709 01:48:50.158383    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b" path="/var/lib/kubelet/pods/bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b/volumes"
Jul 09 02:00:00.157377 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:00:00.157352    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726040-5ww8j"]
Jul 09 02:00:00.159880 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:00:00.157708    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b" containerName="authorino"
Jul 09 02:00:00.159880 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:00:00.157720    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b" containerName="authorino"
Jul 09 02:00:00.159880 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:00:00.157791    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf980975-36ed-4a0a-b53f-5ecf8c7c1a6b" containerName="authorino"
Jul 09 02:00:00.160822 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:00:00.160808    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726040-5ww8j"
Jul 09 02:00:00.163751 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:00:00.163732    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 02:00:00.163860 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:00:00.163798    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dmx8z\""
Jul 09 02:00:00.165043 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:00:00.165010    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 02:00:00.170152 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:00:00.170130    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726040-5ww8j"]
Jul 09 02:00:00.300946 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:00:00.300923    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls7sk\" (UniqueName: \"kubernetes.io/projected/a728b61e-4141-43ee-911b-a131b60b6f35-kube-api-access-ls7sk\") pod \"maas-api-key-cleanup-29726040-5ww8j\" (UID: \"a728b61e-4141-43ee-911b-a131b60b6f35\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726040-5ww8j"
Jul 09 02:00:00.401370 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:00:00.401340    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls7sk\" (UniqueName: \"kubernetes.io/projected/a728b61e-4141-43ee-911b-a131b60b6f35-kube-api-access-ls7sk\") pod \"maas-api-key-cleanup-29726040-5ww8j\" (UID: \"a728b61e-4141-43ee-911b-a131b60b6f35\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726040-5ww8j"
Jul 09 02:00:00.410490 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:00:00.410440    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls7sk\" (UniqueName: \"kubernetes.io/projected/a728b61e-4141-43ee-911b-a131b60b6f35-kube-api-access-ls7sk\") pod \"maas-api-key-cleanup-29726040-5ww8j\" (UID: \"a728b61e-4141-43ee-911b-a131b60b6f35\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726040-5ww8j"
Jul 09 02:00:00.471090 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:00:00.471072    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726040-5ww8j"
Jul 09 02:00:00.598910 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:00:00.598879    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726040-5ww8j"]
Jul 09 02:00:00.601693 ip-10-0-138-200 kubenswrapper[2562]: W0709 02:00:00.601668    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda728b61e_4141_43ee_911b_a131b60b6f35.slice/crio-71dcec4aa1097d0a68eaa2faae02d0c4db48d2e51cf8cb2526406a2a85faf8f8 WatchSource:0}: Error finding container 71dcec4aa1097d0a68eaa2faae02d0c4db48d2e51cf8cb2526406a2a85faf8f8: Status 404 returned error can't find the container with id 71dcec4aa1097d0a68eaa2faae02d0c4db48d2e51cf8cb2526406a2a85faf8f8
Jul 09 02:00:00.603858 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:00:00.603840    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 02:00:01.339677 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:00:01.339644    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726040-5ww8j" event={"ID":"a728b61e-4141-43ee-911b-a131b60b6f35","Type":"ContainerStarted","Data":"71dcec4aa1097d0a68eaa2faae02d0c4db48d2e51cf8cb2526406a2a85faf8f8"}
Jul 09 02:00:06.365884 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:00:06.365850    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726040-5ww8j" event={"ID":"a728b61e-4141-43ee-911b-a131b60b6f35","Type":"ContainerStarted","Data":"a33753f48542a99c680220e8072c70aa22eeccd05015761bd168577cdac41b0a"}
Jul 09 02:00:06.383335 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:00:06.383284    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726040-5ww8j" podStartSLOduration=0.978408226 podStartE2EDuration="6.383269482s" totalImagesPullingTime="5.404861256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:00:06.382329226 +0000 UTC m=+1304.593981564" watchObservedRunningTime="2026-07-09 02:00:06.383269482 +0000 UTC m=+1304.594921818"
Jul 09 02:01:00.011336 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:01:00.011258    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726040-5ww8j"]
Jul 09 02:01:00.011790 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:01:00.011458    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726040-5ww8j" podUID="a728b61e-4141-43ee-911b-a131b60b6f35" containerName="cleanup" containerID="cri-o://a33753f48542a99c680220e8072c70aa22eeccd05015761bd168577cdac41b0a" gracePeriod=30
Jul 09 02:01:30.199498 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:01:30.199470    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726040-5ww8j"
Jul 09 02:01:30.288142 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:01:30.288057    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ls7sk\" (UniqueName: \"kubernetes.io/projected/a728b61e-4141-43ee-911b-a131b60b6f35-kube-api-access-ls7sk\") pod \"a728b61e-4141-43ee-911b-a131b60b6f35\" (UID: \"a728b61e-4141-43ee-911b-a131b60b6f35\") "
Jul 09 02:01:30.290137 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:01:30.290106    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a728b61e-4141-43ee-911b-a131b60b6f35-kube-api-access-ls7sk" (OuterVolumeSpecName: "kube-api-access-ls7sk") pod "a728b61e-4141-43ee-911b-a131b60b6f35" (UID: "a728b61e-4141-43ee-911b-a131b60b6f35"). InnerVolumeSpecName "kube-api-access-ls7sk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:01:30.389413 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:01:30.389365    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ls7sk\" (UniqueName: \"kubernetes.io/projected/a728b61e-4141-43ee-911b-a131b60b6f35-kube-api-access-ls7sk\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:01:30.778477 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:01:30.778440    2562 generic.go:356] "Generic (PLEG): container finished" podID="a728b61e-4141-43ee-911b-a131b60b6f35" containerID="a33753f48542a99c680220e8072c70aa22eeccd05015761bd168577cdac41b0a" exitCode=137
Jul 09 02:01:30.778667 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:01:30.778486    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726040-5ww8j"
Jul 09 02:01:30.778667 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:01:30.778514    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726040-5ww8j" event={"ID":"a728b61e-4141-43ee-911b-a131b60b6f35","Type":"ContainerDied","Data":"a33753f48542a99c680220e8072c70aa22eeccd05015761bd168577cdac41b0a"}
Jul 09 02:01:30.778667 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:01:30.778564    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726040-5ww8j" event={"ID":"a728b61e-4141-43ee-911b-a131b60b6f35","Type":"ContainerDied","Data":"71dcec4aa1097d0a68eaa2faae02d0c4db48d2e51cf8cb2526406a2a85faf8f8"}
Jul 09 02:01:30.778667 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:01:30.778591    2562 scope.go:117] "RemoveContainer" containerID="a33753f48542a99c680220e8072c70aa22eeccd05015761bd168577cdac41b0a"
Jul 09 02:01:30.789410 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:01:30.789388    2562 scope.go:117] "RemoveContainer" containerID="a33753f48542a99c680220e8072c70aa22eeccd05015761bd168577cdac41b0a"
Jul 09 02:01:30.789793 ip-10-0-138-200 kubenswrapper[2562]: E0709 02:01:30.789771    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a33753f48542a99c680220e8072c70aa22eeccd05015761bd168577cdac41b0a\": container with ID starting with a33753f48542a99c680220e8072c70aa22eeccd05015761bd168577cdac41b0a not found: ID does not exist" containerID="a33753f48542a99c680220e8072c70aa22eeccd05015761bd168577cdac41b0a"
Jul 09 02:01:30.789880 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:01:30.789799    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a33753f48542a99c680220e8072c70aa22eeccd05015761bd168577cdac41b0a"} err="failed to get container status \"a33753f48542a99c680220e8072c70aa22eeccd05015761bd168577cdac41b0a\": rpc error: code = NotFound desc = could not find container \"a33753f48542a99c680220e8072c70aa22eeccd05015761bd168577cdac41b0a\": container with ID starting with a33753f48542a99c680220e8072c70aa22eeccd05015761bd168577cdac41b0a not found: ID does not exist"
Jul 09 02:01:30.804206 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:01:30.804180    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726040-5ww8j"]
Jul 09 02:01:30.810346 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:01:30.810319    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726040-5ww8j"]
Jul 09 02:01:32.156862 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:01:32.156833    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a728b61e-4141-43ee-911b-a131b60b6f35" path="/var/lib/kubelet/pods/a728b61e-4141-43ee-911b-a131b60b6f35/volumes"
Jul 09 02:04:33.217218 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:33.217174    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt"]
Jul 09 02:04:33.217827 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:33.217807    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a728b61e-4141-43ee-911b-a131b60b6f35" containerName="cleanup"
Jul 09 02:04:33.217873 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:33.217831    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a728b61e-4141-43ee-911b-a131b60b6f35" containerName="cleanup"
Jul 09 02:04:33.217946 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:33.217934    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a728b61e-4141-43ee-911b-a131b60b6f35" containerName="cleanup"
Jul 09 02:04:33.221478 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:33.221460    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt"
Jul 09 02:04:33.224352 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:33.224325    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-51c9da2a-serving-cert\""
Jul 09 02:04:33.224488 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:33.224329    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 02:04:33.224488 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:33.224334    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dmx8z\""
Jul 09 02:04:33.225518 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:33.225499    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 02:04:33.231244 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:33.231220    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt"]
Jul 09 02:04:33.365745 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:33.365710    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrq6s\" (UniqueName: \"kubernetes.io/projected/da84a0b9-d02a-44be-8735-02230af22201-kube-api-access-qrq6s\") pod \"maas-api-e2e-mt-51c9da2a-cd878b457-6flbt\" (UID: \"da84a0b9-d02a-44be-8735-02230af22201\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt"
Jul 09 02:04:33.365923 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:33.365814    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da84a0b9-d02a-44be-8735-02230af22201-openshift-service-ca\") pod \"maas-api-e2e-mt-51c9da2a-cd878b457-6flbt\" (UID: \"da84a0b9-d02a-44be-8735-02230af22201\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt"
Jul 09 02:04:33.365923 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:33.365880    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da84a0b9-d02a-44be-8735-02230af22201-maas-api-tls\") pod \"maas-api-e2e-mt-51c9da2a-cd878b457-6flbt\" (UID: \"da84a0b9-d02a-44be-8735-02230af22201\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt"
Jul 09 02:04:33.467399 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:33.467311    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da84a0b9-d02a-44be-8735-02230af22201-maas-api-tls\") pod \"maas-api-e2e-mt-51c9da2a-cd878b457-6flbt\" (UID: \"da84a0b9-d02a-44be-8735-02230af22201\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt"
Jul 09 02:04:33.467399 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:33.467384    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrq6s\" (UniqueName: \"kubernetes.io/projected/da84a0b9-d02a-44be-8735-02230af22201-kube-api-access-qrq6s\") pod \"maas-api-e2e-mt-51c9da2a-cd878b457-6flbt\" (UID: \"da84a0b9-d02a-44be-8735-02230af22201\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt"
Jul 09 02:04:33.467587 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:33.467454    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da84a0b9-d02a-44be-8735-02230af22201-openshift-service-ca\") pod \"maas-api-e2e-mt-51c9da2a-cd878b457-6flbt\" (UID: \"da84a0b9-d02a-44be-8735-02230af22201\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt"
Jul 09 02:04:33.467587 ip-10-0-138-200 kubenswrapper[2562]: E0709 02:04:33.467502    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-serving-cert: secret "maas-api-e2e-mt-51c9da2a-serving-cert" not found
Jul 09 02:04:33.467587 ip-10-0-138-200 kubenswrapper[2562]: E0709 02:04:33.467579    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da84a0b9-d02a-44be-8735-02230af22201-maas-api-tls podName:da84a0b9-d02a-44be-8735-02230af22201 nodeName:}" failed. No retries permitted until 2026-07-09 02:04:33.967556782 +0000 UTC m=+1572.179209110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/da84a0b9-d02a-44be-8735-02230af22201-maas-api-tls") pod "maas-api-e2e-mt-51c9da2a-cd878b457-6flbt" (UID: "da84a0b9-d02a-44be-8735-02230af22201") : secret "maas-api-e2e-mt-51c9da2a-serving-cert" not found
Jul 09 02:04:33.468124 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:33.468105    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da84a0b9-d02a-44be-8735-02230af22201-openshift-service-ca\") pod \"maas-api-e2e-mt-51c9da2a-cd878b457-6flbt\" (UID: \"da84a0b9-d02a-44be-8735-02230af22201\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt"
Jul 09 02:04:33.479114 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:33.479091    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrq6s\" (UniqueName: \"kubernetes.io/projected/da84a0b9-d02a-44be-8735-02230af22201-kube-api-access-qrq6s\") pod \"maas-api-e2e-mt-51c9da2a-cd878b457-6flbt\" (UID: \"da84a0b9-d02a-44be-8735-02230af22201\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt"
Jul 09 02:04:33.970931 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:33.970875    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da84a0b9-d02a-44be-8735-02230af22201-maas-api-tls\") pod \"maas-api-e2e-mt-51c9da2a-cd878b457-6flbt\" (UID: \"da84a0b9-d02a-44be-8735-02230af22201\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt"
Jul 09 02:04:33.973280 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:33.973251    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da84a0b9-d02a-44be-8735-02230af22201-maas-api-tls\") pod \"maas-api-e2e-mt-51c9da2a-cd878b457-6flbt\" (UID: \"da84a0b9-d02a-44be-8735-02230af22201\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt"
Jul 09 02:04:34.134444 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:34.134412    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt"
Jul 09 02:04:34.273811 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:34.273781    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt"]
Jul 09 02:04:34.275990 ip-10-0-138-200 kubenswrapper[2562]: W0709 02:04:34.275964    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda84a0b9_d02a_44be_8735_02230af22201.slice/crio-fb09e23b49a85cd09a7923b9068566c570f5fa56a81c27ae7fe5f2d4defbf39f WatchSource:0}: Error finding container fb09e23b49a85cd09a7923b9068566c570f5fa56a81c27ae7fe5f2d4defbf39f: Status 404 returned error can't find the container with id fb09e23b49a85cd09a7923b9068566c570f5fa56a81c27ae7fe5f2d4defbf39f
Jul 09 02:04:34.638336 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:34.638300    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt" event={"ID":"da84a0b9-d02a-44be-8735-02230af22201","Type":"ContainerStarted","Data":"fb09e23b49a85cd09a7923b9068566c570f5fa56a81c27ae7fe5f2d4defbf39f"}
Jul 09 02:04:36.650260 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:36.650228    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt" event={"ID":"da84a0b9-d02a-44be-8735-02230af22201","Type":"ContainerStarted","Data":"3759043d6a107f0420ae22de34156660d46181e5ebd21c5b495b1ea438e5e6c4"}
Jul 09 02:04:36.650674 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:36.650336    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt"
Jul 09 02:04:36.668491 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:36.668434    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt" podStartSLOduration=1.692738913 podStartE2EDuration="3.668415389s" totalImagesPullingTime="1.975676476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:04:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:04:36.666972514 +0000 UTC m=+1574.878624851" watchObservedRunningTime="2026-07-09 02:04:36.668415389 +0000 UTC m=+1574.880067724"
Jul 09 02:04:42.660571 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:42.660543    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt"
Jul 09 02:04:45.465986 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:45.465951    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt"]
Jul 09 02:04:45.466421 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:45.466187    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt" podUID="da84a0b9-d02a-44be-8735-02230af22201" containerName="maas-api" containerID="cri-o://3759043d6a107f0420ae22de34156660d46181e5ebd21c5b495b1ea438e5e6c4" gracePeriod=30
Jul 09 02:04:45.693729 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:45.693693    2562 generic.go:356] "Generic (PLEG): container finished" podID="da84a0b9-d02a-44be-8735-02230af22201" containerID="3759043d6a107f0420ae22de34156660d46181e5ebd21c5b495b1ea438e5e6c4" exitCode=0
Jul 09 02:04:45.693857 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:45.693761    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt" event={"ID":"da84a0b9-d02a-44be-8735-02230af22201","Type":"ContainerDied","Data":"3759043d6a107f0420ae22de34156660d46181e5ebd21c5b495b1ea438e5e6c4"}
Jul 09 02:04:45.712932 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:45.712908    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt"
Jul 09 02:04:45.771922 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:45.771854    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrq6s\" (UniqueName: \"kubernetes.io/projected/da84a0b9-d02a-44be-8735-02230af22201-kube-api-access-qrq6s\") pod \"da84a0b9-d02a-44be-8735-02230af22201\" (UID: \"da84a0b9-d02a-44be-8735-02230af22201\") "
Jul 09 02:04:45.772059 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:45.771925    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da84a0b9-d02a-44be-8735-02230af22201-openshift-service-ca\") pod \"da84a0b9-d02a-44be-8735-02230af22201\" (UID: \"da84a0b9-d02a-44be-8735-02230af22201\") "
Jul 09 02:04:45.772059 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:45.772044    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da84a0b9-d02a-44be-8735-02230af22201-maas-api-tls\") pod \"da84a0b9-d02a-44be-8735-02230af22201\" (UID: \"da84a0b9-d02a-44be-8735-02230af22201\") "
Jul 09 02:04:45.772234 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:45.772212    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da84a0b9-d02a-44be-8735-02230af22201-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "da84a0b9-d02a-44be-8735-02230af22201" (UID: "da84a0b9-d02a-44be-8735-02230af22201"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:04:45.772349 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:45.772329    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da84a0b9-d02a-44be-8735-02230af22201-openshift-service-ca\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:04:45.773966 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:45.773946    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da84a0b9-d02a-44be-8735-02230af22201-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "da84a0b9-d02a-44be-8735-02230af22201" (UID: "da84a0b9-d02a-44be-8735-02230af22201"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:04:45.774031 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:45.773993    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da84a0b9-d02a-44be-8735-02230af22201-kube-api-access-qrq6s" (OuterVolumeSpecName: "kube-api-access-qrq6s") pod "da84a0b9-d02a-44be-8735-02230af22201" (UID: "da84a0b9-d02a-44be-8735-02230af22201"). InnerVolumeSpecName "kube-api-access-qrq6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:04:45.872794 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:45.872763    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da84a0b9-d02a-44be-8735-02230af22201-maas-api-tls\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:04:45.872794 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:45.872790    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrq6s\" (UniqueName: \"kubernetes.io/projected/da84a0b9-d02a-44be-8735-02230af22201-kube-api-access-qrq6s\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:04:46.699936 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:46.699904    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt" event={"ID":"da84a0b9-d02a-44be-8735-02230af22201","Type":"ContainerDied","Data":"fb09e23b49a85cd09a7923b9068566c570f5fa56a81c27ae7fe5f2d4defbf39f"}
Jul 09 02:04:46.699936 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:46.699937    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt"
Jul 09 02:04:46.700386 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:46.699964    2562 scope.go:117] "RemoveContainer" containerID="3759043d6a107f0420ae22de34156660d46181e5ebd21c5b495b1ea438e5e6c4"
Jul 09 02:04:46.717571 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:46.717548    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt"]
Jul 09 02:04:46.721421 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:46.721399    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-51c9da2a-cd878b457-6flbt"]
Jul 09 02:04:48.157659 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:04:48.157627    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da84a0b9-d02a-44be-8735-02230af22201" path="/var/lib/kubelet/pods/da84a0b9-d02a-44be-8735-02230af22201/volumes"
Jul 09 02:05:14.540987 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:14.540904    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4"]
Jul 09 02:05:14.544860 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:14.541589    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da84a0b9-d02a-44be-8735-02230af22201" containerName="maas-api"
Jul 09 02:05:14.544860 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:14.541606    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="da84a0b9-d02a-44be-8735-02230af22201" containerName="maas-api"
Jul 09 02:05:14.544860 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:14.541671    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="da84a0b9-d02a-44be-8735-02230af22201" containerName="maas-api"
Jul 09 02:05:14.546378 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:14.546360    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4"
Jul 09 02:05:14.549149 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:14.549126    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 02:05:14.549149 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:14.549145    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-bafacff2-serving-cert\""
Jul 09 02:05:14.549343 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:14.549163    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 02:05:14.549343 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:14.549235    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dmx8z\""
Jul 09 02:05:14.554538 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:14.554409    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4"]
Jul 09 02:05:14.744760 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:14.744717    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw8nf\" (UniqueName: \"kubernetes.io/projected/7e90e086-077a-4768-9de3-903193bd2b9a-kube-api-access-bw8nf\") pod \"maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4\" (UID: \"7e90e086-077a-4768-9de3-903193bd2b9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4"
Jul 09 02:05:14.744945 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:14.744788    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e90e086-077a-4768-9de3-903193bd2b9a-maas-api-tls\") pod \"maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4\" (UID: \"7e90e086-077a-4768-9de3-903193bd2b9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4"
Jul 09 02:05:14.744945 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:14.744828    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e90e086-077a-4768-9de3-903193bd2b9a-openshift-service-ca\") pod \"maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4\" (UID: \"7e90e086-077a-4768-9de3-903193bd2b9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4"
Jul 09 02:05:14.846239 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:14.846202    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw8nf\" (UniqueName: \"kubernetes.io/projected/7e90e086-077a-4768-9de3-903193bd2b9a-kube-api-access-bw8nf\") pod \"maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4\" (UID: \"7e90e086-077a-4768-9de3-903193bd2b9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4"
Jul 09 02:05:14.846437 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:14.846267    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e90e086-077a-4768-9de3-903193bd2b9a-maas-api-tls\") pod \"maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4\" (UID: \"7e90e086-077a-4768-9de3-903193bd2b9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4"
Jul 09 02:05:14.846437 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:14.846305    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e90e086-077a-4768-9de3-903193bd2b9a-openshift-service-ca\") pod \"maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4\" (UID: \"7e90e086-077a-4768-9de3-903193bd2b9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4"
Jul 09 02:05:14.846965 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:14.846941    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e90e086-077a-4768-9de3-903193bd2b9a-openshift-service-ca\") pod \"maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4\" (UID: \"7e90e086-077a-4768-9de3-903193bd2b9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4"
Jul 09 02:05:14.848690 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:14.848671    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e90e086-077a-4768-9de3-903193bd2b9a-maas-api-tls\") pod \"maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4\" (UID: \"7e90e086-077a-4768-9de3-903193bd2b9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4"
Jul 09 02:05:14.857624 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:14.857604    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw8nf\" (UniqueName: \"kubernetes.io/projected/7e90e086-077a-4768-9de3-903193bd2b9a-kube-api-access-bw8nf\") pod \"maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4\" (UID: \"7e90e086-077a-4768-9de3-903193bd2b9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4"
Jul 09 02:05:14.858398 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:14.858382    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4"
Jul 09 02:05:14.995480 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:14.995458    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4"]
Jul 09 02:05:14.997628 ip-10-0-138-200 kubenswrapper[2562]: W0709 02:05:14.997591    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e90e086_077a_4768_9de3_903193bd2b9a.slice/crio-e36debb469c894e071e14fac3874e8efe61ccbdd77677dc4557148c7fba9fdbe WatchSource:0}: Error finding container e36debb469c894e071e14fac3874e8efe61ccbdd77677dc4557148c7fba9fdbe: Status 404 returned error can't find the container with id e36debb469c894e071e14fac3874e8efe61ccbdd77677dc4557148c7fba9fdbe
Jul 09 02:05:14.998949 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:14.998933    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 02:05:15.845740 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:15.845699    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4" event={"ID":"7e90e086-077a-4768-9de3-903193bd2b9a","Type":"ContainerStarted","Data":"e71aa4b1f3b89b549c34d26efa970feeea4d4227e4067b5771dd88da3feeddf1"}
Jul 09 02:05:15.846123 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:15.845775    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4"
Jul 09 02:05:15.846123 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:15.845803    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4" event={"ID":"7e90e086-077a-4768-9de3-903193bd2b9a","Type":"ContainerStarted","Data":"e36debb469c894e071e14fac3874e8efe61ccbdd77677dc4557148c7fba9fdbe"}
Jul 09 02:05:15.863106 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:15.863009    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4" podStartSLOduration=1.145107522 podStartE2EDuration="1.862991022s" totalImagesPullingTime="717.8835ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:05:15.862001511 +0000 UTC m=+1614.073653849" watchObservedRunningTime="2026-07-09 02:05:15.862991022 +0000 UTC m=+1614.074643357"
Jul 09 02:05:21.857009 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:21.856976    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4"
Jul 09 02:05:34.445252 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.445213    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"]
Jul 09 02:05:34.450029 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.449993    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:05:34.454420 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.454395    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-bafacff2\"/\"kube-root-ca.crt\""
Jul 09 02:05:34.454650 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.454397    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-bafacff2\"/\"e2e-lifecycle-model-bafacff2-kserve-self-signed-certs\""
Jul 09 02:05:34.454737 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.454397    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-bafacff2\"/\"default-dockercfg-6nfp9\""
Jul 09 02:05:34.454824 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.454519    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-bafacff2\"/\"openshift-service-ca.crt\""
Jul 09 02:05:34.458032 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.457990    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"]
Jul 09 02:05:34.525311 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.525269    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3da74063-5290-43ed-9339-be2a9c235a42-tmp-dir\") pod \"e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc\" (UID: \"3da74063-5290-43ed-9339-be2a9c235a42\") " pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:05:34.525511 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.525322    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3da74063-5290-43ed-9339-be2a9c235a42-dshm\") pod \"e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc\" (UID: \"3da74063-5290-43ed-9339-be2a9c235a42\") " pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:05:34.525511 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.525433    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdvtn\" (UniqueName: \"kubernetes.io/projected/3da74063-5290-43ed-9339-be2a9c235a42-kube-api-access-gdvtn\") pod \"e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc\" (UID: \"3da74063-5290-43ed-9339-be2a9c235a42\") " pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:05:34.525511 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.525471    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3da74063-5290-43ed-9339-be2a9c235a42-tls-certs\") pod \"e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc\" (UID: \"3da74063-5290-43ed-9339-be2a9c235a42\") " pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:05:34.525511 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.525508    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3da74063-5290-43ed-9339-be2a9c235a42-home\") pod \"e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc\" (UID: \"3da74063-5290-43ed-9339-be2a9c235a42\") " pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:05:34.525706 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.525563    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3da74063-5290-43ed-9339-be2a9c235a42-model-cache\") pod \"e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc\" (UID: \"3da74063-5290-43ed-9339-be2a9c235a42\") " pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:05:34.626255 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.626218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3da74063-5290-43ed-9339-be2a9c235a42-tmp-dir\") pod \"e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc\" (UID: \"3da74063-5290-43ed-9339-be2a9c235a42\") " pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:05:34.626457 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.626261    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3da74063-5290-43ed-9339-be2a9c235a42-dshm\") pod \"e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc\" (UID: \"3da74063-5290-43ed-9339-be2a9c235a42\") " pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:05:34.626457 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.626303    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdvtn\" (UniqueName: \"kubernetes.io/projected/3da74063-5290-43ed-9339-be2a9c235a42-kube-api-access-gdvtn\") pod \"e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc\" (UID: \"3da74063-5290-43ed-9339-be2a9c235a42\") " pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:05:34.626457 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.626328    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3da74063-5290-43ed-9339-be2a9c235a42-tls-certs\") pod \"e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc\" (UID: \"3da74063-5290-43ed-9339-be2a9c235a42\") " pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:05:34.626457 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.626358    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3da74063-5290-43ed-9339-be2a9c235a42-home\") pod \"e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc\" (UID: \"3da74063-5290-43ed-9339-be2a9c235a42\") " pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:05:34.626457 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.626384    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3da74063-5290-43ed-9339-be2a9c235a42-model-cache\") pod \"e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc\" (UID: \"3da74063-5290-43ed-9339-be2a9c235a42\") " pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:05:34.626992 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.626694    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3da74063-5290-43ed-9339-be2a9c235a42-tmp-dir\") pod \"e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc\" (UID: \"3da74063-5290-43ed-9339-be2a9c235a42\") " pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:05:34.626992 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.626732    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3da74063-5290-43ed-9339-be2a9c235a42-home\") pod \"e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc\" (UID: \"3da74063-5290-43ed-9339-be2a9c235a42\") " pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:05:34.626992 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.626809    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3da74063-5290-43ed-9339-be2a9c235a42-model-cache\") pod \"e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc\" (UID: \"3da74063-5290-43ed-9339-be2a9c235a42\") " pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:05:34.628613 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.628590    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3da74063-5290-43ed-9339-be2a9c235a42-dshm\") pod \"e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc\" (UID: \"3da74063-5290-43ed-9339-be2a9c235a42\") " pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:05:34.628789 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.628761    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3da74063-5290-43ed-9339-be2a9c235a42-tls-certs\") pod \"e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc\" (UID: \"3da74063-5290-43ed-9339-be2a9c235a42\") " pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:05:34.634288 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.634263    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdvtn\" (UniqueName: \"kubernetes.io/projected/3da74063-5290-43ed-9339-be2a9c235a42-kube-api-access-gdvtn\") pod \"e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc\" (UID: \"3da74063-5290-43ed-9339-be2a9c235a42\") " pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:05:34.763519 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.763417    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:05:34.899316 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.899290    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"]
Jul 09 02:05:34.901333 ip-10-0-138-200 kubenswrapper[2562]: W0709 02:05:34.901299    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3da74063_5290_43ed_9339_be2a9c235a42.slice/crio-b59c3d968dcb69886bf967cb805668e7fbdf202ec522045e699508f3212ac378 WatchSource:0}: Error finding container b59c3d968dcb69886bf967cb805668e7fbdf202ec522045e699508f3212ac378: Status 404 returned error can't find the container with id b59c3d968dcb69886bf967cb805668e7fbdf202ec522045e699508f3212ac378
Jul 09 02:05:34.938277 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:34.938242    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc" event={"ID":"3da74063-5290-43ed-9339-be2a9c235a42","Type":"ContainerStarted","Data":"b59c3d968dcb69886bf967cb805668e7fbdf202ec522045e699508f3212ac378"}
Jul 09 02:05:35.944405 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:35.944366    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc" event={"ID":"3da74063-5290-43ed-9339-be2a9c235a42","Type":"ContainerStarted","Data":"760961ba0731150d9b4154d3a93b52933f80a1178e17463a24c7d79edd98e990"}
Jul 09 02:05:35.962401 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:35.962338    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc" podStartSLOduration=1.962320224 podStartE2EDuration="1.962320224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:05:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:05:35.961386005 +0000 UTC m=+1634.173038356" watchObservedRunningTime="2026-07-09 02:05:35.962320224 +0000 UTC m=+1634.173972559"
Jul 09 02:05:44.764065 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:44.764006    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:05:44.764570 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:44.764091    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:05:44.776335 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:44.776304    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:05:45.001561 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:05:45.001539    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:06:06.958843 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:06.958805    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4"]
Jul 09 02:06:06.959336 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:06.959063    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4" podUID="7e90e086-077a-4768-9de3-903193bd2b9a" containerName="maas-api" containerID="cri-o://e71aa4b1f3b89b549c34d26efa970feeea4d4227e4067b5771dd88da3feeddf1" gracePeriod=30
Jul 09 02:06:07.107396 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:07.107366    2562 generic.go:356] "Generic (PLEG): container finished" podID="7e90e086-077a-4768-9de3-903193bd2b9a" containerID="e71aa4b1f3b89b549c34d26efa970feeea4d4227e4067b5771dd88da3feeddf1" exitCode=0
Jul 09 02:06:07.107533 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:07.107431    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4" event={"ID":"7e90e086-077a-4768-9de3-903193bd2b9a","Type":"ContainerDied","Data":"e71aa4b1f3b89b549c34d26efa970feeea4d4227e4067b5771dd88da3feeddf1"}
Jul 09 02:06:07.199183 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:07.199160    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4"
Jul 09 02:06:07.225302 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:07.225247    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bw8nf\" (UniqueName: \"kubernetes.io/projected/7e90e086-077a-4768-9de3-903193bd2b9a-kube-api-access-bw8nf\") pod \"7e90e086-077a-4768-9de3-903193bd2b9a\" (UID: \"7e90e086-077a-4768-9de3-903193bd2b9a\") "
Jul 09 02:06:07.225302 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:07.225298    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e90e086-077a-4768-9de3-903193bd2b9a-maas-api-tls\") pod \"7e90e086-077a-4768-9de3-903193bd2b9a\" (UID: \"7e90e086-077a-4768-9de3-903193bd2b9a\") "
Jul 09 02:06:07.225485 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:07.225396    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e90e086-077a-4768-9de3-903193bd2b9a-openshift-service-ca\") pod \"7e90e086-077a-4768-9de3-903193bd2b9a\" (UID: \"7e90e086-077a-4768-9de3-903193bd2b9a\") "
Jul 09 02:06:07.225742 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:07.225716    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e90e086-077a-4768-9de3-903193bd2b9a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7e90e086-077a-4768-9de3-903193bd2b9a" (UID: "7e90e086-077a-4768-9de3-903193bd2b9a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:06:07.227289 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:07.227264    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e90e086-077a-4768-9de3-903193bd2b9a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7e90e086-077a-4768-9de3-903193bd2b9a" (UID: "7e90e086-077a-4768-9de3-903193bd2b9a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:06:07.227404 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:07.227359    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e90e086-077a-4768-9de3-903193bd2b9a-kube-api-access-bw8nf" (OuterVolumeSpecName: "kube-api-access-bw8nf") pod "7e90e086-077a-4768-9de3-903193bd2b9a" (UID: "7e90e086-077a-4768-9de3-903193bd2b9a"). InnerVolumeSpecName "kube-api-access-bw8nf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:06:07.326187 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:07.326160    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e90e086-077a-4768-9de3-903193bd2b9a-maas-api-tls\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:06:07.326187 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:07.326185    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e90e086-077a-4768-9de3-903193bd2b9a-openshift-service-ca\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:06:07.326353 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:07.326195    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bw8nf\" (UniqueName: \"kubernetes.io/projected/7e90e086-077a-4768-9de3-903193bd2b9a-kube-api-access-bw8nf\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:06:08.113325 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:08.113300    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4"
Jul 09 02:06:08.113325 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:08.113313    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4" event={"ID":"7e90e086-077a-4768-9de3-903193bd2b9a","Type":"ContainerDied","Data":"e36debb469c894e071e14fac3874e8efe61ccbdd77677dc4557148c7fba9fdbe"}
Jul 09 02:06:08.113799 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:08.113368    2562 scope.go:117] "RemoveContainer" containerID="e71aa4b1f3b89b549c34d26efa970feeea4d4227e4067b5771dd88da3feeddf1"
Jul 09 02:06:08.134794 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:08.134769    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4"]
Jul 09 02:06:08.140702 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:08.140680    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bafacff2-5fdbcd7c8b-5ddn4"]
Jul 09 02:06:08.157715 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:08.157690    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e90e086-077a-4768-9de3-903193bd2b9a" path="/var/lib/kubelet/pods/7e90e086-077a-4768-9de3-903193bd2b9a/volumes"
Jul 09 02:06:17.649057 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:17.649003    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"]
Jul 09 02:06:32.669848 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:32.669778    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc" podUID="3da74063-5290-43ed-9339-be2a9c235a42" containerName="main" containerID="cri-o://760961ba0731150d9b4154d3a93b52933f80a1178e17463a24c7d79edd98e990" gracePeriod=45
Jul 09 02:06:32.913126 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:32.913100    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:06:33.067673 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.067630    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3da74063-5290-43ed-9339-be2a9c235a42-tmp-dir\") pod \"3da74063-5290-43ed-9339-be2a9c235a42\" (UID: \"3da74063-5290-43ed-9339-be2a9c235a42\") "
Jul 09 02:06:33.067884 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.067684    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdvtn\" (UniqueName: \"kubernetes.io/projected/3da74063-5290-43ed-9339-be2a9c235a42-kube-api-access-gdvtn\") pod \"3da74063-5290-43ed-9339-be2a9c235a42\" (UID: \"3da74063-5290-43ed-9339-be2a9c235a42\") "
Jul 09 02:06:33.067884 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.067736    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3da74063-5290-43ed-9339-be2a9c235a42-model-cache\") pod \"3da74063-5290-43ed-9339-be2a9c235a42\" (UID: \"3da74063-5290-43ed-9339-be2a9c235a42\") "
Jul 09 02:06:33.067884 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.067781    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3da74063-5290-43ed-9339-be2a9c235a42-tls-certs\") pod \"3da74063-5290-43ed-9339-be2a9c235a42\" (UID: \"3da74063-5290-43ed-9339-be2a9c235a42\") "
Jul 09 02:06:33.067884 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.067841    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3da74063-5290-43ed-9339-be2a9c235a42-dshm\") pod \"3da74063-5290-43ed-9339-be2a9c235a42\" (UID: \"3da74063-5290-43ed-9339-be2a9c235a42\") "
Jul 09 02:06:33.068153 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.067897    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3da74063-5290-43ed-9339-be2a9c235a42-home\") pod \"3da74063-5290-43ed-9339-be2a9c235a42\" (UID: \"3da74063-5290-43ed-9339-be2a9c235a42\") "
Jul 09 02:06:33.068153 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.067963    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3da74063-5290-43ed-9339-be2a9c235a42-model-cache" (OuterVolumeSpecName: "model-cache") pod "3da74063-5290-43ed-9339-be2a9c235a42" (UID: "3da74063-5290-43ed-9339-be2a9c235a42"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:06:33.068153 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.067978    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3da74063-5290-43ed-9339-be2a9c235a42-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3da74063-5290-43ed-9339-be2a9c235a42" (UID: "3da74063-5290-43ed-9339-be2a9c235a42"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:06:33.068333 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.068239    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3da74063-5290-43ed-9339-be2a9c235a42-home" (OuterVolumeSpecName: "home") pod "3da74063-5290-43ed-9339-be2a9c235a42" (UID: "3da74063-5290-43ed-9339-be2a9c235a42"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:06:33.068333 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.068246    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3da74063-5290-43ed-9339-be2a9c235a42-tmp-dir\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:06:33.068333 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.068270    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3da74063-5290-43ed-9339-be2a9c235a42-model-cache\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:06:33.070005 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.069959    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3da74063-5290-43ed-9339-be2a9c235a42-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3da74063-5290-43ed-9339-be2a9c235a42" (UID: "3da74063-5290-43ed-9339-be2a9c235a42"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:06:33.070222 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.070202    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3da74063-5290-43ed-9339-be2a9c235a42-kube-api-access-gdvtn" (OuterVolumeSpecName: "kube-api-access-gdvtn") pod "3da74063-5290-43ed-9339-be2a9c235a42" (UID: "3da74063-5290-43ed-9339-be2a9c235a42"). InnerVolumeSpecName "kube-api-access-gdvtn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:06:33.070292 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.070243    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3da74063-5290-43ed-9339-be2a9c235a42-dshm" (OuterVolumeSpecName: "dshm") pod "3da74063-5290-43ed-9339-be2a9c235a42" (UID: "3da74063-5290-43ed-9339-be2a9c235a42"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:06:33.169436 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.169392    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3da74063-5290-43ed-9339-be2a9c235a42-tls-certs\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:06:33.169436 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.169426    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3da74063-5290-43ed-9339-be2a9c235a42-dshm\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:06:33.169436 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.169436    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3da74063-5290-43ed-9339-be2a9c235a42-home\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:06:33.169684 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.169450    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdvtn\" (UniqueName: \"kubernetes.io/projected/3da74063-5290-43ed-9339-be2a9c235a42-kube-api-access-gdvtn\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:06:33.242544 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.242506    2562 generic.go:356] "Generic (PLEG): container finished" podID="3da74063-5290-43ed-9339-be2a9c235a42" containerID="760961ba0731150d9b4154d3a93b52933f80a1178e17463a24c7d79edd98e990" exitCode=0
Jul 09 02:06:33.242544 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.242548    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"
Jul 09 02:06:33.242746 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.242592    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc" event={"ID":"3da74063-5290-43ed-9339-be2a9c235a42","Type":"ContainerDied","Data":"760961ba0731150d9b4154d3a93b52933f80a1178e17463a24c7d79edd98e990"}
Jul 09 02:06:33.242746 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.242634    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc" event={"ID":"3da74063-5290-43ed-9339-be2a9c235a42","Type":"ContainerDied","Data":"b59c3d968dcb69886bf967cb805668e7fbdf202ec522045e699508f3212ac378"}
Jul 09 02:06:33.242746 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.242650    2562 scope.go:117] "RemoveContainer" containerID="760961ba0731150d9b4154d3a93b52933f80a1178e17463a24c7d79edd98e990"
Jul 09 02:06:33.252306 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.252288    2562 scope.go:117] "RemoveContainer" containerID="760961ba0731150d9b4154d3a93b52933f80a1178e17463a24c7d79edd98e990"
Jul 09 02:06:33.252553 ip-10-0-138-200 kubenswrapper[2562]: E0709 02:06:33.252535    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"760961ba0731150d9b4154d3a93b52933f80a1178e17463a24c7d79edd98e990\": container with ID starting with 760961ba0731150d9b4154d3a93b52933f80a1178e17463a24c7d79edd98e990 not found: ID does not exist" containerID="760961ba0731150d9b4154d3a93b52933f80a1178e17463a24c7d79edd98e990"
Jul 09 02:06:33.252593 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.252565    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"760961ba0731150d9b4154d3a93b52933f80a1178e17463a24c7d79edd98e990"} err="failed to get container status \"760961ba0731150d9b4154d3a93b52933f80a1178e17463a24c7d79edd98e990\": rpc error: code = NotFound desc = could not find container \"760961ba0731150d9b4154d3a93b52933f80a1178e17463a24c7d79edd98e990\": container with ID starting with 760961ba0731150d9b4154d3a93b52933f80a1178e17463a24c7d79edd98e990 not found: ID does not exist"
Jul 09 02:06:33.265432 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.265405    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"]
Jul 09 02:06:33.269809 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:33.269782    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-bafacff2/e2e-lifecycle-model-bafacff2-kserve-9f747d447-lzzhc"]
Jul 09 02:06:34.158001 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:06:34.157963    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3da74063-5290-43ed-9339-be2a9c235a42" path="/var/lib/kubelet/pods/3da74063-5290-43ed-9339-be2a9c235a42/volumes"
Jul 09 02:07:58.284273 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:58.284238    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9"]
Jul 09 02:07:58.284731 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:58.284591    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e90e086-077a-4768-9de3-903193bd2b9a" containerName="maas-api"
Jul 09 02:07:58.284731 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:58.284602    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e90e086-077a-4768-9de3-903193bd2b9a" containerName="maas-api"
Jul 09 02:07:58.284731 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:58.284612    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da74063-5290-43ed-9339-be2a9c235a42" containerName="main"
Jul 09 02:07:58.284731 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:58.284619    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da74063-5290-43ed-9339-be2a9c235a42" containerName="main"
Jul 09 02:07:58.284731 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:58.284693    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e90e086-077a-4768-9de3-903193bd2b9a" containerName="maas-api"
Jul 09 02:07:58.284731 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:58.284701    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3da74063-5290-43ed-9339-be2a9c235a42" containerName="main"
Jul 09 02:07:58.287837 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:58.287820    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9"
Jul 09 02:07:58.292944 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:58.292920    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 02:07:58.294542 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:58.294131    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-528913-serving-cert\""
Jul 09 02:07:58.294542 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:58.294155    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 02:07:58.294542 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:58.294159    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dmx8z\""
Jul 09 02:07:58.332376 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:58.332345    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9"]
Jul 09 02:07:58.410669 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:58.410635    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kxwr\" (UniqueName: \"kubernetes.io/projected/27547c27-1632-48b0-8fda-8d4c71eb6d67-kube-api-access-4kxwr\") pod \"maas-api-e2e-inf-a-528913-56cc6b478c-vhss9\" (UID: \"27547c27-1632-48b0-8fda-8d4c71eb6d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9"
Jul 09 02:07:58.410826 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:58.410680    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27547c27-1632-48b0-8fda-8d4c71eb6d67-openshift-service-ca\") pod \"maas-api-e2e-inf-a-528913-56cc6b478c-vhss9\" (UID: \"27547c27-1632-48b0-8fda-8d4c71eb6d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9"
Jul 09 02:07:58.410826 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:58.410788    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27547c27-1632-48b0-8fda-8d4c71eb6d67-maas-api-tls\") pod \"maas-api-e2e-inf-a-528913-56cc6b478c-vhss9\" (UID: \"27547c27-1632-48b0-8fda-8d4c71eb6d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9"
Jul 09 02:07:58.512300 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:58.512256    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27547c27-1632-48b0-8fda-8d4c71eb6d67-maas-api-tls\") pod \"maas-api-e2e-inf-a-528913-56cc6b478c-vhss9\" (UID: \"27547c27-1632-48b0-8fda-8d4c71eb6d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9"
Jul 09 02:07:58.512495 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:58.512329    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kxwr\" (UniqueName: \"kubernetes.io/projected/27547c27-1632-48b0-8fda-8d4c71eb6d67-kube-api-access-4kxwr\") pod \"maas-api-e2e-inf-a-528913-56cc6b478c-vhss9\" (UID: \"27547c27-1632-48b0-8fda-8d4c71eb6d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9"
Jul 09 02:07:58.512495 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:58.512359    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27547c27-1632-48b0-8fda-8d4c71eb6d67-openshift-service-ca\") pod \"maas-api-e2e-inf-a-528913-56cc6b478c-vhss9\" (UID: \"27547c27-1632-48b0-8fda-8d4c71eb6d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9"
Jul 09 02:07:58.512495 ip-10-0-138-200 kubenswrapper[2562]: E0709 02:07:58.512429    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-serving-cert: secret "maas-api-e2e-inf-a-528913-serving-cert" not found
Jul 09 02:07:58.512668 ip-10-0-138-200 kubenswrapper[2562]: E0709 02:07:58.512513    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27547c27-1632-48b0-8fda-8d4c71eb6d67-maas-api-tls podName:27547c27-1632-48b0-8fda-8d4c71eb6d67 nodeName:}" failed. No retries permitted until 2026-07-09 02:07:59.012488516 +0000 UTC m=+1777.224140830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/27547c27-1632-48b0-8fda-8d4c71eb6d67-maas-api-tls") pod "maas-api-e2e-inf-a-528913-56cc6b478c-vhss9" (UID: "27547c27-1632-48b0-8fda-8d4c71eb6d67") : secret "maas-api-e2e-inf-a-528913-serving-cert" not found
Jul 09 02:07:58.512972 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:58.512954    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27547c27-1632-48b0-8fda-8d4c71eb6d67-openshift-service-ca\") pod \"maas-api-e2e-inf-a-528913-56cc6b478c-vhss9\" (UID: \"27547c27-1632-48b0-8fda-8d4c71eb6d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9"
Jul 09 02:07:58.531743 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:58.531715    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kxwr\" (UniqueName: \"kubernetes.io/projected/27547c27-1632-48b0-8fda-8d4c71eb6d67-kube-api-access-4kxwr\") pod \"maas-api-e2e-inf-a-528913-56cc6b478c-vhss9\" (UID: \"27547c27-1632-48b0-8fda-8d4c71eb6d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9"
Jul 09 02:07:59.018274 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:59.018242    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27547c27-1632-48b0-8fda-8d4c71eb6d67-maas-api-tls\") pod \"maas-api-e2e-inf-a-528913-56cc6b478c-vhss9\" (UID: \"27547c27-1632-48b0-8fda-8d4c71eb6d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9"
Jul 09 02:07:59.020547 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:59.020527    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27547c27-1632-48b0-8fda-8d4c71eb6d67-maas-api-tls\") pod \"maas-api-e2e-inf-a-528913-56cc6b478c-vhss9\" (UID: \"27547c27-1632-48b0-8fda-8d4c71eb6d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9"
Jul 09 02:07:59.197741 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:59.197711    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9"
Jul 09 02:07:59.326703 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:59.326681    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9"]
Jul 09 02:07:59.327878 ip-10-0-138-200 kubenswrapper[2562]: W0709 02:07:59.327855    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27547c27_1632_48b0_8fda_8d4c71eb6d67.slice/crio-b97e79705edd04a5bd93c3e25f1c2eb0858b70ace1b13e507022906e3efc9b17 WatchSource:0}: Error finding container b97e79705edd04a5bd93c3e25f1c2eb0858b70ace1b13e507022906e3efc9b17: Status 404 returned error can't find the container with id b97e79705edd04a5bd93c3e25f1c2eb0858b70ace1b13e507022906e3efc9b17
Jul 09 02:07:59.662235 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:07:59.662194    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9" event={"ID":"27547c27-1632-48b0-8fda-8d4c71eb6d67","Type":"ContainerStarted","Data":"b97e79705edd04a5bd93c3e25f1c2eb0858b70ace1b13e507022906e3efc9b17"}
Jul 09 02:08:00.668952 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:00.668912    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9" event={"ID":"27547c27-1632-48b0-8fda-8d4c71eb6d67","Type":"ContainerStarted","Data":"c0a413d920bb9f6483450397f6465fe556ffc85206bf28620d55f90de096e8b8"}
Jul 09 02:08:00.669410 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:00.668991    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9"
Jul 09 02:08:00.687804 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:00.687753    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9" podStartSLOduration=2.219584157 podStartE2EDuration="2.687738846s" totalImagesPullingTime="468.154689ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:08:00.685313194 +0000 UTC m=+1778.896965530" watchObservedRunningTime="2026-07-09 02:08:00.687738846 +0000 UTC m=+1778.899391160"
Jul 09 02:08:06.679267 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:06.679231    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9"
Jul 09 02:08:09.897472 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:09.897443    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr"]
Jul 09 02:08:09.900989 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:09.900969    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr"
Jul 09 02:08:09.904064 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:09.904043    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-65e1b4-serving-cert\""
Jul 09 02:08:09.930076 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:09.930052    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr"]
Jul 09 02:08:10.015452 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:10.015428    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vkmr\" (UniqueName: \"kubernetes.io/projected/f79bb97c-4bc4-48ec-897a-f83cc2f1d077-kube-api-access-8vkmr\") pod \"maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr\" (UID: \"f79bb97c-4bc4-48ec-897a-f83cc2f1d077\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr"
Jul 09 02:08:10.015588 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:10.015490    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f79bb97c-4bc4-48ec-897a-f83cc2f1d077-openshift-service-ca\") pod \"maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr\" (UID: \"f79bb97c-4bc4-48ec-897a-f83cc2f1d077\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr"
Jul 09 02:08:10.015588 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:10.015559    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f79bb97c-4bc4-48ec-897a-f83cc2f1d077-maas-api-tls\") pod \"maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr\" (UID: \"f79bb97c-4bc4-48ec-897a-f83cc2f1d077\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr"
Jul 09 02:08:10.116679 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:10.116650    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f79bb97c-4bc4-48ec-897a-f83cc2f1d077-maas-api-tls\") pod \"maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr\" (UID: \"f79bb97c-4bc4-48ec-897a-f83cc2f1d077\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr"
Jul 09 02:08:10.116805 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:10.116754    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vkmr\" (UniqueName: \"kubernetes.io/projected/f79bb97c-4bc4-48ec-897a-f83cc2f1d077-kube-api-access-8vkmr\") pod \"maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr\" (UID: \"f79bb97c-4bc4-48ec-897a-f83cc2f1d077\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr"
Jul 09 02:08:10.116805 ip-10-0-138-200 kubenswrapper[2562]: E0709 02:08:10.116793    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-serving-cert: secret "maas-api-e2e-inf-b-65e1b4-serving-cert" not found
Jul 09 02:08:10.116931 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:10.116825    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f79bb97c-4bc4-48ec-897a-f83cc2f1d077-openshift-service-ca\") pod \"maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr\" (UID: \"f79bb97c-4bc4-48ec-897a-f83cc2f1d077\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr"
Jul 09 02:08:10.116931 ip-10-0-138-200 kubenswrapper[2562]: E0709 02:08:10.116847    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f79bb97c-4bc4-48ec-897a-f83cc2f1d077-maas-api-tls podName:f79bb97c-4bc4-48ec-897a-f83cc2f1d077 nodeName:}" failed. No retries permitted until 2026-07-09 02:08:10.616830682 +0000 UTC m=+1788.828483010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f79bb97c-4bc4-48ec-897a-f83cc2f1d077-maas-api-tls") pod "maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr" (UID: "f79bb97c-4bc4-48ec-897a-f83cc2f1d077") : secret "maas-api-e2e-inf-b-65e1b4-serving-cert" not found
Jul 09 02:08:10.117450 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:10.117427    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f79bb97c-4bc4-48ec-897a-f83cc2f1d077-openshift-service-ca\") pod \"maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr\" (UID: \"f79bb97c-4bc4-48ec-897a-f83cc2f1d077\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr"
Jul 09 02:08:10.128094 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:10.128068    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vkmr\" (UniqueName: \"kubernetes.io/projected/f79bb97c-4bc4-48ec-897a-f83cc2f1d077-kube-api-access-8vkmr\") pod \"maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr\" (UID: \"f79bb97c-4bc4-48ec-897a-f83cc2f1d077\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr"
Jul 09 02:08:10.621164 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:10.621130    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f79bb97c-4bc4-48ec-897a-f83cc2f1d077-maas-api-tls\") pod \"maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr\" (UID: \"f79bb97c-4bc4-48ec-897a-f83cc2f1d077\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr"
Jul 09 02:08:10.621333 ip-10-0-138-200 kubenswrapper[2562]: E0709 02:08:10.621233    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-serving-cert: secret "maas-api-e2e-inf-b-65e1b4-serving-cert" not found
Jul 09 02:08:10.621333 ip-10-0-138-200 kubenswrapper[2562]: E0709 02:08:10.621291    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f79bb97c-4bc4-48ec-897a-f83cc2f1d077-maas-api-tls podName:f79bb97c-4bc4-48ec-897a-f83cc2f1d077 nodeName:}" failed. No retries permitted until 2026-07-09 02:08:11.621276581 +0000 UTC m=+1789.832928895 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f79bb97c-4bc4-48ec-897a-f83cc2f1d077-maas-api-tls") pod "maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr" (UID: "f79bb97c-4bc4-48ec-897a-f83cc2f1d077") : secret "maas-api-e2e-inf-b-65e1b4-serving-cert" not found
Jul 09 02:08:11.628153 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:11.628113    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f79bb97c-4bc4-48ec-897a-f83cc2f1d077-maas-api-tls\") pod \"maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr\" (UID: \"f79bb97c-4bc4-48ec-897a-f83cc2f1d077\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr"
Jul 09 02:08:11.630558 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:11.630533    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f79bb97c-4bc4-48ec-897a-f83cc2f1d077-maas-api-tls\") pod \"maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr\" (UID: \"f79bb97c-4bc4-48ec-897a-f83cc2f1d077\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr"
Jul 09 02:08:11.710647 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:11.710616    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr"
Jul 09 02:08:11.839808 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:11.839727    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr"]
Jul 09 02:08:11.842433 ip-10-0-138-200 kubenswrapper[2562]: W0709 02:08:11.842403    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf79bb97c_4bc4_48ec_897a_f83cc2f1d077.slice/crio-3fbdc49784e32dbfa13e0c9a0dc1d3ed0901686353fadf95e4a667a211ef3cba WatchSource:0}: Error finding container 3fbdc49784e32dbfa13e0c9a0dc1d3ed0901686353fadf95e4a667a211ef3cba: Status 404 returned error can't find the container with id 3fbdc49784e32dbfa13e0c9a0dc1d3ed0901686353fadf95e4a667a211ef3cba
Jul 09 02:08:12.733146 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:12.733106    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr" event={"ID":"f79bb97c-4bc4-48ec-897a-f83cc2f1d077","Type":"ContainerStarted","Data":"3e3e8e3911bd14a98fb2fb3f3b36d14976a333efe79f7ef0977ea9c8ccdb0bb7"}
Jul 09 02:08:12.733597 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:12.733164    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr" event={"ID":"f79bb97c-4bc4-48ec-897a-f83cc2f1d077","Type":"ContainerStarted","Data":"3fbdc49784e32dbfa13e0c9a0dc1d3ed0901686353fadf95e4a667a211ef3cba"}
Jul 09 02:08:12.733597 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:12.733236    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr"
Jul 09 02:08:12.753964 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:12.753917    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr" podStartSLOduration=3.37552785 podStartE2EDuration="3.75390168s" totalImagesPullingTime="378.37383ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:08:12.753847377 +0000 UTC m=+1790.965499712" watchObservedRunningTime="2026-07-09 02:08:12.75390168 +0000 UTC m=+1790.965554016"
Jul 09 02:08:18.743797 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:18.743708    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr"
Jul 09 02:08:19.477275 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.477237    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"]
Jul 09 02:08:19.481933 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.481913    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:08:19.485928 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.485898    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-528913\"/\"openshift-service-ca.crt\""
Jul 09 02:08:19.486273 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.485928    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-528913\"/\"test-model-528913-kserve-self-signed-certs\""
Jul 09 02:08:19.486273 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.485946    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-528913\"/\"kube-root-ca.crt\""
Jul 09 02:08:19.486273 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.486093    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-528913\"/\"default-dockercfg-kml5n\""
Jul 09 02:08:19.488976 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.488947    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"]
Jul 09 02:08:19.495887 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.495864    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/577927b4-d8ee-4f29-a8b1-346579b3485c-tmp-dir\") pod \"test-model-528913-kserve-7b9bb487f7-ppxgj\" (UID: \"577927b4-d8ee-4f29-a8b1-346579b3485c\") " pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:08:19.496003 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.495898    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/577927b4-d8ee-4f29-a8b1-346579b3485c-home\") pod \"test-model-528913-kserve-7b9bb487f7-ppxgj\" (UID: \"577927b4-d8ee-4f29-a8b1-346579b3485c\") " pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:08:19.496003 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.495940    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/577927b4-d8ee-4f29-a8b1-346579b3485c-tls-certs\") pod \"test-model-528913-kserve-7b9bb487f7-ppxgj\" (UID: \"577927b4-d8ee-4f29-a8b1-346579b3485c\") " pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:08:19.496143 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.496041    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbp4k\" (UniqueName: \"kubernetes.io/projected/577927b4-d8ee-4f29-a8b1-346579b3485c-kube-api-access-vbp4k\") pod \"test-model-528913-kserve-7b9bb487f7-ppxgj\" (UID: \"577927b4-d8ee-4f29-a8b1-346579b3485c\") " pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:08:19.496143 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.496086    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/577927b4-d8ee-4f29-a8b1-346579b3485c-model-cache\") pod \"test-model-528913-kserve-7b9bb487f7-ppxgj\" (UID: \"577927b4-d8ee-4f29-a8b1-346579b3485c\") " pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:08:19.496269 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.496153    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/577927b4-d8ee-4f29-a8b1-346579b3485c-dshm\") pod \"test-model-528913-kserve-7b9bb487f7-ppxgj\" (UID: \"577927b4-d8ee-4f29-a8b1-346579b3485c\") " pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:08:19.596603 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.596575    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/577927b4-d8ee-4f29-a8b1-346579b3485c-tmp-dir\") pod \"test-model-528913-kserve-7b9bb487f7-ppxgj\" (UID: \"577927b4-d8ee-4f29-a8b1-346579b3485c\") " pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:08:19.596709 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.596611    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/577927b4-d8ee-4f29-a8b1-346579b3485c-home\") pod \"test-model-528913-kserve-7b9bb487f7-ppxgj\" (UID: \"577927b4-d8ee-4f29-a8b1-346579b3485c\") " pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:08:19.596709 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.596660    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/577927b4-d8ee-4f29-a8b1-346579b3485c-tls-certs\") pod \"test-model-528913-kserve-7b9bb487f7-ppxgj\" (UID: \"577927b4-d8ee-4f29-a8b1-346579b3485c\") " pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:08:19.596709 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.596678    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbp4k\" (UniqueName: \"kubernetes.io/projected/577927b4-d8ee-4f29-a8b1-346579b3485c-kube-api-access-vbp4k\") pod \"test-model-528913-kserve-7b9bb487f7-ppxgj\" (UID: \"577927b4-d8ee-4f29-a8b1-346579b3485c\") " pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:08:19.596709 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.596701    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/577927b4-d8ee-4f29-a8b1-346579b3485c-model-cache\") pod \"test-model-528913-kserve-7b9bb487f7-ppxgj\" (UID: \"577927b4-d8ee-4f29-a8b1-346579b3485c\") " pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:08:19.596862 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.596730    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/577927b4-d8ee-4f29-a8b1-346579b3485c-dshm\") pod \"test-model-528913-kserve-7b9bb487f7-ppxgj\" (UID: \"577927b4-d8ee-4f29-a8b1-346579b3485c\") " pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:08:19.597049 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.597005    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/577927b4-d8ee-4f29-a8b1-346579b3485c-tmp-dir\") pod \"test-model-528913-kserve-7b9bb487f7-ppxgj\" (UID: \"577927b4-d8ee-4f29-a8b1-346579b3485c\") " pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:08:19.597105 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.597084    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/577927b4-d8ee-4f29-a8b1-346579b3485c-home\") pod \"test-model-528913-kserve-7b9bb487f7-ppxgj\" (UID: \"577927b4-d8ee-4f29-a8b1-346579b3485c\") " pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:08:19.597197 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.597180    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/577927b4-d8ee-4f29-a8b1-346579b3485c-model-cache\") pod \"test-model-528913-kserve-7b9bb487f7-ppxgj\" (UID: \"577927b4-d8ee-4f29-a8b1-346579b3485c\") " pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:08:19.598936 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.598912    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/577927b4-d8ee-4f29-a8b1-346579b3485c-dshm\") pod \"test-model-528913-kserve-7b9bb487f7-ppxgj\" (UID: \"577927b4-d8ee-4f29-a8b1-346579b3485c\") " pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:08:19.599222 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.599206    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/577927b4-d8ee-4f29-a8b1-346579b3485c-tls-certs\") pod \"test-model-528913-kserve-7b9bb487f7-ppxgj\" (UID: \"577927b4-d8ee-4f29-a8b1-346579b3485c\") " pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:08:19.604384 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.604366    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbp4k\" (UniqueName: \"kubernetes.io/projected/577927b4-d8ee-4f29-a8b1-346579b3485c-kube-api-access-vbp4k\") pod \"test-model-528913-kserve-7b9bb487f7-ppxgj\" (UID: \"577927b4-d8ee-4f29-a8b1-346579b3485c\") " pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:08:19.793458 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.793377    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:08:19.922219 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:19.922087    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"]
Jul 09 02:08:19.924963 ip-10-0-138-200 kubenswrapper[2562]: W0709 02:08:19.924938    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod577927b4_d8ee_4f29_a8b1_346579b3485c.slice/crio-658f89e187b8055c673a9d46c031281a0abcba5b99bfe78eb2793a7c2188f176 WatchSource:0}: Error finding container 658f89e187b8055c673a9d46c031281a0abcba5b99bfe78eb2793a7c2188f176: Status 404 returned error can't find the container with id 658f89e187b8055c673a9d46c031281a0abcba5b99bfe78eb2793a7c2188f176
Jul 09 02:08:20.775106 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:20.775073    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj" event={"ID":"577927b4-d8ee-4f29-a8b1-346579b3485c","Type":"ContainerStarted","Data":"a0309afd59145328601c98d6a7ef541a2e98e77ce83b0f0050d9c4993d7b46a8"}
Jul 09 02:08:20.775275 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:20.775113    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj" event={"ID":"577927b4-d8ee-4f29-a8b1-346579b3485c","Type":"ContainerStarted","Data":"658f89e187b8055c673a9d46c031281a0abcba5b99bfe78eb2793a7c2188f176"}
Jul 09 02:08:20.797635 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:20.797588    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj" podStartSLOduration=1.797574929 podStartE2EDuration="1.797574929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:08:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:08:20.796486632 +0000 UTC m=+1799.008138960" watchObservedRunningTime="2026-07-09 02:08:20.797574929 +0000 UTC m=+1799.009227265"
Jul 09 02:08:29.793804 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:29.793762    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:08:29.793804 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:29.793813    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:08:29.806173 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:29.806147    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:08:29.831152 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:08:29.831118    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:09:08.574432 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:08.574394    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"]
Jul 09 02:09:10.375517 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:10.375485    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9"]
Jul 09 02:09:10.375960 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:10.375696    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9" podUID="27547c27-1632-48b0-8fda-8d4c71eb6d67" containerName="maas-api" containerID="cri-o://c0a413d920bb9f6483450397f6465fe556ffc85206bf28620d55f90de096e8b8" gracePeriod=30
Jul 09 02:09:10.828673 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:10.828647    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9"
Jul 09 02:09:10.864826 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:10.864799    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kxwr\" (UniqueName: \"kubernetes.io/projected/27547c27-1632-48b0-8fda-8d4c71eb6d67-kube-api-access-4kxwr\") pod \"27547c27-1632-48b0-8fda-8d4c71eb6d67\" (UID: \"27547c27-1632-48b0-8fda-8d4c71eb6d67\") "
Jul 09 02:09:10.864988 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:10.864839    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27547c27-1632-48b0-8fda-8d4c71eb6d67-openshift-service-ca\") pod \"27547c27-1632-48b0-8fda-8d4c71eb6d67\" (UID: \"27547c27-1632-48b0-8fda-8d4c71eb6d67\") "
Jul 09 02:09:10.864988 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:10.864858    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27547c27-1632-48b0-8fda-8d4c71eb6d67-maas-api-tls\") pod \"27547c27-1632-48b0-8fda-8d4c71eb6d67\" (UID: \"27547c27-1632-48b0-8fda-8d4c71eb6d67\") "
Jul 09 02:09:10.865283 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:10.865255    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27547c27-1632-48b0-8fda-8d4c71eb6d67-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "27547c27-1632-48b0-8fda-8d4c71eb6d67" (UID: "27547c27-1632-48b0-8fda-8d4c71eb6d67"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:09:10.866982 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:10.866957    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27547c27-1632-48b0-8fda-8d4c71eb6d67-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "27547c27-1632-48b0-8fda-8d4c71eb6d67" (UID: "27547c27-1632-48b0-8fda-8d4c71eb6d67"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:09:10.867085 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:10.866996    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27547c27-1632-48b0-8fda-8d4c71eb6d67-kube-api-access-4kxwr" (OuterVolumeSpecName: "kube-api-access-4kxwr") pod "27547c27-1632-48b0-8fda-8d4c71eb6d67" (UID: "27547c27-1632-48b0-8fda-8d4c71eb6d67"). InnerVolumeSpecName "kube-api-access-4kxwr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:09:10.966099 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:10.965986    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kxwr\" (UniqueName: \"kubernetes.io/projected/27547c27-1632-48b0-8fda-8d4c71eb6d67-kube-api-access-4kxwr\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:09:10.966099 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:10.966037    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27547c27-1632-48b0-8fda-8d4c71eb6d67-openshift-service-ca\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:09:10.966099 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:10.966052    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27547c27-1632-48b0-8fda-8d4c71eb6d67-maas-api-tls\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:09:11.024714 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:11.024674    2562 generic.go:356] "Generic (PLEG): container finished" podID="27547c27-1632-48b0-8fda-8d4c71eb6d67" containerID="c0a413d920bb9f6483450397f6465fe556ffc85206bf28620d55f90de096e8b8" exitCode=0
Jul 09 02:09:11.024714 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:11.024714    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9"
Jul 09 02:09:11.024962 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:11.024751    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9" event={"ID":"27547c27-1632-48b0-8fda-8d4c71eb6d67","Type":"ContainerDied","Data":"c0a413d920bb9f6483450397f6465fe556ffc85206bf28620d55f90de096e8b8"}
Jul 09 02:09:11.024962 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:11.024807    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9" event={"ID":"27547c27-1632-48b0-8fda-8d4c71eb6d67","Type":"ContainerDied","Data":"b97e79705edd04a5bd93c3e25f1c2eb0858b70ace1b13e507022906e3efc9b17"}
Jul 09 02:09:11.024962 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:11.024829    2562 scope.go:117] "RemoveContainer" containerID="c0a413d920bb9f6483450397f6465fe556ffc85206bf28620d55f90de096e8b8"
Jul 09 02:09:11.034332 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:11.034305    2562 scope.go:117] "RemoveContainer" containerID="c0a413d920bb9f6483450397f6465fe556ffc85206bf28620d55f90de096e8b8"
Jul 09 02:09:11.034583 ip-10-0-138-200 kubenswrapper[2562]: E0709 02:09:11.034564    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0a413d920bb9f6483450397f6465fe556ffc85206bf28620d55f90de096e8b8\": container with ID starting with c0a413d920bb9f6483450397f6465fe556ffc85206bf28620d55f90de096e8b8 not found: ID does not exist" containerID="c0a413d920bb9f6483450397f6465fe556ffc85206bf28620d55f90de096e8b8"
Jul 09 02:09:11.034643 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:11.034594    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0a413d920bb9f6483450397f6465fe556ffc85206bf28620d55f90de096e8b8"} err="failed to get container status \"c0a413d920bb9f6483450397f6465fe556ffc85206bf28620d55f90de096e8b8\": rpc error: code = NotFound desc = could not find container \"c0a413d920bb9f6483450397f6465fe556ffc85206bf28620d55f90de096e8b8\": container with ID starting with c0a413d920bb9f6483450397f6465fe556ffc85206bf28620d55f90de096e8b8 not found: ID does not exist"
Jul 09 02:09:11.056142 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:11.056095    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9"]
Jul 09 02:09:11.060656 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:11.060618    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-528913-56cc6b478c-vhss9"]
Jul 09 02:09:12.157505 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:12.157470    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27547c27-1632-48b0-8fda-8d4c71eb6d67" path="/var/lib/kubelet/pods/27547c27-1632-48b0-8fda-8d4c71eb6d67/volumes"
Jul 09 02:09:23.594930 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:23.594884    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj" podUID="577927b4-d8ee-4f29-a8b1-346579b3485c" containerName="main" containerID="cri-o://a0309afd59145328601c98d6a7ef541a2e98e77ce83b0f0050d9c4993d7b46a8" gracePeriod=45
Jul 09 02:09:23.843558 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:23.843533    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:09:23.991683 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:23.991601    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/577927b4-d8ee-4f29-a8b1-346579b3485c-model-cache\") pod \"577927b4-d8ee-4f29-a8b1-346579b3485c\" (UID: \"577927b4-d8ee-4f29-a8b1-346579b3485c\") "
Jul 09 02:09:23.991683 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:23.991676    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/577927b4-d8ee-4f29-a8b1-346579b3485c-tls-certs\") pod \"577927b4-d8ee-4f29-a8b1-346579b3485c\" (UID: \"577927b4-d8ee-4f29-a8b1-346579b3485c\") "
Jul 09 02:09:23.991955 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:23.991728    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbp4k\" (UniqueName: \"kubernetes.io/projected/577927b4-d8ee-4f29-a8b1-346579b3485c-kube-api-access-vbp4k\") pod \"577927b4-d8ee-4f29-a8b1-346579b3485c\" (UID: \"577927b4-d8ee-4f29-a8b1-346579b3485c\") "
Jul 09 02:09:23.991955 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:23.991756    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/577927b4-d8ee-4f29-a8b1-346579b3485c-tmp-dir\") pod \"577927b4-d8ee-4f29-a8b1-346579b3485c\" (UID: \"577927b4-d8ee-4f29-a8b1-346579b3485c\") "
Jul 09 02:09:23.991955 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:23.991778    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/577927b4-d8ee-4f29-a8b1-346579b3485c-home\") pod \"577927b4-d8ee-4f29-a8b1-346579b3485c\" (UID: \"577927b4-d8ee-4f29-a8b1-346579b3485c\") "
Jul 09 02:09:23.991955 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:23.991798    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/577927b4-d8ee-4f29-a8b1-346579b3485c-dshm\") pod \"577927b4-d8ee-4f29-a8b1-346579b3485c\" (UID: \"577927b4-d8ee-4f29-a8b1-346579b3485c\") "
Jul 09 02:09:23.991955 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:23.991879    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/577927b4-d8ee-4f29-a8b1-346579b3485c-model-cache" (OuterVolumeSpecName: "model-cache") pod "577927b4-d8ee-4f29-a8b1-346579b3485c" (UID: "577927b4-d8ee-4f29-a8b1-346579b3485c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:09:23.992303 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:23.992060    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/577927b4-d8ee-4f29-a8b1-346579b3485c-home" (OuterVolumeSpecName: "home") pod "577927b4-d8ee-4f29-a8b1-346579b3485c" (UID: "577927b4-d8ee-4f29-a8b1-346579b3485c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:09:23.992303 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:23.992071    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/577927b4-d8ee-4f29-a8b1-346579b3485c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "577927b4-d8ee-4f29-a8b1-346579b3485c" (UID: "577927b4-d8ee-4f29-a8b1-346579b3485c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:09:23.992303 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:23.992155    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/577927b4-d8ee-4f29-a8b1-346579b3485c-model-cache\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:09:23.994291 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:23.994245    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/577927b4-d8ee-4f29-a8b1-346579b3485c-dshm" (OuterVolumeSpecName: "dshm") pod "577927b4-d8ee-4f29-a8b1-346579b3485c" (UID: "577927b4-d8ee-4f29-a8b1-346579b3485c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:09:23.994415 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:23.994325    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/577927b4-d8ee-4f29-a8b1-346579b3485c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "577927b4-d8ee-4f29-a8b1-346579b3485c" (UID: "577927b4-d8ee-4f29-a8b1-346579b3485c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:09:23.994415 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:23.994367    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/577927b4-d8ee-4f29-a8b1-346579b3485c-kube-api-access-vbp4k" (OuterVolumeSpecName: "kube-api-access-vbp4k") pod "577927b4-d8ee-4f29-a8b1-346579b3485c" (UID: "577927b4-d8ee-4f29-a8b1-346579b3485c"). InnerVolumeSpecName "kube-api-access-vbp4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:09:24.087291 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:24.087258    2562 generic.go:356] "Generic (PLEG): container finished" podID="577927b4-d8ee-4f29-a8b1-346579b3485c" containerID="a0309afd59145328601c98d6a7ef541a2e98e77ce83b0f0050d9c4993d7b46a8" exitCode=0
Jul 09 02:09:24.087485 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:24.087297    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"
Jul 09 02:09:24.087485 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:24.087352    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj" event={"ID":"577927b4-d8ee-4f29-a8b1-346579b3485c","Type":"ContainerDied","Data":"a0309afd59145328601c98d6a7ef541a2e98e77ce83b0f0050d9c4993d7b46a8"}
Jul 09 02:09:24.087485 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:24.087390    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj" event={"ID":"577927b4-d8ee-4f29-a8b1-346579b3485c","Type":"ContainerDied","Data":"658f89e187b8055c673a9d46c031281a0abcba5b99bfe78eb2793a7c2188f176"}
Jul 09 02:09:24.087485 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:24.087410    2562 scope.go:117] "RemoveContainer" containerID="a0309afd59145328601c98d6a7ef541a2e98e77ce83b0f0050d9c4993d7b46a8"
Jul 09 02:09:24.092709 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:24.092684    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/577927b4-d8ee-4f29-a8b1-346579b3485c-tls-certs\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:09:24.092814 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:24.092713    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbp4k\" (UniqueName: \"kubernetes.io/projected/577927b4-d8ee-4f29-a8b1-346579b3485c-kube-api-access-vbp4k\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:09:24.092814 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:24.092727    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/577927b4-d8ee-4f29-a8b1-346579b3485c-tmp-dir\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:09:24.092814 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:24.092740    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/577927b4-d8ee-4f29-a8b1-346579b3485c-home\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:09:24.092814 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:24.092751    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/577927b4-d8ee-4f29-a8b1-346579b3485c-dshm\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:09:24.096159 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:24.096144    2562 scope.go:117] "RemoveContainer" containerID="a0309afd59145328601c98d6a7ef541a2e98e77ce83b0f0050d9c4993d7b46a8"
Jul 09 02:09:24.096400 ip-10-0-138-200 kubenswrapper[2562]: E0709 02:09:24.096383    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0309afd59145328601c98d6a7ef541a2e98e77ce83b0f0050d9c4993d7b46a8\": container with ID starting with a0309afd59145328601c98d6a7ef541a2e98e77ce83b0f0050d9c4993d7b46a8 not found: ID does not exist" containerID="a0309afd59145328601c98d6a7ef541a2e98e77ce83b0f0050d9c4993d7b46a8"
Jul 09 02:09:24.096449 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:24.096407    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0309afd59145328601c98d6a7ef541a2e98e77ce83b0f0050d9c4993d7b46a8"} err="failed to get container status \"a0309afd59145328601c98d6a7ef541a2e98e77ce83b0f0050d9c4993d7b46a8\": rpc error: code = NotFound desc = could not find container \"a0309afd59145328601c98d6a7ef541a2e98e77ce83b0f0050d9c4993d7b46a8\": container with ID starting with a0309afd59145328601c98d6a7ef541a2e98e77ce83b0f0050d9c4993d7b46a8 not found: ID does not exist"
Jul 09 02:09:24.114335 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:24.114298    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"]
Jul 09 02:09:24.114826 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:24.114798    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-528913/test-model-528913-kserve-7b9bb487f7-ppxgj"]
Jul 09 02:09:24.158271 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:24.158246    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="577927b4-d8ee-4f29-a8b1-346579b3485c" path="/var/lib/kubelet/pods/577927b4-d8ee-4f29-a8b1-346579b3485c/volumes"
Jul 09 02:09:53.594154 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:53.594071    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr"]
Jul 09 02:09:53.594634 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:53.594355    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr" podUID="f79bb97c-4bc4-48ec-897a-f83cc2f1d077" containerName="maas-api" containerID="cri-o://3e3e8e3911bd14a98fb2fb3f3b36d14976a333efe79f7ef0977ea9c8ccdb0bb7" gracePeriod=30
Jul 09 02:09:53.739268 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:53.739220    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr" podUID="f79bb97c-4bc4-48ec-897a-f83cc2f1d077" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.43:8443/health\": dial tcp 10.134.0.43:8443: connect: connection refused"
Jul 09 02:09:53.836746 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:53.836721    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr"
Jul 09 02:09:53.868296 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:53.868225    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vkmr\" (UniqueName: \"kubernetes.io/projected/f79bb97c-4bc4-48ec-897a-f83cc2f1d077-kube-api-access-8vkmr\") pod \"f79bb97c-4bc4-48ec-897a-f83cc2f1d077\" (UID: \"f79bb97c-4bc4-48ec-897a-f83cc2f1d077\") "
Jul 09 02:09:53.868445 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:53.868297    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f79bb97c-4bc4-48ec-897a-f83cc2f1d077-openshift-service-ca\") pod \"f79bb97c-4bc4-48ec-897a-f83cc2f1d077\" (UID: \"f79bb97c-4bc4-48ec-897a-f83cc2f1d077\") "
Jul 09 02:09:53.868445 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:53.868317    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f79bb97c-4bc4-48ec-897a-f83cc2f1d077-maas-api-tls\") pod \"f79bb97c-4bc4-48ec-897a-f83cc2f1d077\" (UID: \"f79bb97c-4bc4-48ec-897a-f83cc2f1d077\") "
Jul 09 02:09:53.868657 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:53.868636    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f79bb97c-4bc4-48ec-897a-f83cc2f1d077-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f79bb97c-4bc4-48ec-897a-f83cc2f1d077" (UID: "f79bb97c-4bc4-48ec-897a-f83cc2f1d077"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:09:53.870348 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:53.870314    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f79bb97c-4bc4-48ec-897a-f83cc2f1d077-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f79bb97c-4bc4-48ec-897a-f83cc2f1d077" (UID: "f79bb97c-4bc4-48ec-897a-f83cc2f1d077"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:09:53.870442 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:53.870352    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f79bb97c-4bc4-48ec-897a-f83cc2f1d077-kube-api-access-8vkmr" (OuterVolumeSpecName: "kube-api-access-8vkmr") pod "f79bb97c-4bc4-48ec-897a-f83cc2f1d077" (UID: "f79bb97c-4bc4-48ec-897a-f83cc2f1d077"). InnerVolumeSpecName "kube-api-access-8vkmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:09:53.969854 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:53.969809    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vkmr\" (UniqueName: \"kubernetes.io/projected/f79bb97c-4bc4-48ec-897a-f83cc2f1d077-kube-api-access-8vkmr\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:09:53.969854 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:53.969844    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f79bb97c-4bc4-48ec-897a-f83cc2f1d077-openshift-service-ca\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:09:53.969854 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:53.969855    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f79bb97c-4bc4-48ec-897a-f83cc2f1d077-maas-api-tls\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:09:54.227437 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:54.227406    2562 generic.go:356] "Generic (PLEG): container finished" podID="f79bb97c-4bc4-48ec-897a-f83cc2f1d077" containerID="3e3e8e3911bd14a98fb2fb3f3b36d14976a333efe79f7ef0977ea9c8ccdb0bb7" exitCode=0
Jul 09 02:09:54.227618 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:54.227450    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr"
Jul 09 02:09:54.227618 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:54.227458    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr" event={"ID":"f79bb97c-4bc4-48ec-897a-f83cc2f1d077","Type":"ContainerDied","Data":"3e3e8e3911bd14a98fb2fb3f3b36d14976a333efe79f7ef0977ea9c8ccdb0bb7"}
Jul 09 02:09:54.227618 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:54.227509    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr" event={"ID":"f79bb97c-4bc4-48ec-897a-f83cc2f1d077","Type":"ContainerDied","Data":"3fbdc49784e32dbfa13e0c9a0dc1d3ed0901686353fadf95e4a667a211ef3cba"}
Jul 09 02:09:54.227618 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:54.227537    2562 scope.go:117] "RemoveContainer" containerID="3e3e8e3911bd14a98fb2fb3f3b36d14976a333efe79f7ef0977ea9c8ccdb0bb7"
Jul 09 02:09:54.236495 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:54.236478    2562 scope.go:117] "RemoveContainer" containerID="3e3e8e3911bd14a98fb2fb3f3b36d14976a333efe79f7ef0977ea9c8ccdb0bb7"
Jul 09 02:09:54.236802 ip-10-0-138-200 kubenswrapper[2562]: E0709 02:09:54.236776    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e3e8e3911bd14a98fb2fb3f3b36d14976a333efe79f7ef0977ea9c8ccdb0bb7\": container with ID starting with 3e3e8e3911bd14a98fb2fb3f3b36d14976a333efe79f7ef0977ea9c8ccdb0bb7 not found: ID does not exist" containerID="3e3e8e3911bd14a98fb2fb3f3b36d14976a333efe79f7ef0977ea9c8ccdb0bb7"
Jul 09 02:09:54.236887 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:54.236812    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e3e8e3911bd14a98fb2fb3f3b36d14976a333efe79f7ef0977ea9c8ccdb0bb7"} err="failed to get container status \"3e3e8e3911bd14a98fb2fb3f3b36d14976a333efe79f7ef0977ea9c8ccdb0bb7\": rpc error: code = NotFound desc = could not find container \"3e3e8e3911bd14a98fb2fb3f3b36d14976a333efe79f7ef0977ea9c8ccdb0bb7\": container with ID starting with 3e3e8e3911bd14a98fb2fb3f3b36d14976a333efe79f7ef0977ea9c8ccdb0bb7 not found: ID does not exist"
Jul 09 02:09:54.246850 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:54.246828    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr"]
Jul 09 02:09:54.251443 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:54.251421    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-65e1b4-67b7d4d54f-zgfbr"]
Jul 09 02:09:56.157931 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:09:56.157899    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f79bb97c-4bc4-48ec-897a-f83cc2f1d077" path="/var/lib/kubelet/pods/f79bb97c-4bc4-48ec-897a-f83cc2f1d077/volumes"
Jul 09 02:10:03.638314 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:03.638278    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b"]
Jul 09 02:10:03.638819 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:03.638674    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f79bb97c-4bc4-48ec-897a-f83cc2f1d077" containerName="maas-api"
Jul 09 02:10:03.638819 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:03.638687    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f79bb97c-4bc4-48ec-897a-f83cc2f1d077" containerName="maas-api"
Jul 09 02:10:03.638819 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:03.638698    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="577927b4-d8ee-4f29-a8b1-346579b3485c" containerName="main"
Jul 09 02:10:03.638819 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:03.638703    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="577927b4-d8ee-4f29-a8b1-346579b3485c" containerName="main"
Jul 09 02:10:03.638819 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:03.638722    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27547c27-1632-48b0-8fda-8d4c71eb6d67" containerName="maas-api"
Jul 09 02:10:03.638819 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:03.638730    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="27547c27-1632-48b0-8fda-8d4c71eb6d67" containerName="maas-api"
Jul 09 02:10:03.638819 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:03.638802    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="577927b4-d8ee-4f29-a8b1-346579b3485c" containerName="main"
Jul 09 02:10:03.638819 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:03.638810    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="27547c27-1632-48b0-8fda-8d4c71eb6d67" containerName="maas-api"
Jul 09 02:10:03.638819 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:03.638818    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f79bb97c-4bc4-48ec-897a-f83cc2f1d077" containerName="maas-api"
Jul 09 02:10:03.642345 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:03.642322    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b"
Jul 09 02:10:03.645475 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:03.645455    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 02:10:03.646618 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:03.646600    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 02:10:03.646618 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:03.646611    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-fbb202-serving-cert\""
Jul 09 02:10:03.646775 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:03.646620    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dmx8z\""
Jul 09 02:10:03.651287 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:03.651265    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b"]
Jul 09 02:10:03.760854 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:03.760817    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x7gq\" (UniqueName: \"kubernetes.io/projected/4d996260-2967-4ac3-acf7-77c50574cc94-kube-api-access-9x7gq\") pod \"maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b\" (UID: \"4d996260-2967-4ac3-acf7-77c50574cc94\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b"
Jul 09 02:10:03.761053 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:03.760871    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d996260-2967-4ac3-acf7-77c50574cc94-openshift-service-ca\") pod \"maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b\" (UID: \"4d996260-2967-4ac3-acf7-77c50574cc94\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b"
Jul 09 02:10:03.761053 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:03.760890    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d996260-2967-4ac3-acf7-77c50574cc94-maas-api-tls\") pod \"maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b\" (UID: \"4d996260-2967-4ac3-acf7-77c50574cc94\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b"
Jul 09 02:10:03.861653 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:03.861618    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d996260-2967-4ac3-acf7-77c50574cc94-openshift-service-ca\") pod \"maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b\" (UID: \"4d996260-2967-4ac3-acf7-77c50574cc94\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b"
Jul 09 02:10:03.861653 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:03.861658    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d996260-2967-4ac3-acf7-77c50574cc94-maas-api-tls\") pod \"maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b\" (UID: \"4d996260-2967-4ac3-acf7-77c50574cc94\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b"
Jul 09 02:10:03.861821 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:03.861734    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x7gq\" (UniqueName: \"kubernetes.io/projected/4d996260-2967-4ac3-acf7-77c50574cc94-kube-api-access-9x7gq\") pod \"maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b\" (UID: \"4d996260-2967-4ac3-acf7-77c50574cc94\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b"
Jul 09 02:10:03.861863 ip-10-0-138-200 kubenswrapper[2562]: E0709 02:10:03.861843    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-serving-cert: secret "maas-api-e2e-api-a-fbb202-serving-cert" not found
Jul 09 02:10:03.861921 ip-10-0-138-200 kubenswrapper[2562]: E0709 02:10:03.861911    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d996260-2967-4ac3-acf7-77c50574cc94-maas-api-tls podName:4d996260-2967-4ac3-acf7-77c50574cc94 nodeName:}" failed. No retries permitted until 2026-07-09 02:10:04.361893962 +0000 UTC m=+1902.573546279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4d996260-2967-4ac3-acf7-77c50574cc94-maas-api-tls") pod "maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b" (UID: "4d996260-2967-4ac3-acf7-77c50574cc94") : secret "maas-api-e2e-api-a-fbb202-serving-cert" not found
Jul 09 02:10:03.862287 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:03.862269    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d996260-2967-4ac3-acf7-77c50574cc94-openshift-service-ca\") pod \"maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b\" (UID: \"4d996260-2967-4ac3-acf7-77c50574cc94\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b"
Jul 09 02:10:03.873761 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:03.873740    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x7gq\" (UniqueName: \"kubernetes.io/projected/4d996260-2967-4ac3-acf7-77c50574cc94-kube-api-access-9x7gq\") pod \"maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b\" (UID: \"4d996260-2967-4ac3-acf7-77c50574cc94\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b"
Jul 09 02:10:04.366473 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:04.366443    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d996260-2967-4ac3-acf7-77c50574cc94-maas-api-tls\") pod \"maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b\" (UID: \"4d996260-2967-4ac3-acf7-77c50574cc94\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b"
Jul 09 02:10:04.368817 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:04.368787    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d996260-2967-4ac3-acf7-77c50574cc94-maas-api-tls\") pod \"maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b\" (UID: \"4d996260-2967-4ac3-acf7-77c50574cc94\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b"
Jul 09 02:10:04.554417 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:04.554388    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b"
Jul 09 02:10:04.686886 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:04.686857    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b"]
Jul 09 02:10:04.689079 ip-10-0-138-200 kubenswrapper[2562]: W0709 02:10:04.689051    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d996260_2967_4ac3_acf7_77c50574cc94.slice/crio-9950acc66de468a6f567eba67d32cff0e5e87cda0b9a62e456ab48b5129ba2a4 WatchSource:0}: Error finding container 9950acc66de468a6f567eba67d32cff0e5e87cda0b9a62e456ab48b5129ba2a4: Status 404 returned error can't find the container with id 9950acc66de468a6f567eba67d32cff0e5e87cda0b9a62e456ab48b5129ba2a4
Jul 09 02:10:05.283338 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:05.283303    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b" event={"ID":"4d996260-2967-4ac3-acf7-77c50574cc94","Type":"ContainerStarted","Data":"9950acc66de468a6f567eba67d32cff0e5e87cda0b9a62e456ab48b5129ba2a4"}
Jul 09 02:10:06.289461 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:06.289420    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b" event={"ID":"4d996260-2967-4ac3-acf7-77c50574cc94","Type":"ContainerStarted","Data":"e66fa6f6be9cc4b18cc9a92118d6026c3db57d666db5c094b633cbaf53d8f61a"}
Jul 09 02:10:06.289858 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:06.289494    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b"
Jul 09 02:10:06.311031 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:06.310975    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b" podStartSLOduration=2.7805703939999997 podStartE2EDuration="3.310957956s" totalImagesPullingTime="530.387562ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:10:06.308905747 +0000 UTC m=+1904.520558079" watchObservedRunningTime="2026-07-09 02:10:06.310957956 +0000 UTC m=+1904.522610292"
Jul 09 02:10:11.823347 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:11.823298    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64"]
Jul 09 02:10:11.827369 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:11.827334    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64"
Jul 09 02:10:11.830078 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:11.830055    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-8d3ee6-serving-cert\""
Jul 09 02:10:11.838734 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:11.838705    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64"]
Jul 09 02:10:11.931382 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:11.931343    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct566\" (UniqueName: \"kubernetes.io/projected/20dca291-cedd-45d7-85e7-a551894f5069-kube-api-access-ct566\") pod \"maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64\" (UID: \"20dca291-cedd-45d7-85e7-a551894f5069\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64"
Jul 09 02:10:11.931382 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:11.931394    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20dca291-cedd-45d7-85e7-a551894f5069-openshift-service-ca\") pod \"maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64\" (UID: \"20dca291-cedd-45d7-85e7-a551894f5069\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64"
Jul 09 02:10:11.931658 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:11.931413    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20dca291-cedd-45d7-85e7-a551894f5069-maas-api-tls\") pod \"maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64\" (UID: \"20dca291-cedd-45d7-85e7-a551894f5069\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64"
Jul 09 02:10:12.032588 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:12.032550    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct566\" (UniqueName: \"kubernetes.io/projected/20dca291-cedd-45d7-85e7-a551894f5069-kube-api-access-ct566\") pod \"maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64\" (UID: \"20dca291-cedd-45d7-85e7-a551894f5069\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64"
Jul 09 02:10:12.032753 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:12.032602    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20dca291-cedd-45d7-85e7-a551894f5069-openshift-service-ca\") pod \"maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64\" (UID: \"20dca291-cedd-45d7-85e7-a551894f5069\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64"
Jul 09 02:10:12.032753 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:12.032719    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20dca291-cedd-45d7-85e7-a551894f5069-maas-api-tls\") pod \"maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64\" (UID: \"20dca291-cedd-45d7-85e7-a551894f5069\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64"
Jul 09 02:10:12.032896 ip-10-0-138-200 kubenswrapper[2562]: E0709 02:10:12.032870    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-serving-cert: secret "maas-api-e2e-api-b-8d3ee6-serving-cert" not found
Jul 09 02:10:12.032975 ip-10-0-138-200 kubenswrapper[2562]: E0709 02:10:12.032961    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20dca291-cedd-45d7-85e7-a551894f5069-maas-api-tls podName:20dca291-cedd-45d7-85e7-a551894f5069 nodeName:}" failed. No retries permitted until 2026-07-09 02:10:12.53293777 +0000 UTC m=+1910.744590162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/20dca291-cedd-45d7-85e7-a551894f5069-maas-api-tls") pod "maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64" (UID: "20dca291-cedd-45d7-85e7-a551894f5069") : secret "maas-api-e2e-api-b-8d3ee6-serving-cert" not found
Jul 09 02:10:12.033237 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:12.033220    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20dca291-cedd-45d7-85e7-a551894f5069-openshift-service-ca\") pod \"maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64\" (UID: \"20dca291-cedd-45d7-85e7-a551894f5069\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64"
Jul 09 02:10:12.041661 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:12.041638    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct566\" (UniqueName: \"kubernetes.io/projected/20dca291-cedd-45d7-85e7-a551894f5069-kube-api-access-ct566\") pod \"maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64\" (UID: \"20dca291-cedd-45d7-85e7-a551894f5069\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64"
Jul 09 02:10:12.299506 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:12.299431    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b"
Jul 09 02:10:12.538130 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:12.538090    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20dca291-cedd-45d7-85e7-a551894f5069-maas-api-tls\") pod \"maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64\" (UID: \"20dca291-cedd-45d7-85e7-a551894f5069\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64"
Jul 09 02:10:12.540509 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:12.540487    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20dca291-cedd-45d7-85e7-a551894f5069-maas-api-tls\") pod \"maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64\" (UID: \"20dca291-cedd-45d7-85e7-a551894f5069\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64"
Jul 09 02:10:12.739789 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:12.739751    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64"
Jul 09 02:10:12.875606 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:12.875583    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64"]
Jul 09 02:10:12.877504 ip-10-0-138-200 kubenswrapper[2562]: W0709 02:10:12.877474    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20dca291_cedd_45d7_85e7_a551894f5069.slice/crio-3028856f89190aadc60887ae0f33308df5ffed1207bd395bed650d83ed204c77 WatchSource:0}: Error finding container 3028856f89190aadc60887ae0f33308df5ffed1207bd395bed650d83ed204c77: Status 404 returned error can't find the container with id 3028856f89190aadc60887ae0f33308df5ffed1207bd395bed650d83ed204c77
Jul 09 02:10:13.325457 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:13.325418    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64" event={"ID":"20dca291-cedd-45d7-85e7-a551894f5069","Type":"ContainerStarted","Data":"3e5f410272cd018e35d22568d5bd4e72ed4c581e5c0b2be66883ffca4b46f1ce"}
Jul 09 02:10:13.325629 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:13.325473    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64" event={"ID":"20dca291-cedd-45d7-85e7-a551894f5069","Type":"ContainerStarted","Data":"3028856f89190aadc60887ae0f33308df5ffed1207bd395bed650d83ed204c77"}
Jul 09 02:10:13.325629 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:13.325508    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64"
Jul 09 02:10:13.344585 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:13.344534    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64" podStartSLOduration=2.051714936 podStartE2EDuration="2.344516765s" totalImagesPullingTime="292.801829ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:10:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:10:13.342565612 +0000 UTC m=+1911.554217949" watchObservedRunningTime="2026-07-09 02:10:13.344516765 +0000 UTC m=+1911.556169100"
Jul 09 02:10:19.336174 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:19.336146    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64"
Jul 09 02:10:24.905112 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:24.905069    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b"]
Jul 09 02:10:24.905543 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:24.905282    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b" podUID="4d996260-2967-4ac3-acf7-77c50574cc94" containerName="maas-api" containerID="cri-o://e66fa6f6be9cc4b18cc9a92118d6026c3db57d666db5c094b633cbaf53d8f61a" gracePeriod=30
Jul 09 02:10:25.151596 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:25.151565    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b"
Jul 09 02:10:25.249923 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:25.249836    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d996260-2967-4ac3-acf7-77c50574cc94-openshift-service-ca\") pod \"4d996260-2967-4ac3-acf7-77c50574cc94\" (UID: \"4d996260-2967-4ac3-acf7-77c50574cc94\") "
Jul 09 02:10:25.250074 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:25.249946    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9x7gq\" (UniqueName: \"kubernetes.io/projected/4d996260-2967-4ac3-acf7-77c50574cc94-kube-api-access-9x7gq\") pod \"4d996260-2967-4ac3-acf7-77c50574cc94\" (UID: \"4d996260-2967-4ac3-acf7-77c50574cc94\") "
Jul 09 02:10:25.250074 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:25.249969    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d996260-2967-4ac3-acf7-77c50574cc94-maas-api-tls\") pod \"4d996260-2967-4ac3-acf7-77c50574cc94\" (UID: \"4d996260-2967-4ac3-acf7-77c50574cc94\") "
Jul 09 02:10:25.250317 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:25.250278    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d996260-2967-4ac3-acf7-77c50574cc94-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4d996260-2967-4ac3-acf7-77c50574cc94" (UID: "4d996260-2967-4ac3-acf7-77c50574cc94"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:10:25.250721 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:25.250634    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d996260-2967-4ac3-acf7-77c50574cc94-openshift-service-ca\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:10:25.252610 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:25.252589    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d996260-2967-4ac3-acf7-77c50574cc94-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4d996260-2967-4ac3-acf7-77c50574cc94" (UID: "4d996260-2967-4ac3-acf7-77c50574cc94"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:10:25.252610 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:25.252601    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d996260-2967-4ac3-acf7-77c50574cc94-kube-api-access-9x7gq" (OuterVolumeSpecName: "kube-api-access-9x7gq") pod "4d996260-2967-4ac3-acf7-77c50574cc94" (UID: "4d996260-2967-4ac3-acf7-77c50574cc94"). InnerVolumeSpecName "kube-api-access-9x7gq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:10:25.352135 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:25.352103    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9x7gq\" (UniqueName: \"kubernetes.io/projected/4d996260-2967-4ac3-acf7-77c50574cc94-kube-api-access-9x7gq\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:10:25.352135 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:25.352131    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d996260-2967-4ac3-acf7-77c50574cc94-maas-api-tls\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:10:25.393346 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:25.393315    2562 generic.go:356] "Generic (PLEG): container finished" podID="4d996260-2967-4ac3-acf7-77c50574cc94" containerID="e66fa6f6be9cc4b18cc9a92118d6026c3db57d666db5c094b633cbaf53d8f61a" exitCode=0
Jul 09 02:10:25.393513 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:25.393361    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b"
Jul 09 02:10:25.393513 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:25.393406    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b" event={"ID":"4d996260-2967-4ac3-acf7-77c50574cc94","Type":"ContainerDied","Data":"e66fa6f6be9cc4b18cc9a92118d6026c3db57d666db5c094b633cbaf53d8f61a"}
Jul 09 02:10:25.393513 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:25.393467    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b" event={"ID":"4d996260-2967-4ac3-acf7-77c50574cc94","Type":"ContainerDied","Data":"9950acc66de468a6f567eba67d32cff0e5e87cda0b9a62e456ab48b5129ba2a4"}
Jul 09 02:10:25.393513 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:25.393495    2562 scope.go:117] "RemoveContainer" containerID="e66fa6f6be9cc4b18cc9a92118d6026c3db57d666db5c094b633cbaf53d8f61a"
Jul 09 02:10:25.402399 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:25.402385    2562 scope.go:117] "RemoveContainer" containerID="e66fa6f6be9cc4b18cc9a92118d6026c3db57d666db5c094b633cbaf53d8f61a"
Jul 09 02:10:25.402648 ip-10-0-138-200 kubenswrapper[2562]: E0709 02:10:25.402631    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e66fa6f6be9cc4b18cc9a92118d6026c3db57d666db5c094b633cbaf53d8f61a\": container with ID starting with e66fa6f6be9cc4b18cc9a92118d6026c3db57d666db5c094b633cbaf53d8f61a not found: ID does not exist" containerID="e66fa6f6be9cc4b18cc9a92118d6026c3db57d666db5c094b633cbaf53d8f61a"
Jul 09 02:10:25.402688 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:25.402656    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e66fa6f6be9cc4b18cc9a92118d6026c3db57d666db5c094b633cbaf53d8f61a"} err="failed to get container status \"e66fa6f6be9cc4b18cc9a92118d6026c3db57d666db5c094b633cbaf53d8f61a\": rpc error: code = NotFound desc = could not find container \"e66fa6f6be9cc4b18cc9a92118d6026c3db57d666db5c094b633cbaf53d8f61a\": container with ID starting with e66fa6f6be9cc4b18cc9a92118d6026c3db57d666db5c094b633cbaf53d8f61a not found: ID does not exist"
Jul 09 02:10:25.416091 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:25.416067    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b"]
Jul 09 02:10:25.422264 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:25.422244    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-fbb202-84d9d9f7cd-wrb5b"]
Jul 09 02:10:26.157963 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:26.157930    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d996260-2967-4ac3-acf7-77c50574cc94" path="/var/lib/kubelet/pods/4d996260-2967-4ac3-acf7-77c50574cc94/volumes"
Jul 09 02:10:32.362028 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:32.361982    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64"]
Jul 09 02:10:32.362420 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:32.362236    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64" podUID="20dca291-cedd-45d7-85e7-a551894f5069" containerName="maas-api" containerID="cri-o://3e5f410272cd018e35d22568d5bd4e72ed4c581e5c0b2be66883ffca4b46f1ce" gracePeriod=30
Jul 09 02:10:32.605804 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:32.605773    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64"
Jul 09 02:10:32.718411 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:32.718332    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct566\" (UniqueName: \"kubernetes.io/projected/20dca291-cedd-45d7-85e7-a551894f5069-kube-api-access-ct566\") pod \"20dca291-cedd-45d7-85e7-a551894f5069\" (UID: \"20dca291-cedd-45d7-85e7-a551894f5069\") "
Jul 09 02:10:32.718411 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:32.718398    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20dca291-cedd-45d7-85e7-a551894f5069-openshift-service-ca\") pod \"20dca291-cedd-45d7-85e7-a551894f5069\" (UID: \"20dca291-cedd-45d7-85e7-a551894f5069\") "
Jul 09 02:10:32.718641 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:32.718441    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20dca291-cedd-45d7-85e7-a551894f5069-maas-api-tls\") pod \"20dca291-cedd-45d7-85e7-a551894f5069\" (UID: \"20dca291-cedd-45d7-85e7-a551894f5069\") "
Jul 09 02:10:32.718766 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:32.718742    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20dca291-cedd-45d7-85e7-a551894f5069-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "20dca291-cedd-45d7-85e7-a551894f5069" (UID: "20dca291-cedd-45d7-85e7-a551894f5069"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:10:32.720418 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:32.720385    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20dca291-cedd-45d7-85e7-a551894f5069-kube-api-access-ct566" (OuterVolumeSpecName: "kube-api-access-ct566") pod "20dca291-cedd-45d7-85e7-a551894f5069" (UID: "20dca291-cedd-45d7-85e7-a551894f5069"). InnerVolumeSpecName "kube-api-access-ct566". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:10:32.720527 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:32.720462    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20dca291-cedd-45d7-85e7-a551894f5069-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "20dca291-cedd-45d7-85e7-a551894f5069" (UID: "20dca291-cedd-45d7-85e7-a551894f5069"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:10:32.820079 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:32.820050    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20dca291-cedd-45d7-85e7-a551894f5069-openshift-service-ca\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:10:32.820079 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:32.820075    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20dca291-cedd-45d7-85e7-a551894f5069-maas-api-tls\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:10:32.820214 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:32.820089    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct566\" (UniqueName: \"kubernetes.io/projected/20dca291-cedd-45d7-85e7-a551894f5069-kube-api-access-ct566\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:10:33.431947 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:33.431912    2562 generic.go:356] "Generic (PLEG): container finished" podID="20dca291-cedd-45d7-85e7-a551894f5069" containerID="3e5f410272cd018e35d22568d5bd4e72ed4c581e5c0b2be66883ffca4b46f1ce" exitCode=0
Jul 09 02:10:33.432405 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:33.431969    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64" event={"ID":"20dca291-cedd-45d7-85e7-a551894f5069","Type":"ContainerDied","Data":"3e5f410272cd018e35d22568d5bd4e72ed4c581e5c0b2be66883ffca4b46f1ce"}
Jul 09 02:10:33.432405 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:33.431972    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64"
Jul 09 02:10:33.432405 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:33.432049    2562 scope.go:117] "RemoveContainer" containerID="3e5f410272cd018e35d22568d5bd4e72ed4c581e5c0b2be66883ffca4b46f1ce"
Jul 09 02:10:33.432405 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:33.432038    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64" event={"ID":"20dca291-cedd-45d7-85e7-a551894f5069","Type":"ContainerDied","Data":"3028856f89190aadc60887ae0f33308df5ffed1207bd395bed650d83ed204c77"}
Jul 09 02:10:33.441380 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:33.441362    2562 scope.go:117] "RemoveContainer" containerID="3e5f410272cd018e35d22568d5bd4e72ed4c581e5c0b2be66883ffca4b46f1ce"
Jul 09 02:10:33.441646 ip-10-0-138-200 kubenswrapper[2562]: E0709 02:10:33.441625    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e5f410272cd018e35d22568d5bd4e72ed4c581e5c0b2be66883ffca4b46f1ce\": container with ID starting with 3e5f410272cd018e35d22568d5bd4e72ed4c581e5c0b2be66883ffca4b46f1ce not found: ID does not exist" containerID="3e5f410272cd018e35d22568d5bd4e72ed4c581e5c0b2be66883ffca4b46f1ce"
Jul 09 02:10:33.441700 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:33.441655    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e5f410272cd018e35d22568d5bd4e72ed4c581e5c0b2be66883ffca4b46f1ce"} err="failed to get container status \"3e5f410272cd018e35d22568d5bd4e72ed4c581e5c0b2be66883ffca4b46f1ce\": rpc error: code = NotFound desc = could not find container \"3e5f410272cd018e35d22568d5bd4e72ed4c581e5c0b2be66883ffca4b46f1ce\": container with ID starting with 3e5f410272cd018e35d22568d5bd4e72ed4c581e5c0b2be66883ffca4b46f1ce not found: ID does not exist"
Jul 09 02:10:33.457791 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:33.457762    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64"]
Jul 09 02:10:33.461195 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:33.461174    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8d3ee6-6745b5d448-t5l64"]
Jul 09 02:10:34.157117 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:34.157078    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20dca291-cedd-45d7-85e7-a551894f5069" path="/var/lib/kubelet/pods/20dca291-cedd-45d7-85e7-a551894f5069/volumes"
Jul 09 02:10:41.878562 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:41.878527    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769"]
Jul 09 02:10:41.879124 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:41.879106    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d996260-2967-4ac3-acf7-77c50574cc94" containerName="maas-api"
Jul 09 02:10:41.879218 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:41.879126    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d996260-2967-4ac3-acf7-77c50574cc94" containerName="maas-api"
Jul 09 02:10:41.879218 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:41.879143    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20dca291-cedd-45d7-85e7-a551894f5069" containerName="maas-api"
Jul 09 02:10:41.879218 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:41.879151    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="20dca291-cedd-45d7-85e7-a551894f5069" containerName="maas-api"
Jul 09 02:10:41.879375 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:41.879241    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="20dca291-cedd-45d7-85e7-a551894f5069" containerName="maas-api"
Jul 09 02:10:41.879375 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:41.879258    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d996260-2967-4ac3-acf7-77c50574cc94" containerName="maas-api"
Jul 09 02:10:41.883560 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:41.883539    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769"
Jul 09 02:10:41.886636 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:41.886616    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 02:10:41.886771 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:41.886649    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-77db86-serving-cert\""
Jul 09 02:10:41.886771 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:41.886656    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dmx8z\""
Jul 09 02:10:41.887761 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:41.887743    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 02:10:41.893635 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:41.893613    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769"]
Jul 09 02:10:42.006377 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:42.006337    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50bac1d1-7683-4017-ba71-35c272f142aa-maas-api-tls\") pod \"maas-api-e2e-shared-a-77db86-6cc97b4449-5v769\" (UID: \"50bac1d1-7683-4017-ba71-35c272f142aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769"
Jul 09 02:10:42.006577 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:42.006402    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnf55\" (UniqueName: \"kubernetes.io/projected/50bac1d1-7683-4017-ba71-35c272f142aa-kube-api-access-vnf55\") pod \"maas-api-e2e-shared-a-77db86-6cc97b4449-5v769\" (UID: \"50bac1d1-7683-4017-ba71-35c272f142aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769"
Jul 09 02:10:42.006577 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:42.006491    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50bac1d1-7683-4017-ba71-35c272f142aa-openshift-service-ca\") pod \"maas-api-e2e-shared-a-77db86-6cc97b4449-5v769\" (UID: \"50bac1d1-7683-4017-ba71-35c272f142aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769"
Jul 09 02:10:42.107654 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:42.107618    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50bac1d1-7683-4017-ba71-35c272f142aa-openshift-service-ca\") pod \"maas-api-e2e-shared-a-77db86-6cc97b4449-5v769\" (UID: \"50bac1d1-7683-4017-ba71-35c272f142aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769"
Jul 09 02:10:42.107831 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:42.107706    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50bac1d1-7683-4017-ba71-35c272f142aa-maas-api-tls\") pod \"maas-api-e2e-shared-a-77db86-6cc97b4449-5v769\" (UID: \"50bac1d1-7683-4017-ba71-35c272f142aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769"
Jul 09 02:10:42.107831 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:42.107797    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnf55\" (UniqueName: \"kubernetes.io/projected/50bac1d1-7683-4017-ba71-35c272f142aa-kube-api-access-vnf55\") pod \"maas-api-e2e-shared-a-77db86-6cc97b4449-5v769\" (UID: \"50bac1d1-7683-4017-ba71-35c272f142aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769"
Jul 09 02:10:42.107905 ip-10-0-138-200 kubenswrapper[2562]: E0709 02:10:42.107855    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-serving-cert: secret "maas-api-e2e-shared-a-77db86-serving-cert" not found
Jul 09 02:10:42.107945 ip-10-0-138-200 kubenswrapper[2562]: E0709 02:10:42.107930    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50bac1d1-7683-4017-ba71-35c272f142aa-maas-api-tls podName:50bac1d1-7683-4017-ba71-35c272f142aa nodeName:}" failed. No retries permitted until 2026-07-09 02:10:42.607914048 +0000 UTC m=+1940.819566362 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/50bac1d1-7683-4017-ba71-35c272f142aa-maas-api-tls") pod "maas-api-e2e-shared-a-77db86-6cc97b4449-5v769" (UID: "50bac1d1-7683-4017-ba71-35c272f142aa") : secret "maas-api-e2e-shared-a-77db86-serving-cert" not found
Jul 09 02:10:42.108413 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:42.108393    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50bac1d1-7683-4017-ba71-35c272f142aa-openshift-service-ca\") pod \"maas-api-e2e-shared-a-77db86-6cc97b4449-5v769\" (UID: \"50bac1d1-7683-4017-ba71-35c272f142aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769"
Jul 09 02:10:42.119031 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:42.119002    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnf55\" (UniqueName: \"kubernetes.io/projected/50bac1d1-7683-4017-ba71-35c272f142aa-kube-api-access-vnf55\") pod \"maas-api-e2e-shared-a-77db86-6cc97b4449-5v769\" (UID: \"50bac1d1-7683-4017-ba71-35c272f142aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769"
Jul 09 02:10:42.612593 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:42.612558    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50bac1d1-7683-4017-ba71-35c272f142aa-maas-api-tls\") pod \"maas-api-e2e-shared-a-77db86-6cc97b4449-5v769\" (UID: \"50bac1d1-7683-4017-ba71-35c272f142aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769"
Jul 09 02:10:42.614991 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:42.614956    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50bac1d1-7683-4017-ba71-35c272f142aa-maas-api-tls\") pod \"maas-api-e2e-shared-a-77db86-6cc97b4449-5v769\" (UID: \"50bac1d1-7683-4017-ba71-35c272f142aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769"
Jul 09 02:10:42.795427 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:42.795390    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769"
Jul 09 02:10:42.928548 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:42.928523    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769"]
Jul 09 02:10:42.930706 ip-10-0-138-200 kubenswrapper[2562]: W0709 02:10:42.930678    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50bac1d1_7683_4017_ba71_35c272f142aa.slice/crio-a84342b69dd49aa164720f56ddb2d76faaac611aee236aa539bad1cf0c3f1cc9 WatchSource:0}: Error finding container a84342b69dd49aa164720f56ddb2d76faaac611aee236aa539bad1cf0c3f1cc9: Status 404 returned error can't find the container with id a84342b69dd49aa164720f56ddb2d76faaac611aee236aa539bad1cf0c3f1cc9
Jul 09 02:10:42.932234 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:42.932212    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 02:10:43.478938 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:43.478912    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769" event={"ID":"50bac1d1-7683-4017-ba71-35c272f142aa","Type":"ContainerStarted","Data":"adf7a6aaabb86d8071c62a6897cee87508be344a8dcf33bcebdd051795fd4d4f"}
Jul 09 02:10:43.479090 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:43.478964    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769" event={"ID":"50bac1d1-7683-4017-ba71-35c272f142aa","Type":"ContainerStarted","Data":"a84342b69dd49aa164720f56ddb2d76faaac611aee236aa539bad1cf0c3f1cc9"}
Jul 09 02:10:43.479090 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:43.478989    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769"
Jul 09 02:10:43.499618 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:43.499573    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769" podStartSLOduration=2.024994969 podStartE2EDuration="2.49955752s" totalImagesPullingTime="474.562551ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:10:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:10:43.497647671 +0000 UTC m=+1941.709300020" watchObservedRunningTime="2026-07-09 02:10:43.49955752 +0000 UTC m=+1941.711209857"
Jul 09 02:10:49.489563 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:49.489534    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769"
Jul 09 02:10:50.020528 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:50.020492    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt"]
Jul 09 02:10:50.024220 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:50.024199    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt"
Jul 09 02:10:50.027144 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:50.027125    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-fc352a-serving-cert\""
Jul 09 02:10:50.036714 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:50.036689    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt"]
Jul 09 02:10:50.182126 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:50.182098    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae81d1d9-241a-44a2-b777-bb359337b9cd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt\" (UID: \"ae81d1d9-241a-44a2-b777-bb359337b9cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt"
Jul 09 02:10:50.182285 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:50.182163    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae81d1d9-241a-44a2-b777-bb359337b9cd-maas-api-tls\") pod \"maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt\" (UID: \"ae81d1d9-241a-44a2-b777-bb359337b9cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt"
Jul 09 02:10:50.182285 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:50.182218    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wbc8\" (UniqueName: \"kubernetes.io/projected/ae81d1d9-241a-44a2-b777-bb359337b9cd-kube-api-access-9wbc8\") pod \"maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt\" (UID: \"ae81d1d9-241a-44a2-b777-bb359337b9cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt"
Jul 09 02:10:50.283538 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:50.283456    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae81d1d9-241a-44a2-b777-bb359337b9cd-maas-api-tls\") pod \"maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt\" (UID: \"ae81d1d9-241a-44a2-b777-bb359337b9cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt"
Jul 09 02:10:50.283538 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:50.283512    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wbc8\" (UniqueName: \"kubernetes.io/projected/ae81d1d9-241a-44a2-b777-bb359337b9cd-kube-api-access-9wbc8\") pod \"maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt\" (UID: \"ae81d1d9-241a-44a2-b777-bb359337b9cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt"
Jul 09 02:10:50.283712 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:50.283564    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae81d1d9-241a-44a2-b777-bb359337b9cd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt\" (UID: \"ae81d1d9-241a-44a2-b777-bb359337b9cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt"
Jul 09 02:10:50.283712 ip-10-0-138-200 kubenswrapper[2562]: E0709 02:10:50.283628    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-serving-cert: secret "maas-api-e2e-shared-b-fc352a-serving-cert" not found
Jul 09 02:10:50.283712 ip-10-0-138-200 kubenswrapper[2562]: E0709 02:10:50.283685    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae81d1d9-241a-44a2-b777-bb359337b9cd-maas-api-tls podName:ae81d1d9-241a-44a2-b777-bb359337b9cd nodeName:}" failed. No retries permitted until 2026-07-09 02:10:50.783669723 +0000 UTC m=+1948.995322038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ae81d1d9-241a-44a2-b777-bb359337b9cd-maas-api-tls") pod "maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt" (UID: "ae81d1d9-241a-44a2-b777-bb359337b9cd") : secret "maas-api-e2e-shared-b-fc352a-serving-cert" not found
Jul 09 02:10:50.284270 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:50.284253    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae81d1d9-241a-44a2-b777-bb359337b9cd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt\" (UID: \"ae81d1d9-241a-44a2-b777-bb359337b9cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt"
Jul 09 02:10:50.295242 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:50.295211    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wbc8\" (UniqueName: \"kubernetes.io/projected/ae81d1d9-241a-44a2-b777-bb359337b9cd-kube-api-access-9wbc8\") pod \"maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt\" (UID: \"ae81d1d9-241a-44a2-b777-bb359337b9cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt"
Jul 09 02:10:50.789764 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:50.789728    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae81d1d9-241a-44a2-b777-bb359337b9cd-maas-api-tls\") pod \"maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt\" (UID: \"ae81d1d9-241a-44a2-b777-bb359337b9cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt"
Jul 09 02:10:50.792328 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:50.792305    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae81d1d9-241a-44a2-b777-bb359337b9cd-maas-api-tls\") pod \"maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt\" (UID: \"ae81d1d9-241a-44a2-b777-bb359337b9cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt"
Jul 09 02:10:50.934528 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:50.934489    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt"
Jul 09 02:10:51.070112 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:51.070087    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt"]
Jul 09 02:10:51.072975 ip-10-0-138-200 kubenswrapper[2562]: W0709 02:10:51.072948    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae81d1d9_241a_44a2_b777_bb359337b9cd.slice/crio-52166c5a4f8e38a4cd2be20b7832cfcb1294e80c45fc8fdf0613e5f3667189fc WatchSource:0}: Error finding container 52166c5a4f8e38a4cd2be20b7832cfcb1294e80c45fc8fdf0613e5f3667189fc: Status 404 returned error can't find the container with id 52166c5a4f8e38a4cd2be20b7832cfcb1294e80c45fc8fdf0613e5f3667189fc
Jul 09 02:10:51.517853 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:51.517819    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt" event={"ID":"ae81d1d9-241a-44a2-b777-bb359337b9cd","Type":"ContainerStarted","Data":"05b4f87581025075e678950f6d3f22dfef13188e15f3bff5fe7513222c76da0d"}
Jul 09 02:10:51.518042 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:51.517880    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt" event={"ID":"ae81d1d9-241a-44a2-b777-bb359337b9cd","Type":"ContainerStarted","Data":"52166c5a4f8e38a4cd2be20b7832cfcb1294e80c45fc8fdf0613e5f3667189fc"}
Jul 09 02:10:51.518042 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:51.517917    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt"
Jul 09 02:10:51.537280 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:51.537227    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt" podStartSLOduration=2.212940219 podStartE2EDuration="2.537209102s" totalImagesPullingTime="324.268883ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:10:51.535153559 +0000 UTC m=+1949.746805894" watchObservedRunningTime="2026-07-09 02:10:51.537209102 +0000 UTC m=+1949.748861438"
Jul 09 02:10:57.533849 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:10:57.533815    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt"
Jul 09 02:13:59.687228 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:13:59.687194    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769"]
Jul 09 02:13:59.687741 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:13:59.687401    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769" podUID="50bac1d1-7683-4017-ba71-35c272f142aa" containerName="maas-api" containerID="cri-o://adf7a6aaabb86d8071c62a6897cee87508be344a8dcf33bcebdd051795fd4d4f" gracePeriod=30
Jul 09 02:13:59.935379 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:13:59.935354    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769"
Jul 09 02:14:00.043683 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:00.043615    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50bac1d1-7683-4017-ba71-35c272f142aa-maas-api-tls\") pod \"50bac1d1-7683-4017-ba71-35c272f142aa\" (UID: \"50bac1d1-7683-4017-ba71-35c272f142aa\") "
Jul 09 02:14:00.043683 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:00.043644    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50bac1d1-7683-4017-ba71-35c272f142aa-openshift-service-ca\") pod \"50bac1d1-7683-4017-ba71-35c272f142aa\" (UID: \"50bac1d1-7683-4017-ba71-35c272f142aa\") "
Jul 09 02:14:00.043861 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:00.043745    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnf55\" (UniqueName: \"kubernetes.io/projected/50bac1d1-7683-4017-ba71-35c272f142aa-kube-api-access-vnf55\") pod \"50bac1d1-7683-4017-ba71-35c272f142aa\" (UID: \"50bac1d1-7683-4017-ba71-35c272f142aa\") "
Jul 09 02:14:00.044062 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:00.044006    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50bac1d1-7683-4017-ba71-35c272f142aa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "50bac1d1-7683-4017-ba71-35c272f142aa" (UID: "50bac1d1-7683-4017-ba71-35c272f142aa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:14:00.045733 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:00.045705    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50bac1d1-7683-4017-ba71-35c272f142aa-kube-api-access-vnf55" (OuterVolumeSpecName: "kube-api-access-vnf55") pod "50bac1d1-7683-4017-ba71-35c272f142aa" (UID: "50bac1d1-7683-4017-ba71-35c272f142aa"). InnerVolumeSpecName "kube-api-access-vnf55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:14:00.045832 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:00.045728    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50bac1d1-7683-4017-ba71-35c272f142aa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "50bac1d1-7683-4017-ba71-35c272f142aa" (UID: "50bac1d1-7683-4017-ba71-35c272f142aa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:14:00.144890 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:00.144863    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnf55\" (UniqueName: \"kubernetes.io/projected/50bac1d1-7683-4017-ba71-35c272f142aa-kube-api-access-vnf55\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:14:00.144890 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:00.144888    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50bac1d1-7683-4017-ba71-35c272f142aa-maas-api-tls\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:14:00.145094 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:00.144900    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50bac1d1-7683-4017-ba71-35c272f142aa-openshift-service-ca\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:14:00.443078 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:00.443047    2562 generic.go:356] "Generic (PLEG): container finished" podID="50bac1d1-7683-4017-ba71-35c272f142aa" containerID="adf7a6aaabb86d8071c62a6897cee87508be344a8dcf33bcebdd051795fd4d4f" exitCode=0
Jul 09 02:14:00.443258 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:00.443129    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769"
Jul 09 02:14:00.443258 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:00.443132    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769" event={"ID":"50bac1d1-7683-4017-ba71-35c272f142aa","Type":"ContainerDied","Data":"adf7a6aaabb86d8071c62a6897cee87508be344a8dcf33bcebdd051795fd4d4f"}
Jul 09 02:14:00.443363 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:00.443258    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769" event={"ID":"50bac1d1-7683-4017-ba71-35c272f142aa","Type":"ContainerDied","Data":"a84342b69dd49aa164720f56ddb2d76faaac611aee236aa539bad1cf0c3f1cc9"}
Jul 09 02:14:00.443363 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:00.443287    2562 scope.go:117] "RemoveContainer" containerID="adf7a6aaabb86d8071c62a6897cee87508be344a8dcf33bcebdd051795fd4d4f"
Jul 09 02:14:00.452241 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:00.452218    2562 scope.go:117] "RemoveContainer" containerID="adf7a6aaabb86d8071c62a6897cee87508be344a8dcf33bcebdd051795fd4d4f"
Jul 09 02:14:00.452508 ip-10-0-138-200 kubenswrapper[2562]: E0709 02:14:00.452490    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adf7a6aaabb86d8071c62a6897cee87508be344a8dcf33bcebdd051795fd4d4f\": container with ID starting with adf7a6aaabb86d8071c62a6897cee87508be344a8dcf33bcebdd051795fd4d4f not found: ID does not exist" containerID="adf7a6aaabb86d8071c62a6897cee87508be344a8dcf33bcebdd051795fd4d4f"
Jul 09 02:14:00.452562 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:00.452516    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adf7a6aaabb86d8071c62a6897cee87508be344a8dcf33bcebdd051795fd4d4f"} err="failed to get container status \"adf7a6aaabb86d8071c62a6897cee87508be344a8dcf33bcebdd051795fd4d4f\": rpc error: code = NotFound desc = could not find container \"adf7a6aaabb86d8071c62a6897cee87508be344a8dcf33bcebdd051795fd4d4f\": container with ID starting with adf7a6aaabb86d8071c62a6897cee87508be344a8dcf33bcebdd051795fd4d4f not found: ID does not exist"
Jul 09 02:14:00.462389 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:00.462361    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769"]
Jul 09 02:14:00.466082 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:00.466052    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77db86-6cc97b4449-5v769"]
Jul 09 02:14:02.157479 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:02.157446    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50bac1d1-7683-4017-ba71-35c272f142aa" path="/var/lib/kubelet/pods/50bac1d1-7683-4017-ba71-35c272f142aa/volumes"
Jul 09 02:14:07.061598 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:07.061564    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt"]
Jul 09 02:14:07.061962 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:07.061812    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt" podUID="ae81d1d9-241a-44a2-b777-bb359337b9cd" containerName="maas-api" containerID="cri-o://05b4f87581025075e678950f6d3f22dfef13188e15f3bff5fe7513222c76da0d" gracePeriod=30
Jul 09 02:14:07.314887 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:07.314819    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt"
Jul 09 02:14:07.414726 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:07.414694    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae81d1d9-241a-44a2-b777-bb359337b9cd-maas-api-tls\") pod \"ae81d1d9-241a-44a2-b777-bb359337b9cd\" (UID: \"ae81d1d9-241a-44a2-b777-bb359337b9cd\") "
Jul 09 02:14:07.414875 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:07.414756    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wbc8\" (UniqueName: \"kubernetes.io/projected/ae81d1d9-241a-44a2-b777-bb359337b9cd-kube-api-access-9wbc8\") pod \"ae81d1d9-241a-44a2-b777-bb359337b9cd\" (UID: \"ae81d1d9-241a-44a2-b777-bb359337b9cd\") "
Jul 09 02:14:07.414875 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:07.414802    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae81d1d9-241a-44a2-b777-bb359337b9cd-openshift-service-ca\") pod \"ae81d1d9-241a-44a2-b777-bb359337b9cd\" (UID: \"ae81d1d9-241a-44a2-b777-bb359337b9cd\") "
Jul 09 02:14:07.415244 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:07.415219    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae81d1d9-241a-44a2-b777-bb359337b9cd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ae81d1d9-241a-44a2-b777-bb359337b9cd" (UID: "ae81d1d9-241a-44a2-b777-bb359337b9cd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:14:07.416831 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:07.416800    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae81d1d9-241a-44a2-b777-bb359337b9cd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ae81d1d9-241a-44a2-b777-bb359337b9cd" (UID: "ae81d1d9-241a-44a2-b777-bb359337b9cd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:14:07.416831 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:07.416822    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae81d1d9-241a-44a2-b777-bb359337b9cd-kube-api-access-9wbc8" (OuterVolumeSpecName: "kube-api-access-9wbc8") pod "ae81d1d9-241a-44a2-b777-bb359337b9cd" (UID: "ae81d1d9-241a-44a2-b777-bb359337b9cd"). InnerVolumeSpecName "kube-api-access-9wbc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:14:07.482174 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:07.482145    2562 generic.go:356] "Generic (PLEG): container finished" podID="ae81d1d9-241a-44a2-b777-bb359337b9cd" containerID="05b4f87581025075e678950f6d3f22dfef13188e15f3bff5fe7513222c76da0d" exitCode=0
Jul 09 02:14:07.482312 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:07.482200    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt"
Jul 09 02:14:07.482312 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:07.482210    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt" event={"ID":"ae81d1d9-241a-44a2-b777-bb359337b9cd","Type":"ContainerDied","Data":"05b4f87581025075e678950f6d3f22dfef13188e15f3bff5fe7513222c76da0d"}
Jul 09 02:14:07.482312 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:07.482299    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt" event={"ID":"ae81d1d9-241a-44a2-b777-bb359337b9cd","Type":"ContainerDied","Data":"52166c5a4f8e38a4cd2be20b7832cfcb1294e80c45fc8fdf0613e5f3667189fc"}
Jul 09 02:14:07.482478 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:07.482332    2562 scope.go:117] "RemoveContainer" containerID="05b4f87581025075e678950f6d3f22dfef13188e15f3bff5fe7513222c76da0d"
Jul 09 02:14:07.491750 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:07.491732    2562 scope.go:117] "RemoveContainer" containerID="05b4f87581025075e678950f6d3f22dfef13188e15f3bff5fe7513222c76da0d"
Jul 09 02:14:07.491984 ip-10-0-138-200 kubenswrapper[2562]: E0709 02:14:07.491966    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05b4f87581025075e678950f6d3f22dfef13188e15f3bff5fe7513222c76da0d\": container with ID starting with 05b4f87581025075e678950f6d3f22dfef13188e15f3bff5fe7513222c76da0d not found: ID does not exist" containerID="05b4f87581025075e678950f6d3f22dfef13188e15f3bff5fe7513222c76da0d"
Jul 09 02:14:07.492055 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:07.491995    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05b4f87581025075e678950f6d3f22dfef13188e15f3bff5fe7513222c76da0d"} err="failed to get container status \"05b4f87581025075e678950f6d3f22dfef13188e15f3bff5fe7513222c76da0d\": rpc error: code = NotFound desc = could not find container \"05b4f87581025075e678950f6d3f22dfef13188e15f3bff5fe7513222c76da0d\": container with ID starting with 05b4f87581025075e678950f6d3f22dfef13188e15f3bff5fe7513222c76da0d not found: ID does not exist"
Jul 09 02:14:07.503924 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:07.503902    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt"]
Jul 09 02:14:07.509686 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:07.509667    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fc352a-6bf7455456-25vjt"]
Jul 09 02:14:07.516054 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:07.516038    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wbc8\" (UniqueName: \"kubernetes.io/projected/ae81d1d9-241a-44a2-b777-bb359337b9cd-kube-api-access-9wbc8\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:14:07.516111 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:07.516057    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae81d1d9-241a-44a2-b777-bb359337b9cd-openshift-service-ca\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:14:07.516111 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:07.516068    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae81d1d9-241a-44a2-b777-bb359337b9cd-maas-api-tls\") on node \"ip-10-0-138-200.ec2.internal\" DevicePath \"\""
Jul 09 02:14:08.156912 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:08.156880    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae81d1d9-241a-44a2-b777-bb359337b9cd" path="/var/lib/kubelet/pods/ae81d1d9-241a-44a2-b777-bb359337b9cd/volumes"
Jul 09 02:14:13.530209 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:13.530177    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-557ccdfbdb-xqd44_2131b1c9-fb62-441f-9a94-3e6925034e86/authorino/0.log"
Jul 09 02:14:18.869932 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:18.869841    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4b98c894-zkllk_44379a51-ccfd-47f1-97e5-e69b25aa5a74/copy-manifests/0.log"
Jul 09 02:14:18.878366 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:18.878341    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4b98c894-zkllk_44379a51-ccfd-47f1-97e5-e69b25aa5a74/manager/0.log"
Jul 09 02:14:20.164993 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:20.164962    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-557ccdfbdb-xqd44_2131b1c9-fb62-441f-9a94-3e6925034e86/authorino/0.log"
Jul 09 02:14:20.277651 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:20.277624    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7ngf5_3e5d2973-03cc-4735-b10a-e8058c6ac603/manager/0.log"
Jul 09 02:14:21.593234 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:21.593203    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dd66d5ffd-dbsph_5c1b21c5-6a99-4792-9e8d-6c986a74f97c/kube-auth-proxy/0.log"
Jul 09 02:14:21.931894 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:21.931798    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-jp6pj_c87da6b1-1098-48e0-838c-2f0ab998d08b/payload-pre-processing/0.log"
Jul 09 02:14:22.495370 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:22.495336    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-5z2jb_c91ee496-548e-4d22-9eb5-2cf75776708c/main/0.log"
Jul 09 02:14:23.055165 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:23.055132    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-l65xg_1b4d62d4-1f91-455d-b8ec-9a37bc8fc06d/main/0.log"
Jul 09 02:14:27.518687 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:27.518653    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k9hbz/must-gather-s7gtp"]
Jul 09 02:14:27.519231 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:27.519213    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae81d1d9-241a-44a2-b777-bb359337b9cd" containerName="maas-api"
Jul 09 02:14:27.519310 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:27.519234    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae81d1d9-241a-44a2-b777-bb359337b9cd" containerName="maas-api"
Jul 09 02:14:27.519310 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:27.519278    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50bac1d1-7683-4017-ba71-35c272f142aa" containerName="maas-api"
Jul 09 02:14:27.519310 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:27.519287    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="50bac1d1-7683-4017-ba71-35c272f142aa" containerName="maas-api"
Jul 09 02:14:27.519470 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:27.519371    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae81d1d9-241a-44a2-b777-bb359337b9cd" containerName="maas-api"
Jul 09 02:14:27.519470 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:27.519386    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="50bac1d1-7683-4017-ba71-35c272f142aa" containerName="maas-api"
Jul 09 02:14:27.522647 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:27.522621    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k9hbz/must-gather-s7gtp"
Jul 09 02:14:27.525938 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:27.525915    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k9hbz\"/\"openshift-service-ca.crt\""
Jul 09 02:14:27.526092 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:27.526074    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k9hbz\"/\"kube-root-ca.crt\""
Jul 09 02:14:27.526226 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:27.526210    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-k9hbz\"/\"default-dockercfg-txlpg\""
Jul 09 02:14:27.533900 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:27.533874    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k9hbz/must-gather-s7gtp"]
Jul 09 02:14:27.581858 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:27.581820    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6phn\" (UniqueName: \"kubernetes.io/projected/c7dd937c-2dae-43c4-bd2b-04e41e8bce11-kube-api-access-d6phn\") pod \"must-gather-s7gtp\" (UID: \"c7dd937c-2dae-43c4-bd2b-04e41e8bce11\") " pod="openshift-must-gather-k9hbz/must-gather-s7gtp"
Jul 09 02:14:27.582060 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:27.581896    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c7dd937c-2dae-43c4-bd2b-04e41e8bce11-must-gather-output\") pod \"must-gather-s7gtp\" (UID: \"c7dd937c-2dae-43c4-bd2b-04e41e8bce11\") " pod="openshift-must-gather-k9hbz/must-gather-s7gtp"
Jul 09 02:14:27.683415 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:27.683379    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c7dd937c-2dae-43c4-bd2b-04e41e8bce11-must-gather-output\") pod \"must-gather-s7gtp\" (UID: \"c7dd937c-2dae-43c4-bd2b-04e41e8bce11\") " pod="openshift-must-gather-k9hbz/must-gather-s7gtp"
Jul 09 02:14:27.683613 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:27.683536    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6phn\" (UniqueName: \"kubernetes.io/projected/c7dd937c-2dae-43c4-bd2b-04e41e8bce11-kube-api-access-d6phn\") pod \"must-gather-s7gtp\" (UID: \"c7dd937c-2dae-43c4-bd2b-04e41e8bce11\") " pod="openshift-must-gather-k9hbz/must-gather-s7gtp"
Jul 09 02:14:27.683810 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:27.683787    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c7dd937c-2dae-43c4-bd2b-04e41e8bce11-must-gather-output\") pod \"must-gather-s7gtp\" (UID: \"c7dd937c-2dae-43c4-bd2b-04e41e8bce11\") " pod="openshift-must-gather-k9hbz/must-gather-s7gtp"
Jul 09 02:14:27.692862 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:27.692828    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6phn\" (UniqueName: \"kubernetes.io/projected/c7dd937c-2dae-43c4-bd2b-04e41e8bce11-kube-api-access-d6phn\") pod \"must-gather-s7gtp\" (UID: \"c7dd937c-2dae-43c4-bd2b-04e41e8bce11\") " pod="openshift-must-gather-k9hbz/must-gather-s7gtp"
Jul 09 02:14:27.832148 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:27.832112    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k9hbz/must-gather-s7gtp"
Jul 09 02:14:27.964512 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:27.964479    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k9hbz/must-gather-s7gtp"]
Jul 09 02:14:28.596046 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:28.595994    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k9hbz/must-gather-s7gtp" event={"ID":"c7dd937c-2dae-43c4-bd2b-04e41e8bce11","Type":"ContainerStarted","Data":"882fdcbc64ebd1f4a2e0f4a1c829e1c621443d3bcfdf3b4077f0a018e38506df"}
Jul 09 02:14:29.606257 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:29.606215    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k9hbz/must-gather-s7gtp" event={"ID":"c7dd937c-2dae-43c4-bd2b-04e41e8bce11","Type":"ContainerStarted","Data":"365387227c814f209fe4e46f38755f425d4227a9fc31e9466395d4093a7fb338"}
Jul 09 02:14:29.606658 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:29.606275    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k9hbz/must-gather-s7gtp" event={"ID":"c7dd937c-2dae-43c4-bd2b-04e41e8bce11","Type":"ContainerStarted","Data":"8af3b6d52457e4d8d5c59ac1d0fa9d0217276e56a2b7342614591e728ed586e8"}
Jul 09 02:14:29.623957 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:29.623902    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-k9hbz/must-gather-s7gtp" podStartSLOduration=1.872920688 podStartE2EDuration="2.623886405s" totalImagesPullingTime="750.965717ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:14:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:14:29.621639918 +0000 UTC m=+2167.833292282" watchObservedRunningTime="2026-07-09 02:14:29.623886405 +0000 UTC m=+2167.835538784"
Jul 09 02:14:30.389065 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:30.389035    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xcs6g_d934d4c6-1de4-4fce-8aca-e3a5a1cd14df/global-pull-secret-syncer/0.log"
Jul 09 02:14:30.528655 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:30.528611    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zqpkr_c5d65341-3507-4208-86f3-d3269df692bc/konnectivity-agent/0.log"
Jul 09 02:14:30.598176 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:30.598133    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-200.ec2.internal_f10a9fc02587642f786ed8d229854619/haproxy/0.log"
Jul 09 02:14:35.274685 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:35.274592    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-557ccdfbdb-xqd44_2131b1c9-fb62-441f-9a94-3e6925034e86/authorino/0.log"
Jul 09 02:14:35.302745 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:35.302717    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7ngf5_3e5d2973-03cc-4735-b10a-e8058c6ac603/manager/0.log"
Jul 09 02:14:37.212760 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:37.212701    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bb908ac5-6a99-4744-bb88-32883f6c2b77/alertmanager/0.log"
Jul 09 02:14:37.239424 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:37.239389    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bb908ac5-6a99-4744-bb88-32883f6c2b77/config-reloader/0.log"
Jul 09 02:14:37.262306 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:37.261632    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bb908ac5-6a99-4744-bb88-32883f6c2b77/kube-rbac-proxy-web/0.log"
Jul 09 02:14:37.286218 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:37.286195    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bb908ac5-6a99-4744-bb88-32883f6c2b77/kube-rbac-proxy/0.log"
Jul 09 02:14:37.318929 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:37.318881    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bb908ac5-6a99-4744-bb88-32883f6c2b77/kube-rbac-proxy-metric/0.log"
Jul 09 02:14:37.340557 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:37.340529    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bb908ac5-6a99-4744-bb88-32883f6c2b77/prom-label-proxy/0.log"
Jul 09 02:14:37.361533 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:37.361483    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bb908ac5-6a99-4744-bb88-32883f6c2b77/init-config-reloader/0.log"
Jul 09 02:14:37.451158 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:37.451114    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-rhc8v_0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6/kube-state-metrics/0.log"
Jul 09 02:14:37.486404 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:37.486299    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-rhc8v_0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6/kube-rbac-proxy-main/0.log"
Jul 09 02:14:37.523371 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:37.523327    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-rhc8v_0cf73d3b-8a56-49ad-8fe6-6aa05b9bb4a6/kube-rbac-proxy-self/0.log"
Jul 09 02:14:37.550054 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:37.549995    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-784d559c-28pzc_e9e4b665-cc44-4db4-b0ad-5e833d08bec4/metrics-server/0.log"
Jul 09 02:14:37.579608 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:37.579564    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-7djfk_d4e9ac0a-b2da-4b82-86c6-c69b57d0f6c0/monitoring-plugin/0.log"
Jul 09 02:14:37.628883 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:37.628834    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fdjbs_43947d65-f367-4cf4-8c37-2fb07939ef30/node-exporter/0.log"
Jul 09 02:14:37.660550 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:37.660487    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fdjbs_43947d65-f367-4cf4-8c37-2fb07939ef30/kube-rbac-proxy/0.log"
Jul 09 02:14:37.693462 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:37.693433    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fdjbs_43947d65-f367-4cf4-8c37-2fb07939ef30/init-textfile/0.log"
Jul 09 02:14:37.879992 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:37.879961    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-cnbl2_dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7/kube-rbac-proxy-main/0.log"
Jul 09 02:14:37.905718 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:37.905679    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-cnbl2_dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7/kube-rbac-proxy-self/0.log"
Jul 09 02:14:37.928657 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:37.928619    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-cnbl2_dc7fdf5a-0044-4dc2-bfe8-a8872c9fbdc7/openshift-state-metrics/0.log"
Jul 09 02:14:37.979066 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:37.979032    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_30742dc0-f132-40e7-a800-b685b9605b1d/prometheus/0.log"
Jul 09 02:14:38.002471 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:38.002430    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_30742dc0-f132-40e7-a800-b685b9605b1d/config-reloader/0.log"
Jul 09 02:14:38.033619 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:38.033501    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_30742dc0-f132-40e7-a800-b685b9605b1d/thanos-sidecar/0.log"
Jul 09 02:14:38.055396 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:38.055369    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_30742dc0-f132-40e7-a800-b685b9605b1d/kube-rbac-proxy-web/0.log"
Jul 09 02:14:38.078433 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:38.078408    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_30742dc0-f132-40e7-a800-b685b9605b1d/kube-rbac-proxy/0.log"
Jul 09 02:14:38.099783 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:38.099750    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_30742dc0-f132-40e7-a800-b685b9605b1d/kube-rbac-proxy-thanos/0.log"
Jul 09 02:14:38.121270 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:38.121215    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_30742dc0-f132-40e7-a800-b685b9605b1d/init-config-reloader/0.log"
Jul 09 02:14:38.148367 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:38.148321    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-c2sl5_2326dd0b-fb56-4cbf-a644-7e051314d1a2/prometheus-operator/0.log"
Jul 09 02:14:38.171466 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:38.171436    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-c2sl5_2326dd0b-fb56-4cbf-a644-7e051314d1a2/kube-rbac-proxy/0.log"
Jul 09 02:14:38.226397 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:38.226363    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d84b66c64-56vbt_285f78f2-08aa-455a-8613-e1b219ac3559/telemeter-client/0.log"
Jul 09 02:14:38.247549 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:38.247518    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d84b66c64-56vbt_285f78f2-08aa-455a-8613-e1b219ac3559/reload/0.log"
Jul 09 02:14:38.270990 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:38.270963    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d84b66c64-56vbt_285f78f2-08aa-455a-8613-e1b219ac3559/kube-rbac-proxy/0.log"
Jul 09 02:14:38.311307 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:38.311282    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79cb9dd7b7-thkn2_a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c/thanos-query/0.log"
Jul 09 02:14:38.334811 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:38.334783    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79cb9dd7b7-thkn2_a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c/kube-rbac-proxy-web/0.log"
Jul 09 02:14:38.358532 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:38.358496    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79cb9dd7b7-thkn2_a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c/kube-rbac-proxy/0.log"
Jul 09 02:14:38.381633 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:38.381607    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79cb9dd7b7-thkn2_a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c/prom-label-proxy/0.log"
Jul 09 02:14:38.402201 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:38.402176    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79cb9dd7b7-thkn2_a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c/kube-rbac-proxy-rules/0.log"
Jul 09 02:14:38.424318 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:38.424279    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79cb9dd7b7-thkn2_a915bbd1-6534-4ffc-a0e8-75ee02ec6b8c/kube-rbac-proxy-metrics/0.log"
Jul 09 02:14:40.896979 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:40.896941    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55d595d777-7bnf9_34d3de22-63bd-4726-99ff-b3497f8ca879/console/0.log"
Jul 09 02:14:41.669800 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:41.669765    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k9hbz/perf-node-gather-daemonset-lgtt8"]
Jul 09 02:14:41.676031 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:41.675985    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-lgtt8"
Jul 09 02:14:41.681698 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:41.681668    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k9hbz/perf-node-gather-daemonset-lgtt8"]
Jul 09 02:14:41.842396 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:41.842360    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e883324a-0e15-42db-ad73-70ab17079186-lib-modules\") pod \"perf-node-gather-daemonset-lgtt8\" (UID: \"e883324a-0e15-42db-ad73-70ab17079186\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-lgtt8"
Jul 09 02:14:41.842586 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:41.842406    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e883324a-0e15-42db-ad73-70ab17079186-sys\") pod \"perf-node-gather-daemonset-lgtt8\" (UID: \"e883324a-0e15-42db-ad73-70ab17079186\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-lgtt8"
Jul 09 02:14:41.842586 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:41.842439    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6bjg\" (UniqueName: \"kubernetes.io/projected/e883324a-0e15-42db-ad73-70ab17079186-kube-api-access-p6bjg\") pod \"perf-node-gather-daemonset-lgtt8\" (UID: \"e883324a-0e15-42db-ad73-70ab17079186\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-lgtt8"
Jul 09 02:14:41.842586 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:41.842528    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e883324a-0e15-42db-ad73-70ab17079186-proc\") pod \"perf-node-gather-daemonset-lgtt8\" (UID: \"e883324a-0e15-42db-ad73-70ab17079186\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-lgtt8"
Jul 09 02:14:41.842770 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:41.842684    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e883324a-0e15-42db-ad73-70ab17079186-podres\") pod \"perf-node-gather-daemonset-lgtt8\" (UID: \"e883324a-0e15-42db-ad73-70ab17079186\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-lgtt8"
Jul 09 02:14:41.944122 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:41.944009    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e883324a-0e15-42db-ad73-70ab17079186-podres\") pod \"perf-node-gather-daemonset-lgtt8\" (UID: \"e883324a-0e15-42db-ad73-70ab17079186\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-lgtt8"
Jul 09 02:14:41.944550 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:41.944129    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e883324a-0e15-42db-ad73-70ab17079186-lib-modules\") pod \"perf-node-gather-daemonset-lgtt8\" (UID: \"e883324a-0e15-42db-ad73-70ab17079186\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-lgtt8"
Jul 09 02:14:41.944550 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:41.944142    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e883324a-0e15-42db-ad73-70ab17079186-podres\") pod \"perf-node-gather-daemonset-lgtt8\" (UID: \"e883324a-0e15-42db-ad73-70ab17079186\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-lgtt8"
Jul 09 02:14:41.944550 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:41.944179    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e883324a-0e15-42db-ad73-70ab17079186-sys\") pod \"perf-node-gather-daemonset-lgtt8\" (UID: \"e883324a-0e15-42db-ad73-70ab17079186\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-lgtt8"
Jul 09 02:14:41.944550 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:41.944218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6bjg\" (UniqueName: \"kubernetes.io/projected/e883324a-0e15-42db-ad73-70ab17079186-kube-api-access-p6bjg\") pod \"perf-node-gather-daemonset-lgtt8\" (UID: \"e883324a-0e15-42db-ad73-70ab17079186\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-lgtt8"
Jul 09 02:14:41.944550 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:41.944235    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e883324a-0e15-42db-ad73-70ab17079186-lib-modules\") pod \"perf-node-gather-daemonset-lgtt8\" (UID: \"e883324a-0e15-42db-ad73-70ab17079186\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-lgtt8"
Jul 09 02:14:41.944550 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:41.944264    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e883324a-0e15-42db-ad73-70ab17079186-proc\") pod \"perf-node-gather-daemonset-lgtt8\" (UID: \"e883324a-0e15-42db-ad73-70ab17079186\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-lgtt8"
Jul 09 02:14:41.944550 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:41.944324    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e883324a-0e15-42db-ad73-70ab17079186-sys\") pod \"perf-node-gather-daemonset-lgtt8\" (UID: \"e883324a-0e15-42db-ad73-70ab17079186\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-lgtt8"
Jul 09 02:14:41.944550 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:41.944400    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e883324a-0e15-42db-ad73-70ab17079186-proc\") pod \"perf-node-gather-daemonset-lgtt8\" (UID: \"e883324a-0e15-42db-ad73-70ab17079186\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-lgtt8"
Jul 09 02:14:41.953222 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:41.953197    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6bjg\" (UniqueName: \"kubernetes.io/projected/e883324a-0e15-42db-ad73-70ab17079186-kube-api-access-p6bjg\") pod \"perf-node-gather-daemonset-lgtt8\" (UID: \"e883324a-0e15-42db-ad73-70ab17079186\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-lgtt8"
Jul 09 02:14:41.991304 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:41.991091    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-lgtt8"
Jul 09 02:14:42.166569 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:42.166535    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k9hbz/perf-node-gather-daemonset-lgtt8"]
Jul 09 02:14:42.608759 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:42.608732    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-24ln9_57eec479-7796-4606-b98b-0cf65bd96d8f/dns/0.log"
Jul 09 02:14:42.631744 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:42.631713    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-24ln9_57eec479-7796-4606-b98b-0cf65bd96d8f/kube-rbac-proxy/0.log"
Jul 09 02:14:42.707893 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:42.707846    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-lgtt8" event={"ID":"e883324a-0e15-42db-ad73-70ab17079186","Type":"ContainerStarted","Data":"bb9dcfdbf54a2330cf7e0f7e8f7c3b5e4779e9fa90533a885ac686dd6613cd7a"}
Jul 09 02:14:42.708107 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:42.707922    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-lgtt8"
Jul 09 02:14:42.708107 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:42.707944    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-lgtt8" event={"ID":"e883324a-0e15-42db-ad73-70ab17079186","Type":"ContainerStarted","Data":"4adb163a0bde65dc8188d9b101ca870cbc3e8286f4c775cfc9bdb99ba3cea371"}
Jul 09 02:14:42.726304 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:42.726259    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-lgtt8" podStartSLOduration=1.726241454 podStartE2EDuration="1.726241454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:14:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:14:42.724397 +0000 UTC m=+2180.936049348" watchObservedRunningTime="2026-07-09 02:14:42.726241454 +0000 UTC m=+2180.937893789"
Jul 09 02:14:42.775591 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:42.775562    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r4hf8_57c14d99-09ac-43ca-8cbd-88d3ea0dae62/dns-node-resolver/0.log"
Jul 09 02:14:43.347527 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:43.347501    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9sjqd_1479a0d8-2d1e-48d1-ac35-9754ea6fa215/node-ca/0.log"
Jul 09 02:14:44.543150 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:44.543099    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dd66d5ffd-dbsph_5c1b21c5-6a99-4792-9e8d-6c986a74f97c/kube-auth-proxy/0.log"
Jul 09 02:14:44.675592 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:44.675559    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-jp6pj_c87da6b1-1098-48e0-838c-2f0ab998d08b/payload-pre-processing/0.log"
Jul 09 02:14:45.472071 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:45.472040    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-chv7g_1c9d9da1-bf01-4198-b1f7-dfe8e764ae28/serve-healthcheck-canary/0.log"
Jul 09 02:14:46.014149 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:46.014123    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-695mk_ebc6286a-5d2f-4e0e-b90f-950fd091c42f/kube-rbac-proxy/0.log"
Jul 09 02:14:46.036239 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:46.036216    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-695mk_ebc6286a-5d2f-4e0e-b90f-950fd091c42f/exporter/0.log"
Jul 09 02:14:46.061005 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:46.058960    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-695mk_ebc6286a-5d2f-4e0e-b90f-950fd091c42f/extractor/0.log"
Jul 09 02:14:48.725442 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:48.725412    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-lgtt8"
Jul 09 02:14:49.128687 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:49.128661    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4b98c894-zkllk_44379a51-ccfd-47f1-97e5-e69b25aa5a74/manager/0.log"
Jul 09 02:14:49.153002 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:49.152977    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4b98c894-zkllk_44379a51-ccfd-47f1-97e5-e69b25aa5a74/copy-manifests/0.log"
Jul 09 02:14:50.332384 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:50.332352    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6489dc67d-7dl45_d15fe60a-5950-4aa5-9612-a7f4376e2d47/manager/0.log"
Jul 09 02:14:50.425501 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:50.425467    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dd66d5ffd-dbsph_5c1b21c5-6a99-4792-9e8d-6c986a74f97c/kube-auth-proxy/0.log"
Jul 09 02:14:50.536375 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:50.536346    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-jp6pj_c87da6b1-1098-48e0-838c-2f0ab998d08b/payload-pre-processing/0.log"
Jul 09 02:14:52.147276 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:52.147244    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dd66d5ffd-dbsph_5c1b21c5-6a99-4792-9e8d-6c986a74f97c/kube-auth-proxy/0.log"
Jul 09 02:14:52.251816 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:52.251762    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-jp6pj_c87da6b1-1098-48e0-838c-2f0ab998d08b/payload-pre-processing/0.log"
Jul 09 02:14:57.423584 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:57.423557    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfnsg_90b8ee8a-a205-410e-a20c-63fe30c64bb1/kube-multus-additional-cni-plugins/0.log"
Jul 09 02:14:57.443866 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:57.443840    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfnsg_90b8ee8a-a205-410e-a20c-63fe30c64bb1/egress-router-binary-copy/0.log"
Jul 09 02:14:57.464202 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:57.464182    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfnsg_90b8ee8a-a205-410e-a20c-63fe30c64bb1/cni-plugins/0.log"
Jul 09 02:14:57.485268 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:57.485251    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfnsg_90b8ee8a-a205-410e-a20c-63fe30c64bb1/bond-cni-plugin/0.log"
Jul 09 02:14:57.505259 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:57.505240    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfnsg_90b8ee8a-a205-410e-a20c-63fe30c64bb1/routeoverride-cni/0.log"
Jul 09 02:14:57.526452 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:57.526430    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfnsg_90b8ee8a-a205-410e-a20c-63fe30c64bb1/whereabouts-cni-bincopy/0.log"
Jul 09 02:14:57.547565 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:57.547545    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfnsg_90b8ee8a-a205-410e-a20c-63fe30c64bb1/whereabouts-cni/0.log"
Jul 09 02:14:57.609141 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:57.609109    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tf75l_8bbd093b-0f3c-474f-b700-7ea794383781/kube-multus/0.log"
Jul 09 02:14:57.737526 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:57.737443    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fbxl7_354cfa30-e59e-4198-996a-62a7fd0b43dc/network-metrics-daemon/0.log"
Jul 09 02:14:57.760729 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:57.760706    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fbxl7_354cfa30-e59e-4198-996a-62a7fd0b43dc/kube-rbac-proxy/0.log"
Jul 09 02:14:58.680253 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:58.680171    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-699pt_06fb185c-c179-447a-a8cc-523c966571b7/ovn-controller/0.log"
Jul 09 02:14:58.698733 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:58.698700    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-699pt_06fb185c-c179-447a-a8cc-523c966571b7/ovn-acl-logging/0.log"
Jul 09 02:14:58.722896 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:58.722869    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-699pt_06fb185c-c179-447a-a8cc-523c966571b7/kube-rbac-proxy-node/0.log"
Jul 09 02:14:58.744894 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:58.744861    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-699pt_06fb185c-c179-447a-a8cc-523c966571b7/kube-rbac-proxy-ovn-metrics/0.log"
Jul 09 02:14:58.769171 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:58.769147    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-699pt_06fb185c-c179-447a-a8cc-523c966571b7/northd/0.log"
Jul 09 02:14:58.789852 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:58.789825    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-699pt_06fb185c-c179-447a-a8cc-523c966571b7/nbdb/0.log"
Jul 09 02:14:58.809296 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:58.809274    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-699pt_06fb185c-c179-447a-a8cc-523c966571b7/sbdb/0.log"
Jul 09 02:14:58.870425 ip-10-0-138-200 kubenswrapper[2562]: I0709 02:14:58.870397    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-699pt_06fb185c-c179-447a-a8cc-523c966571b7/ovnkube-controller/0.log"