Jul 09 18:43:39.601720 ip-10-0-137-236 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 09 18:43:39.601731 ip-10-0-137-236 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 09 18:43:39.601738 ip-10-0-137-236 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 09 18:43:39.601951 ip-10-0-137-236 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 09 18:43:49.790397 ip-10-0-137-236 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 09 18:43:49.790415 ip-10-0-137-236 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot a406915645ba4a16a6a72d6de68cf11f --
Jul 09 18:45:44.688551 ip-10-0-137-236 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 18:45:45.028193 ip-10-0-137-236 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 18:45:45.028193 ip-10-0-137-236 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 18:45:45.028193 ip-10-0-137-236 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 18:45:45.028193 ip-10-0-137-236 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 18:45:45.028193 ip-10-0-137-236 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 18:45:45.029257 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.029170    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 18:45:45.035795 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035780    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:45:45.035795 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035795    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:45:45.035873 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035799    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:45:45.035873 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035802    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:45:45.035873 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035809    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:45:45.035873 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035812    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:45:45.035873 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035815    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:45:45.035873 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035818    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:45:45.035873 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035820    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:45:45.035873 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035824    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:45:45.035873 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035839    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:45:45.035873 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035842    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:45:45.035873 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035844    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:45:45.035873 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035847    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:45:45.035873 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035850    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:45:45.035873 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035853    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:45:45.035873 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035855    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:45:45.035873 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035858    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:45:45.035873 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035861    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:45:45.035873 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035863    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:45:45.035873 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035866    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:45:45.036333 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035869    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:45:45.036333 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035872    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:45:45.036333 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035875    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:45:45.036333 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035878    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:45:45.036333 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035880    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:45:45.036333 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035883    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:45:45.036333 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035886    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:45:45.036333 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035889    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:45:45.036333 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035891    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:45:45.036333 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035894    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:45:45.036333 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035896    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:45:45.036333 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035899    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:45:45.036333 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035902    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:45:45.036333 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035904    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:45:45.036333 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035907    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:45:45.036333 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035909    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:45:45.036333 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035913    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:45:45.036333 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035915    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:45:45.036333 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035918    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:45:45.036333 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035920    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:45:45.037032 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035923    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:45:45.037032 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035925    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:45:45.037032 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035928    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:45:45.037032 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035930    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:45:45.037032 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035934    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:45:45.037032 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035938    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:45:45.037032 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035941    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:45:45.037032 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035943    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:45:45.037032 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035946    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:45:45.037032 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035948    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:45:45.037032 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035951    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:45:45.037032 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035953    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:45:45.037032 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035956    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:45:45.037032 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035961    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:45:45.037032 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035965    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:45:45.037032 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035968    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:45:45.037032 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035971    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:45:45.037032 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035974    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:45:45.037032 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035977    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:45:45.037721 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035980    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:45:45.037721 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035983    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:45:45.037721 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035986    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:45:45.037721 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035989    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:45:45.037721 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035992    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:45:45.037721 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035995    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:45:45.037721 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.035998    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:45:45.037721 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036001    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:45:45.037721 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036004    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:45:45.037721 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036006    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:45:45.037721 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036010    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:45:45.037721 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036012    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:45:45.037721 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036015    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:45:45.037721 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036017    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:45:45.037721 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036020    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:45:45.037721 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036022    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:45:45.037721 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036025    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:45:45.037721 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036027    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:45:45.037721 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036035    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:45:45.037721 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036038    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:45:45.038224 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036040    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:45:45.038224 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036044    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:45:45.038224 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036047    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:45:45.038224 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036049    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:45:45.038224 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036052    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:45:45.038224 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036056    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:45:45.038224 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036058    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:45:45.038224 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036061    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:45:45.038224 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036064    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:45:45.038224 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036066    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:45:45.038224 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036069    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:45:45.038224 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036071    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:45:45.038224 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036074    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:45:45.038224 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036078    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:45:45.038224 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036081    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:45:45.038224 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036084    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:45:45.038224 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036087    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:45:45.038224 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036090    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:45:45.038224 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.036093    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:45:45.040986 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.040965    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:45:45.040986 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.040981    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:45:45.040986 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.040986    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:45:45.040986 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.040989    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:45:45.040986 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.040992    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:45:45.041188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.040995    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:45:45.041188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.040998    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:45:45.041188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041001    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:45:45.041188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041003    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:45:45.041188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041006    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:45:45.041188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041009    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:45:45.041188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041012    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:45:45.041188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041015    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:45:45.041188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041017    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:45:45.041188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041020    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:45:45.041188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041023    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:45:45.041188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041025    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:45:45.041188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041028    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:45:45.041188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041030    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:45:45.041188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041033    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:45:45.041188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041036    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:45:45.041188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041038    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:45:45.041188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041041    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:45:45.041188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041045    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:45:45.041685 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041050    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:45:45.041685 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041052    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:45:45.041685 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041055    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:45:45.041685 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041061    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:45:45.041685 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041064    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:45:45.041685 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041066    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:45:45.041685 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041069    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:45:45.041685 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041072    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:45:45.041685 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041074    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:45:45.041685 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041077    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:45:45.041685 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041079    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:45:45.041685 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041082    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:45:45.041685 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041085    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:45:45.041685 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041087    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:45:45.041685 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041090    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:45:45.041685 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041093    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:45:45.041685 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041095    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:45:45.041685 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041098    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:45:45.041685 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041101    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:45:45.041685 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041103    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:45:45.042188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041106    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:45:45.042188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041108    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:45:45.042188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041111    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:45:45.042188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041115    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:45:45.042188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041119    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:45:45.042188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041122    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:45:45.042188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041133    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:45:45.042188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041136    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:45:45.042188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041139    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:45:45.042188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041142    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:45:45.042188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041145    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:45:45.042188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041148    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:45:45.042188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041150    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:45:45.042188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041153    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:45:45.042188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041156    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:45:45.042188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041159    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:45:45.042188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041161    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:45:45.042188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041164    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:45:45.042188 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041166    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:45:45.042644 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041169    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:45:45.042644 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041171    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:45:45.042644 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041174    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:45:45.042644 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041176    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:45:45.042644 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041179    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:45:45.042644 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041182    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:45:45.042644 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041185    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:45:45.042644 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041187    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:45:45.042644 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041190    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:45:45.042644 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041193    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:45:45.042644 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041195    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:45:45.042644 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041198    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:45:45.042644 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041201    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:45:45.042644 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041204    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:45:45.042644 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041206    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:45:45.042644 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041209    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:45:45.042644 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041212    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:45:45.042644 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041215    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:45:45.042644 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041217    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:45:45.042644 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041221    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:45:45.043146 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041226    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:45:45.043146 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041229    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:45:45.043146 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041232    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:45:45.043146 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041235    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:45:45.043146 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041238    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:45:45.043146 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041241    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:45:45.043146 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041244    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:45:45.043146 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041247    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:45:45.043146 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041250    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:45:45.043146 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041252    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:45:45.043146 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041255    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:45:45.043146 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041258    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:45:45.043146 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041261    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:45:45.043146 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041263    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:45:45.043146 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041266    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:45:45.043146 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041269    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:45:45.043146 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041646    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:45:45.043146 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041651    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:45:45.043146 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041654    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:45:45.043602 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041657    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:45:45.043602 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041660    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:45:45.043602 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041663    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:45:45.043602 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041666    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:45:45.043602 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041668    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:45:45.043602 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041671    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:45:45.043602 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041673    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:45:45.043602 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041676    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:45:45.043602 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041679    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:45:45.043602 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041681    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:45:45.043602 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041684    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:45:45.043602 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041688    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:45:45.043602 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041691    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:45:45.043602 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041695    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:45:45.043602 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041698    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:45:45.043602 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041700    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:45:45.043602 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041703    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:45:45.043602 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041706    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:45:45.043602 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041709    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:45:45.044069 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041711    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:45:45.044069 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041714    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:45:45.044069 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041716    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:45:45.044069 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041719    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:45:45.044069 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041721    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:45:45.044069 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041724    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:45:45.044069 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041727    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:45:45.044069 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041729    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:45:45.044069 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041732    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:45:45.044069 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041735    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:45:45.044069 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041738    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:45:45.044069 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041740    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:45:45.044069 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041743    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:45:45.044069 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041745    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:45:45.044069 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041749    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:45:45.044069 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041753    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:45:45.044069 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041756    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:45:45.044069 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041759    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:45:45.044069 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041762    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:45:45.044069 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041765    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:45:45.044553 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041767    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:45:45.044553 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041770    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:45:45.044553 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041773    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:45:45.044553 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041776    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:45:45.044553 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041779    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:45:45.044553 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041782    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:45:45.044553 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041785    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:45:45.044553 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041788    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:45:45.044553 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041791    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:45:45.044553 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041795    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:45:45.044553 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041798    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:45:45.044553 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041801    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:45:45.044553 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041804    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:45:45.044553 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041807    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:45:45.044553 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041810    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:45:45.044553 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041813    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:45:45.044553 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041815    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:45:45.044553 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041818    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:45:45.044553 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041820    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:45:45.044553 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041822    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:45:45.045039 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041839    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:45:45.045039 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041842    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:45:45.045039 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041845    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:45:45.045039 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041848    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:45:45.045039 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041851    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:45:45.045039 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041853    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:45:45.045039 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041856    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:45:45.045039 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041859    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:45:45.045039 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041861    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:45:45.045039 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041864    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:45:45.045039 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041867    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:45:45.045039 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041869    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:45:45.045039 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041872    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:45:45.045039 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041874    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:45:45.045039 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041877    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:45:45.045039 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041879    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:45:45.045039 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041882    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:45:45.045039 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041884    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:45:45.045039 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041887    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:45:45.045488 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041889    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:45:45.045488 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041893    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:45:45.045488 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041895    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:45:45.045488 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041898    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:45:45.045488 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041900    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:45:45.045488 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041903    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:45:45.045488 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041906    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:45:45.045488 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041909    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:45:45.045488 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041911    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:45:45.045488 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041914    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:45:45.045488 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041916    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:45:45.045488 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041919    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:45:45.045488 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041921    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:45:45.045488 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041924    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:45:45.045488 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041927    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:45:45.045488 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041930    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:45:45.045488 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041932    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:45:45.045488 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.041935    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:45:45.045488 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042011    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 18:45:45.045488 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042030    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 18:45:45.045488 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042039    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 18:45:45.045998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042044    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 18:45:45.045998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042047    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 18:45:45.045998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042051    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 18:45:45.045998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042055    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 18:45:45.045998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042059    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 18:45:45.045998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042062    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 18:45:45.045998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042065    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 18:45:45.045998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042069    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 18:45:45.045998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042072    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 18:45:45.045998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042075    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 18:45:45.045998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042078    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 09 18:45:45.045998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042081    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 18:45:45.045998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042084    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 09 18:45:45.045998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042088    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 18:45:45.045998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042091    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 18:45:45.045998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042094    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 09 18:45:45.045998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042100    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 18:45:45.045998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042103    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 18:45:45.045998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042106    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 18:45:45.045998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042109    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 18:45:45.045998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042113    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 18:45:45.045998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042116    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 18:45:45.045998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042119    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 18:45:45.046548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042122    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 18:45:45.046548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042125    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 18:45:45.046548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042128    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 18:45:45.046548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042131    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 18:45:45.046548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042135    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 18:45:45.046548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042138    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 18:45:45.046548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042142    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 18:45:45.046548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042145    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 18:45:45.046548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042148    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 18:45:45.046548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042151    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 18:45:45.046548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042154    2580 flags.go:64] FLAG: --enable-server="true"
Jul 09 18:45:45.046548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042156    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 18:45:45.046548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042161    2580 flags.go:64] FLAG: --event-burst="100"
Jul 09 18:45:45.046548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042164    2580 flags.go:64] FLAG: --event-qps="50"
Jul 09 18:45:45.046548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042167    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 18:45:45.046548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042170    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 18:45:45.046548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042173    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 09 18:45:45.046548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042177    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 18:45:45.046548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042180    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 18:45:45.046548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042182    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 18:45:45.046548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042186    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 09 18:45:45.046548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042189    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 18:45:45.046548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042192    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 18:45:45.046548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042195    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 18:45:45.046548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042198    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 18:45:45.047218 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042202    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 18:45:45.047218 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042206    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 18:45:45.047218 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042209    2580 flags.go:64] FLAG: --feature-gates=""
Jul 09 18:45:45.047218 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042212    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 18:45:45.047218 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042215    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 18:45:45.047218 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042218    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 18:45:45.047218 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042221    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 18:45:45.047218 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042225    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 18:45:45.047218 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042228    2580 flags.go:64] FLAG: --help="false"
Jul 09 18:45:45.047218 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042231    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-137-236.ec2.internal"
Jul 09 18:45:45.047218 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042234    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 18:45:45.047218 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042236    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 18:45:45.047218 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042239    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 18:45:45.047218 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042243    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 18:45:45.047218 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042246    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 18:45:45.047218 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042249    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 18:45:45.047218 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042251    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 18:45:45.047218 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042254    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 18:45:45.047218 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042257    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 18:45:45.047218 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042259    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 18:45:45.047218 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042263    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 18:45:45.047218 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042265    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 09 18:45:45.047218 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042268    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 18:45:45.047218 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042271    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 18:45:45.047800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042274    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 18:45:45.047800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042277    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 18:45:45.047800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042279    2580 flags.go:64] FLAG: --lock-file=""
Jul 09 18:45:45.047800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042282    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 18:45:45.047800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042285    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 18:45:45.047800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042288    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 18:45:45.047800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042293    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 18:45:45.047800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042296    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 18:45:45.047800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042301    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 18:45:45.047800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042303    2580 flags.go:64] FLAG: --logging-format="text"
Jul 09 18:45:45.047800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042306    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 18:45:45.047800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042309    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 18:45:45.047800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042312    2580 flags.go:64] FLAG: --manifest-url=""
Jul 09 18:45:45.047800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042315    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 18:45:45.047800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042319    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 18:45:45.047800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042322    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 18:45:45.047800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042328    2580 flags.go:64] FLAG: --max-pods="110"
Jul 09 18:45:45.047800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042331    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 18:45:45.047800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042334    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 18:45:45.047800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042337    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 18:45:45.047800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042340    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 18:45:45.047800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042343    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 18:45:45.047800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042346    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 18:45:45.047800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042349    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 18:45:45.047800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042356    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 18:45:45.048420 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042359    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 18:45:45.048420 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042363    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 18:45:45.048420 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042366    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 09 18:45:45.048420 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042368    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 09 18:45:45.048420 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042374    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 18:45:45.048420 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042377    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 18:45:45.048420 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042380    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 18:45:45.048420 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042383    2580 flags.go:64] FLAG: --port="10250"
Jul 09 18:45:45.048420 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042386    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 18:45:45.048420 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042388    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0edbe58cebb220d5e"
Jul 09 18:45:45.048420 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042391    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 09 18:45:45.048420 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042395    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 18:45:45.048420 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042397    2580 flags.go:64] FLAG: --register-node="true"
Jul 09 18:45:45.048420 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042400    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 09 18:45:45.048420 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042406    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 09 18:45:45.048420 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042411    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 09 18:45:45.048420 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042414    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 18:45:45.048420 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042417    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 09 18:45:45.048420 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042420    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 18:45:45.048420 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042423    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 18:45:45.048420 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042426    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 18:45:45.048420 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042429    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 18:45:45.048420 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042432    2580 flags.go:64] FLAG: --runonce="false"
Jul 09 18:45:45.048420 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042435    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 18:45:45.048420 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042439    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 18:45:45.049039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042442    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 18:45:45.049039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042445    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 18:45:45.049039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042448    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 18:45:45.049039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042450    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 18:45:45.049039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042453    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 18:45:45.049039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042456    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 18:45:45.049039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042459    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 18:45:45.049039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042462    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 18:45:45.049039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042465    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 18:45:45.049039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042468    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 18:45:45.049039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042471    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 18:45:45.049039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042474    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 09 18:45:45.049039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042477    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 18:45:45.049039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042482    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 18:45:45.049039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042485    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 18:45:45.049039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042488    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 18:45:45.049039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042492    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 09 18:45:45.049039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042494    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 18:45:45.049039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042497    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 18:45:45.049039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042500    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 18:45:45.049039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042503    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 18:45:45.049039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042506    2580 flags.go:64] FLAG: --v="2"
Jul 09 18:45:45.049039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042511    2580 flags.go:64] FLAG: --version="false"
Jul 09 18:45:45.049039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042516    2580 flags.go:64] FLAG: --vmodule=""
Jul 09 18:45:45.049039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042520    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 18:45:45.049639 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.042523    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 18:45:45.049639 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042666    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:45:45.049639 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042671    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:45:45.049639 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042674    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:45:45.049639 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042677    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:45:45.049639 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042680    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:45:45.049639 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042684    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:45:45.049639 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042688    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:45:45.049639 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042692    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:45:45.049639 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042697    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:45:45.049639 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042701    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:45:45.049639 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042704    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:45:45.049639 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042707    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:45:45.049639 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042710    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:45:45.049639 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042713    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:45:45.049639 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042715    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:45:45.049639 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042718    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:45:45.049639 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042721    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:45:45.049639 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042723    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:45:45.050123 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042726    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:45:45.050123 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042728    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:45:45.050123 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042731    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:45:45.050123 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042734    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:45:45.050123 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042736    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:45:45.050123 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042739    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:45:45.050123 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042743    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:45:45.050123 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042746    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:45:45.050123 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042749    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:45:45.050123 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042752    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:45:45.050123 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042756    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:45:45.050123 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042759    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:45:45.050123 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042762    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:45:45.050123 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042765    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:45:45.050123 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042768    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:45:45.050123 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042770    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:45:45.050123 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042773    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:45:45.050123 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042775    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:45:45.050123 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042778    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:45:45.050633 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042782    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:45:45.050633 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042784    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:45:45.050633 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042787    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:45:45.050633 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042789    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:45:45.050633 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042792    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:45:45.050633 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042794    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:45:45.050633 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042797    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:45:45.050633 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042800    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:45:45.050633 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042802    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:45:45.050633 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042804    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:45:45.050633 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042807    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:45:45.050633 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042810    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:45:45.050633 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042812    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:45:45.050633 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042815    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:45:45.050633 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042817    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:45:45.050633 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042820    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:45:45.050633 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042823    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:45:45.050633 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042845    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:45:45.050633 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042849    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:45:45.050633 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042852    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:45:45.051140 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042854    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:45:45.051140 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042857    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:45:45.051140 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042859    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:45:45.051140 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042863    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:45:45.051140 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042866    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:45:45.051140 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042868    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:45:45.051140 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042872    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:45:45.051140 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042874    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:45:45.051140 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042877    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:45:45.051140 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042879    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:45:45.051140 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042882    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:45:45.051140 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042885    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:45:45.051140 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042888    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:45:45.051140 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042891    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:45:45.051140 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042894    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:45:45.051140 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042896    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:45:45.051140 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042899    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:45:45.051140 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042901    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:45:45.051140 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042904    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:45:45.051140 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042907    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:45:45.051625 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042910    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:45:45.051625 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042912    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:45:45.051625 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042915    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:45:45.051625 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042917    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:45:45.051625 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042920    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:45:45.051625 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042923    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:45:45.051625 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042925    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:45:45.051625 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042928    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:45:45.051625 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042930    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:45:45.051625 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042933    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:45:45.051625 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042935    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:45:45.051625 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042938    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:45:45.051625 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042940    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:45:45.051625 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042943    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:45:45.051625 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042946    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:45:45.051625 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042951    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:45:45.051625 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042953    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:45:45.051625 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042956    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:45:45.051625 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042958    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:45:45.051625 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042962    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:45:45.052189 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042964    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:45:45.052189 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.042966    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:45:45.052189 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.043571    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 18:45:45.052189 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.050058    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 09 18:45:45.052189 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.050072    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 18:45:45.052189 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.050091    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 18:45:45.052189 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.050097    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 18:45:45.052189 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050150    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:45:45.052189 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050155    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:45:45.052189 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050158    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:45:45.052189 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050161    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:45:45.052189 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050165    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:45:45.052189 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050170    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:45:45.052189 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050173    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:45:45.052533 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050176    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:45:45.052533 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050178    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:45:45.052533 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050181    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:45:45.052533 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050184    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:45:45.052533 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050188    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:45:45.052533 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050192    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:45:45.052533 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050195    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:45:45.052533 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050197    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:45:45.052533 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050200    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:45:45.052533 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050203    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:45:45.052533 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050205    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:45:45.052533 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050208    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:45:45.052533 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050211    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:45:45.052533 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050214    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:45:45.052533 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050217    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:45:45.052533 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050220    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:45:45.052533 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050223    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:45:45.052533 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050226    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:45:45.052533 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050228    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:45:45.052533 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050231    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:45:45.053013 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050234    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:45:45.053013 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050236    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:45:45.053013 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050239    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:45:45.053013 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050242    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:45:45.053013 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050245    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:45:45.053013 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050247    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:45:45.053013 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050250    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:45:45.053013 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050252    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:45:45.053013 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050255    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:45:45.053013 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050257    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:45:45.053013 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050260    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:45:45.053013 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050263    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:45:45.053013 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050265    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:45:45.053013 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050268    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:45:45.053013 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050271    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:45:45.053013 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050273    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:45:45.053013 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050276    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:45:45.053013 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050281    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:45:45.053013 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050284    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:45:45.053013 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050286    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:45:45.053485 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050289    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:45:45.053485 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050291    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:45:45.053485 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050294    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:45:45.053485 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050297    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:45:45.053485 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050299    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:45:45.053485 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050302    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:45:45.053485 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050307    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:45:45.053485 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050310    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:45:45.053485 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050313    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:45:45.053485 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050316    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:45:45.053485 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050319    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:45:45.053485 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050322    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:45:45.053485 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050324    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:45:45.053485 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050327    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:45:45.053485 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050330    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:45:45.053485 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050332    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:45:45.053485 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050335    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:45:45.053485 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050337    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:45:45.053485 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050340    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:45:45.053485 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050343    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:45:45.053976 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050346    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:45:45.053976 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050348    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:45:45.053976 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050351    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:45:45.053976 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050354    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:45:45.053976 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050356    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:45:45.053976 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050359    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:45:45.053976 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050361    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:45:45.053976 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050364    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:45:45.053976 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050366    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:45:45.053976 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050369    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:45:45.053976 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050371    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:45:45.053976 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050374    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:45:45.053976 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050377    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:45:45.053976 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050379    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:45:45.053976 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050382    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:45:45.053976 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050384    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:45:45.053976 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050387    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:45:45.053976 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050390    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:45:45.053976 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050393    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:45:45.053976 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050395    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:45:45.054458 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050398    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:45:45.054458 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050400    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:45:45.054458 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050403    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:45:45.054458 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050405    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:45:45.054458 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050408    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:45:45.054458 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050410    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:45:45.054458 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050413    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:45:45.054458 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050416    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:45:45.054458 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050418    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:45:45.054458 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050421    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:45:45.054458 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050423    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:45:45.054458 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050426    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:45:45.054458 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.050431    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 18:45:45.054458 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050538    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:45:45.054458 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050542    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:45:45.054836 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050545    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:45:45.054836 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050548    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:45:45.054836 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050551    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:45:45.054836 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050554    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:45:45.054836 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050557    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:45:45.054836 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050560    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:45:45.054836 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050565    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:45:45.054836 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050568    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:45:45.054836 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050571    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:45:45.054836 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050574    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:45:45.054836 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050577    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:45:45.054836 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050580    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:45:45.054836 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050583    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:45:45.054836 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050585    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:45:45.054836 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050589    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:45:45.054836 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050593    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:45:45.054836 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050596    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:45:45.054836 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050599    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:45:45.054836 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050602    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:45:45.055308 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050604    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:45:45.055308 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050607    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:45:45.055308 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050610    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:45:45.055308 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050613    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:45:45.055308 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050615    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:45:45.055308 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050618    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:45:45.055308 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050621    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:45:45.055308 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050623    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:45:45.055308 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050626    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:45:45.055308 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050628    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:45:45.055308 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050631    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:45:45.055308 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050633    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:45:45.055308 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050636    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:45:45.055308 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050638    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:45:45.055308 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050641    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:45:45.055308 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050644    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:45:45.055308 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050646    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:45:45.055308 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050649    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:45:45.055308 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050652    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:45:45.055308 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050654    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:45:45.055786 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050657    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:45:45.055786 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050660    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:45:45.055786 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050662    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:45:45.055786 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050665    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:45:45.055786 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050667    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:45:45.055786 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050669    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:45:45.055786 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050672    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:45:45.055786 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050675    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:45:45.055786 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050678    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:45:45.055786 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050680    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:45:45.055786 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050683    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:45:45.055786 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050686    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:45:45.055786 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050688    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:45:45.055786 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050691    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:45:45.055786 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050693    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:45:45.055786 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050696    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:45:45.055786 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050699    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:45:45.055786 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050701    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:45:45.055786 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050704    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:45:45.055786 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050707    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:45:45.056270 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050709    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:45:45.056270 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050711    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:45:45.056270 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050714    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:45:45.056270 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050717    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:45:45.056270 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050719    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:45:45.056270 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050722    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:45:45.056270 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050724    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:45:45.056270 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050727    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:45:45.056270 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050729    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:45:45.056270 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050731    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:45:45.056270 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050734    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:45:45.056270 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050736    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:45:45.056270 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050739    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:45:45.056270 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050742    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:45:45.056270 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050745    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:45:45.056270 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050747    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:45:45.056270 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050750    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:45:45.056270 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050752    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:45:45.056270 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050755    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:45:45.056270 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050757    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:45:45.056742 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050760    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:45:45.056742 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050762    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:45:45.056742 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050765    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:45:45.056742 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050767    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:45:45.056742 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050769    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:45:45.056742 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050772    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:45:45.056742 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050775    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:45:45.056742 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050777    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:45:45.056742 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050780    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:45:45.056742 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050782    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:45:45.056742 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050785    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:45:45.056742 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050787    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:45:45.056742 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050790    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:45:45.056742 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050792    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:45:45.056742 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050794    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:45:45.056742 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050797    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:45:45.056742 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050800    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:45:45.056742 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:45.050802    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:45:45.057189 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.050807    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 18:45:45.057189 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.050918    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 18:45:45.057189 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.054289    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 18:45:45.057189 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.056243    2580 server.go:1019] "Starting client certificate rotation"
Jul 09 18:45:45.057189 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.056339    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 18:45:45.057189 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.056373    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 18:45:45.058626 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.058613    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 18:45:45.062098 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.062081    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 18:45:45.076100 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.076079    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 09 18:45:45.078232 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.078214    2580 log.go:25] "Validated CRI v1 image API"
Jul 09 18:45:45.079040 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.079024    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 18:45:45.081192 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.081174    2580 fs.go:135] Filesystem UUIDs: map[1553e010-4e6e-4d39-8e2b-87788c5c5691:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 dbeb0c3b-f825-402f-b9ce-e414f9f42b75:/dev/nvme0n1p4]
Jul 09 18:45:45.081247 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.081193    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 18:45:45.087185 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.087062    2580 manager.go:216] Machine: {Timestamp:2026-07-09 18:45:45.085959219 +0000 UTC m=+0.295548430 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3139949 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec278b8d16a08336bdc565f927e8ea1d SystemUUID:ec278b8d-16a0-8336-bdc5-65f927e8ea1d BootID:a4069156-45ba-4a16-a6a7-2d6de68cf11f Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e9:cf:e7:f2:9b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e9:cf:e7:f2:9b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:6e:c4:cc:d5:6b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 18:45:45.087185 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.087183    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 18:45:45.087296 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.087261    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 18:45:45.090001 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.089973    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 18:45:45.090141 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.090003    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-236.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 18:45:45.090711 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.090701    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 18:45:45.090742 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.090713    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 18:45:45.090742 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.090722    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 18:45:45.091390 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.091379    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 18:45:45.092306 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.092296    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 18:45:45.096323 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.096310    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 18:45:45.096457 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.096447    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 18:45:45.097087 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.097076    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 18:45:45.097135 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.097093    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 18:45:45.097135 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.097125    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 18:45:45.097135 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.097136    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 09 18:45:45.097272 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.097145    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 18:45:45.097506 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.097490    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 18:45:45.097566 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.097511    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 18:45:45.099780 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.099761    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 09 18:45:45.101219 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.101204    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 18:45:45.101268 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.101237    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 18:45:45.101864 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.101852    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 18:45:45.101896 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.101870    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 18:45:45.101896 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.101879    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 18:45:45.101896 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.101885    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 18:45:45.101896 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.101894    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 18:45:45.102037 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.101900    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 18:45:45.102037 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.101927    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 18:45:45.102037 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.101934    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 18:45:45.102037 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.101949    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 18:45:45.102037 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.101956    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 18:45:45.102037 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.101970    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 18:45:45.102037 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.101979    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 18:45:45.102680 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.102670    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 18:45:45.102680 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.102679    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 18:45:45.105967 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.105951    2580 server.go:1268] "Started kubelet"
Jul 09 18:45:45.106071 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.106033    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 18:45:45.106198 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.106043    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 18:45:45.106260 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.106224    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 18:45:45.107116 ip-10-0-137-236 systemd[1]: Started Kubernetes Kubelet.
Jul 09 18:45:45.107754 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.107621    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 18:45:45.108380 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.108367    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 18:45:45.110674 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:45.110650    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 18:45:45.111974 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.111953    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 18:45:45.112061 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.111956    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 18:45:45.112133 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:45.112066    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-236.ec2.internal\" not found"
Jul 09 18:45:45.113048 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.112725    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 18:45:45.113048 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.112873    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 18:45:45.113203 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.113057    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 18:45:45.113203 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.113066    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 18:45:45.113591 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.113574    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 18:45:45.113787 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.113753    2580 factory.go:55] Registering systemd factory
Jul 09 18:45:45.113787 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.113782    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 09 18:45:45.114058 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.114041    2580 factory.go:153] Registering CRI-O factory
Jul 09 18:45:45.114146 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.114061    2580 factory.go:223] Registration of the crio container factory successfully
Jul 09 18:45:45.114204 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.114154    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 18:45:45.114204 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.114180    2580 factory.go:103] Registering Raw factory
Jul 09 18:45:45.114204 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.114203    2580 manager.go:1196] Started watching for new ooms in manager
Jul 09 18:45:45.115251 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.115216    2580 manager.go:349] Starting recovery of all containers
Jul 09 18:45:45.121326 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.121276    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 18:45:45.127902 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.127731    2580 manager.go:354] Recovery completed
Jul 09 18:45:45.132069 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.132056    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:45:45.133997 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.133980    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-236.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 18:45:45.135282 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:45.135265    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-236.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 18:45:45.137539 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.137520    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:45:45.137610 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.137565    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:45:45.137610 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.137576    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-236.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:45:45.137831 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:45.137808    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 09 18:45:45.138278 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.138252    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 18:45:45.138278 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.138268    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:45:45.138430 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.138270    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 18:45:45.138430 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.138370    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 18:45:45.139083 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.139068    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:45:45.139149 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.139095    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:45:45.139149 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.139107    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-236.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:45:45.140619 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.140606    2580 policy_none.go:49] "None policy: Start"
Jul 09 18:45:45.140680 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.140634    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 18:45:45.140680 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.140645    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 18:45:45.141469 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:45.141443    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 18:45:45.141573 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:45.141524    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-236.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 09 18:45:45.141657 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.141640    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 18:45:45.142262 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:45.141380    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-236.ec2.internal.18c0b36fc7587d88  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-236.ec2.internal,UID:ip-10-0-137-236.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-236.ec2.internal,},FirstTimestamp:2026-07-09 18:45:45.105923464 +0000 UTC m=+0.315512678,LastTimestamp:2026-07-09 18:45:45.105923464 +0000 UTC m=+0.315512678,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-236.ec2.internal,}"
Jul 09 18:45:45.142810 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.142798    2580 policy_none.go:47] "Start"
Jul 09 18:45:45.150151 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:45.150085    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-236.ec2.internal.18c0b36fc93b1081  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-236.ec2.internal,UID:ip-10-0-137-236.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-236.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-236.ec2.internal,},FirstTimestamp:2026-07-09 18:45:45.137549441 +0000 UTC m=+0.347138653,LastTimestamp:2026-07-09 18:45:45.137549441 +0000 UTC m=+0.347138653,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-236.ec2.internal,}"
Jul 09 18:45:45.152722 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.152699    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cfxfn"
Jul 09 18:45:45.158544 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:45.158471    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-236.ec2.internal.18c0b36fc93b6232  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-236.ec2.internal,UID:ip-10-0-137-236.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-236.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-236.ec2.internal,},FirstTimestamp:2026-07-09 18:45:45.137570354 +0000 UTC m=+0.347159566,LastTimestamp:2026-07-09 18:45:45.137570354 +0000 UTC m=+0.347159566,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-236.ec2.internal,}"
Jul 09 18:45:45.163120 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.163103    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cfxfn"
Jul 09 18:45:45.191537 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.191519    2580 manager.go:337] "Starting Device Plugin manager"
Jul 09 18:45:45.191622 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:45.191549    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 18:45:45.191622 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.191559    2580 server.go:87] "Starting device plugin registration server"
Jul 09 18:45:45.191796 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.191781    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 18:45:45.192197 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.191794    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 18:45:45.192197 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.191920    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 18:45:45.192197 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.192034    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 18:45:45.192197 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.192044    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 18:45:45.218123 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:45.192677    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 18:45:45.218123 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:45.192734    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-236.ec2.internal\" not found"
Jul 09 18:45:45.246133 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.246107    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 18:45:45.246245 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.246152    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 18:45:45.246245 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.246173    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 18:45:45.246245 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:45.246207    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 18:45:45.249019 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.248994    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:45:45.292359 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.292300    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:45:45.293424 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.293407    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:45:45.293507 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.293440    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:45:45.293507 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.293452    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-236.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:45:45.293507 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.293477    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-236.ec2.internal"
Jul 09 18:45:45.302944 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.302929    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-236.ec2.internal"
Jul 09 18:45:45.303000 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:45.302952    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-236.ec2.internal\": node \"ip-10-0-137-236.ec2.internal\" not found"
Jul 09 18:45:45.322453 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:45.322429    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-236.ec2.internal\" not found"
Jul 09 18:45:45.347044 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.347018    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-236.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-236.ec2.internal"]
Jul 09 18:45:45.347146 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.347091    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:45:45.348686 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.348670    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:45:45.348780 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.348704    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:45:45.348780 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.348719    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-236.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:45:45.352048 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.352032    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:45:45.352165 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.352149    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-236.ec2.internal"
Jul 09 18:45:45.352209 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.352183    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:45:45.352821 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.352800    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:45:45.352940 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.352800    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:45:45.352940 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.352847    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:45:45.352940 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.352859    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:45:45.352940 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.352890    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-236.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:45:45.352940 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.352862    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-236.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:45:45.355332 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.355318    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-236.ec2.internal"
Jul 09 18:45:45.355418 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.355343    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:45:45.355989 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.355973    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:45:45.356056 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.355996    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:45:45.356056 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.356010    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-236.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:45:45.375571 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:45.375541    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-236.ec2.internal\" not found" node="ip-10-0-137-236.ec2.internal"
Jul 09 18:45:45.379412 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:45.379396    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-236.ec2.internal\" not found" node="ip-10-0-137-236.ec2.internal"
Jul 09 18:45:45.423634 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:45.423602    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-236.ec2.internal\" not found"
Jul 09 18:45:45.516086 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.516029    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/809123b5f16ae02e29c4290d953f3218-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-236.ec2.internal\" (UID: \"809123b5f16ae02e29c4290d953f3218\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-236.ec2.internal"
Jul 09 18:45:45.516196 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.516112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f3668d4575d5d0e1336d26672db23ccf-config\") pod \"kube-apiserver-proxy-ip-10-0-137-236.ec2.internal\" (UID: \"f3668d4575d5d0e1336d26672db23ccf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-236.ec2.internal"
Jul 09 18:45:45.516196 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.516142    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/809123b5f16ae02e29c4290d953f3218-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-236.ec2.internal\" (UID: \"809123b5f16ae02e29c4290d953f3218\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-236.ec2.internal"
Jul 09 18:45:45.524791 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:45.524770    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-236.ec2.internal\" not found"
Jul 09 18:45:45.617465 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.617378    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f3668d4575d5d0e1336d26672db23ccf-config\") pod \"kube-apiserver-proxy-ip-10-0-137-236.ec2.internal\" (UID: \"f3668d4575d5d0e1336d26672db23ccf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-236.ec2.internal"
Jul 09 18:45:45.617465 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.617415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/809123b5f16ae02e29c4290d953f3218-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-236.ec2.internal\" (UID: \"809123b5f16ae02e29c4290d953f3218\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-236.ec2.internal"
Jul 09 18:45:45.617640 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.617472    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/809123b5f16ae02e29c4290d953f3218-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-236.ec2.internal\" (UID: \"809123b5f16ae02e29c4290d953f3218\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-236.ec2.internal"
Jul 09 18:45:45.617640 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.617530    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f3668d4575d5d0e1336d26672db23ccf-config\") pod \"kube-apiserver-proxy-ip-10-0-137-236.ec2.internal\" (UID: \"f3668d4575d5d0e1336d26672db23ccf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-236.ec2.internal"
Jul 09 18:45:45.617640 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.617550    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/809123b5f16ae02e29c4290d953f3218-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-236.ec2.internal\" (UID: \"809123b5f16ae02e29c4290d953f3218\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-236.ec2.internal"
Jul 09 18:45:45.617640 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.617575    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/809123b5f16ae02e29c4290d953f3218-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-236.ec2.internal\" (UID: \"809123b5f16ae02e29c4290d953f3218\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-236.ec2.internal"
Jul 09 18:45:45.624966 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:45.624938    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-236.ec2.internal\" not found"
Jul 09 18:45:45.681447 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.681403    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-236.ec2.internal"
Jul 09 18:45:45.682595 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.682578    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-236.ec2.internal"
Jul 09 18:45:45.725426 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:45.725389    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-236.ec2.internal\" not found"
Jul 09 18:45:45.825804 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:45.825738    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-236.ec2.internal\" not found"
Jul 09 18:45:45.926591 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:45.926508    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-236.ec2.internal\" not found"
Jul 09 18:45:45.981558 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:45.981529    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:45:46.027703 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:46.027670    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-236.ec2.internal\" not found"
Jul 09 18:45:46.055182 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:46.055152    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 18:45:46.055705 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:46.055303    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 18:45:46.055705 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:46.055331    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 18:45:46.127955 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:46.127916    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-236.ec2.internal\" not found"
Jul 09 18:45:46.167930 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:46.167884    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 18:40:45 +0000 UTC" deadline="2028-03-30 22:16:27.235542186 +0000 UTC"
Jul 09 18:45:46.167930 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:46.167919    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15123h30m41.067626463s"
Jul 09 18:45:46.212592 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:46.212517    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:45:46.213522 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:46.213499    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:45:46.213625 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:46.213541    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:45:46.213625 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:46.213557    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-236.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:45:46.228939 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:46.228921    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-236.ec2.internal\" not found"
Jul 09 18:45:46.246167 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:46.246144    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:45:46.313000 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:46.312965    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-236.ec2.internal"
Jul 09 18:45:46.334754 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:46.334729    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 18:45:46.336262 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:46.336248    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-236.ec2.internal"
Jul 09 18:45:46.345510 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:46.345482    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 18:45:46.396146 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:46.396119    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:45:46.411396 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:46.411349    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod809123b5f16ae02e29c4290d953f3218.slice/crio-3249d1e4b370196913dce44e01dbe21f6a1c0f7a847c9190b1187e4c657668de WatchSource:0}: Error finding container 3249d1e4b370196913dce44e01dbe21f6a1c0f7a847c9190b1187e4c657668de: Status 404 returned error can't find the container with id 3249d1e4b370196913dce44e01dbe21f6a1c0f7a847c9190b1187e4c657668de
Jul 09 18:45:46.419879 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:46.419859    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 18:45:46.426460 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:46.426431    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3668d4575d5d0e1336d26672db23ccf.slice/crio-dd3467ee993c533397a00372193583c74ccf9a7cf1bd06fd8bd8546ba8cd14ae WatchSource:0}: Error finding container dd3467ee993c533397a00372193583c74ccf9a7cf1bd06fd8bd8546ba8cd14ae: Status 404 returned error can't find the container with id dd3467ee993c533397a00372193583c74ccf9a7cf1bd06fd8bd8546ba8cd14ae
Jul 09 18:45:47.098779 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.098493    2580 apiserver.go:52] "Watching apiserver"
Jul 09 18:45:47.107588 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.107555    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 18:45:47.108319 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.108289    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-236.ec2.internal","openshift-cluster-node-tuning-operator/tuned-7lt7f","openshift-dns/node-resolver-9stx9","openshift-image-registry/node-ca-kcv9j","openshift-multus/multus-additional-cni-plugins-kqr58","openshift-network-diagnostics/network-check-target-5rkc2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-236.ec2.internal","openshift-multus/multus-lf5c6","openshift-multus/network-metrics-daemon-c4kbs","openshift-network-operator/iptables-alerter-9tkmf","openshift-ovn-kubernetes/ovnkube-node-hps7x","kube-system/global-pull-secret-syncer-8zclz","kube-system/konnectivity-agent-r5584"]
Jul 09 18:45:47.111398 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.111364    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9tkmf"
Jul 09 18:45:47.113012 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.112992    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 18:45:47.115006 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.114983    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 18:45:47.115242 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.115223    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:45:47.115572 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.115553    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t746c\""
Jul 09 18:45:47.116267 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.116243    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 18:45:47.116340 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.116291    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r5584"
Jul 09 18:45:47.120451 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.120427    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw"
Jul 09 18:45:47.121560 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.121539    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 18:45:47.121825 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.121797    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 18:45:47.122170 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.122145    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qchhs\""
Jul 09 18:45:47.122946 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.122896    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kcv9j"
Jul 09 18:45:47.124229 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.124207    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 18:45:47.124449 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.124431    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 18:45:47.124672 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.124654    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 18:45:47.124858 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.124841    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-q67rm\""
Jul 09 18:45:47.128395 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.128371    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 18:45:47.128716 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.128695    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dmh2t\""
Jul 09 18:45:47.130287 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.130261    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c31709d1-1d67-431a-b24b-0020555b58e3-iptables-alerter-script\") pod \"iptables-alerter-9tkmf\" (UID: \"c31709d1-1d67-431a-b24b-0020555b58e3\") " pod="openshift-network-operator/iptables-alerter-9tkmf"
Jul 09 18:45:47.130381 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.130308    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c31709d1-1d67-431a-b24b-0020555b58e3-host-slash\") pod \"iptables-alerter-9tkmf\" (UID: \"c31709d1-1d67-431a-b24b-0020555b58e3\") " pod="openshift-network-operator/iptables-alerter-9tkmf"
Jul 09 18:45:47.130381 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.130341    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cg72\" (UniqueName: \"kubernetes.io/projected/c31709d1-1d67-431a-b24b-0020555b58e3-kube-api-access-6cg72\") pod \"iptables-alerter-9tkmf\" (UID: \"c31709d1-1d67-431a-b24b-0020555b58e3\") " pod="openshift-network-operator/iptables-alerter-9tkmf"
Jul 09 18:45:47.130381 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.130366    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7c638eb0-3766-4e75-9a1e-5d22fdac873b-agent-certs\") pod \"konnectivity-agent-r5584\" (UID: \"7c638eb0-3766-4e75-9a1e-5d22fdac873b\") " pod="kube-system/konnectivity-agent-r5584"
Jul 09 18:45:47.130548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.130401    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7c638eb0-3766-4e75-9a1e-5d22fdac873b-konnectivity-ca\") pod \"konnectivity-agent-r5584\" (UID: \"7c638eb0-3766-4e75-9a1e-5d22fdac873b\") " pod="kube-system/konnectivity-agent-r5584"
Jul 09 18:45:47.136039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.134278    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 18:45:47.136039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.134534    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 18:45:47.136039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.134720    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.136039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.135713    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:45:47.136039 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:47.135796    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rkc2" podUID="be0a5922-6e9a-4314-bb47-e68afc2cdc7b"
Jul 09 18:45:47.137260 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.137235    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 18:45:47.137833 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.137811    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 18:45:47.137925 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.137852    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 18:45:47.138210 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.138191    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vcr7d\""
Jul 09 18:45:47.138279 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.138215    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 18:45:47.138461 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.138439    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 18:45:47.138533 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.138490    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.139148 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.139130    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 18:45:47.141157 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.141128    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 18:45:47.141289 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.141266    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-npdwd\""
Jul 09 18:45:47.141516 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.141497    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:45:47.141590 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:47.141568    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kbs" podUID="409661cb-d599-4f25-a45b-58c69fd015f8"
Jul 09 18:45:47.143511 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.143495    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9stx9"
Jul 09 18:45:47.146473 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.146015    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 18:45:47.146473 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.146253    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 18:45:47.146473 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.146383    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bpqpt\""
Jul 09 18:45:47.146680 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.146629    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.149149 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.148930    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:45:47.149149 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:47.148993    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zclz" podUID="493326cf-6bd0-480f-b459-66089efc73c8"
Jul 09 18:45:47.149149 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.149001    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 18:45:47.150312 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.150293    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 18:45:47.150425 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.150355    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 18:45:47.150534 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.150507    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 18:45:47.150640 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.150621    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 18:45:47.150780 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.150760    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 18:45:47.150855 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.150836    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5dkss\""
Jul 09 18:45:47.152967 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.152947    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.156602 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.155980    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 18:45:47.156602 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.156235    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:45:47.156602 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.156418    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jqwrx\""
Jul 09 18:45:47.158193 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.157512    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jw8qm"
Jul 09 18:45:47.167067 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.167032    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jw8qm"
Jul 09 18:45:47.214827 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.214805    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 18:45:47.231034 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231000    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-hostroot\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.231173 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231047    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6ed47e5e-bb49-4c04-a547-aadde61f5fdd-registration-dir\") pod \"aws-ebs-csi-driver-node-lrpqw\" (UID: \"6ed47e5e-bb49-4c04-a547-aadde61f5fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw"
Jul 09 18:45:47.231173 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231073    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-etc-kubernetes\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.231173 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-run\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.231173 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231121    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-os-release\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.231173 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231143    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-host-run-k8s-cni-cncf-io\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.231173 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231172    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c31709d1-1d67-431a-b24b-0020555b58e3-host-slash\") pod \"iptables-alerter-9tkmf\" (UID: \"c31709d1-1d67-431a-b24b-0020555b58e3\") " pod="openshift-network-operator/iptables-alerter-9tkmf"
Jul 09 18:45:47.231489 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231199    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7c638eb0-3766-4e75-9a1e-5d22fdac873b-konnectivity-ca\") pod \"konnectivity-agent-r5584\" (UID: \"7c638eb0-3766-4e75-9a1e-5d22fdac873b\") " pod="kube-system/konnectivity-agent-r5584"
Jul 09 18:45:47.231489 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231227    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-host-slash\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.231489 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231251    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-host-cni-netd\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.231489 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231275    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/493326cf-6bd0-480f-b459-66089efc73c8-dbus\") pod \"global-pull-secret-syncer-8zclz\" (UID: \"493326cf-6bd0-480f-b459-66089efc73c8\") " pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:45:47.231489 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231298    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-host\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.231489 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231324    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c08f64a5-c9f2-4791-9cb0-0e3737d610cf-serviceca\") pod \"node-ca-kcv9j\" (UID: \"c08f64a5-c9f2-4791-9cb0-0e3737d610cf\") " pod="openshift-image-registry/node-ca-kcv9j"
Jul 09 18:45:47.231489 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231348    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-etc-kubernetes\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.231489 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231372    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-host-kubelet\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.231489 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231399    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-host-run-netns\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.231489 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231427    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2mqr\" (UniqueName: \"kubernetes.io/projected/30222ae0-b5d2-440e-a799-e808706d4b84-kube-api-access-r2mqr\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.231489 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231468    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/493326cf-6bd0-480f-b459-66089efc73c8-kubelet-config\") pod \"global-pull-secret-syncer-8zclz\" (UID: \"493326cf-6bd0-480f-b459-66089efc73c8\") " pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:45:47.232059 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231496    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-etc-modprobe-d\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.232059 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231526    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-var-lib-kubelet\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.232059 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231595    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eaa7461d-b281-4e7f-86f0-4caebd6a396d-cnibin\") pod \"multus-additional-cni-plugins-kqr58\" (UID: \"eaa7461d-b281-4e7f-86f0-4caebd6a396d\") " pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.232059 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231619    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-cnibin\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.232059 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231657    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/493326cf-6bd0-480f-b459-66089efc73c8-original-pull-secret\") pod \"global-pull-secret-syncer-8zclz\" (UID: \"493326cf-6bd0-480f-b459-66089efc73c8\") " pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:45:47.232059 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231684    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eaa7461d-b281-4e7f-86f0-4caebd6a396d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kqr58\" (UID: \"eaa7461d-b281-4e7f-86f0-4caebd6a396d\") " pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.232059 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231709    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-run-ovn\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.232059 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231735    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/30222ae0-b5d2-440e-a799-e808706d4b84-env-overrides\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.232059 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231758    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-etc-sysctl-d\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.232059 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231785    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sgj8\" (UniqueName: \"kubernetes.io/projected/eaa7461d-b281-4e7f-86f0-4caebd6a396d-kube-api-access-6sgj8\") pod \"multus-additional-cni-plugins-kqr58\" (UID: \"eaa7461d-b281-4e7f-86f0-4caebd6a396d\") " pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.232059 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231811    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-system-cni-dir\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.232059 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231841    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c31709d1-1d67-431a-b24b-0020555b58e3-iptables-alerter-script\") pod \"iptables-alerter-9tkmf\" (UID: \"c31709d1-1d67-431a-b24b-0020555b58e3\") " pod="openshift-network-operator/iptables-alerter-9tkmf"
Jul 09 18:45:47.232059 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231866    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-host-var-lib-cni-bin\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.232059 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231894    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-host-run-multus-certs\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.232059 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231941    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-sys\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.232059 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.231967    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eaa7461d-b281-4e7f-86f0-4caebd6a396d-os-release\") pod \"multus-additional-cni-plugins-kqr58\" (UID: \"eaa7461d-b281-4e7f-86f0-4caebd6a396d\") " pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.232852 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232026    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-multus-cni-dir\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.232852 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232061    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-host-var-lib-kubelet\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.232852 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232093    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ptc8\" (UniqueName: \"kubernetes.io/projected/311e85d9-feb7-414a-9e8f-ca306874a6f3-kube-api-access-2ptc8\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.232852 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232121    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-run-openvswitch\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.232852 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232146    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/30222ae0-b5d2-440e-a799-e808706d4b84-ovnkube-config\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.232852 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eaa7461d-b281-4e7f-86f0-4caebd6a396d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kqr58\" (UID: \"eaa7461d-b281-4e7f-86f0-4caebd6a396d\") " pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.232852 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232210    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/311e85d9-feb7-414a-9e8f-ca306874a6f3-cni-binary-copy\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.232852 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232235    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6ed47e5e-bb49-4c04-a547-aadde61f5fdd-etc-selinux\") pod \"aws-ebs-csi-driver-node-lrpqw\" (UID: \"6ed47e5e-bb49-4c04-a547-aadde61f5fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw"
Jul 09 18:45:47.232852 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232261    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/30222ae0-b5d2-440e-a799-e808706d4b84-ovn-node-metrics-cert\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.232852 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232288    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-etc-sysctl-conf\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.232852 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232315    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cnts\" (UniqueName: \"kubernetes.io/projected/be0a5922-6e9a-4314-bb47-e68afc2cdc7b-kube-api-access-8cnts\") pod \"network-check-target-5rkc2\" (UID: \"be0a5922-6e9a-4314-bb47-e68afc2cdc7b\") " pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:45:47.232852 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232342    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fspmt\" (UniqueName: \"kubernetes.io/projected/409661cb-d599-4f25-a45b-58c69fd015f8-kube-api-access-fspmt\") pod \"network-metrics-daemon-c4kbs\" (UID: \"409661cb-d599-4f25-a45b-58c69fd015f8\") " pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:45:47.232852 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232373    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7c638eb0-3766-4e75-9a1e-5d22fdac873b-agent-certs\") pod \"konnectivity-agent-r5584\" (UID: \"7c638eb0-3766-4e75-9a1e-5d22fdac873b\") " pod="kube-system/konnectivity-agent-r5584"
Jul 09 18:45:47.232852 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232411    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fa63441b-d9d3-4572-be55-ce08ce5d3cbe-hosts-file\") pod \"node-resolver-9stx9\" (UID: \"fa63441b-d9d3-4572-be55-ce08ce5d3cbe\") " pod="openshift-dns/node-resolver-9stx9"
Jul 09 18:45:47.232852 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232437    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-var-lib-openvswitch\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.232852 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232463    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/30222ae0-b5d2-440e-a799-e808706d4b84-ovnkube-script-lib\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.233719 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232489    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-etc-systemd\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.233719 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232524    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-etc-tuned\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.233719 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232549    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c08f64a5-c9f2-4791-9cb0-0e3737d610cf-host\") pod \"node-ca-kcv9j\" (UID: \"c08f64a5-c9f2-4791-9cb0-0e3737d610cf\") " pod="openshift-image-registry/node-ca-kcv9j"
Jul 09 18:45:47.233719 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232576    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eaa7461d-b281-4e7f-86f0-4caebd6a396d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kqr58\" (UID: \"eaa7461d-b281-4e7f-86f0-4caebd6a396d\") " pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.233719 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232605    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6ed47e5e-bb49-4c04-a547-aadde61f5fdd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lrpqw\" (UID: \"6ed47e5e-bb49-4c04-a547-aadde61f5fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw"
Jul 09 18:45:47.233719 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232632    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6ed47e5e-bb49-4c04-a547-aadde61f5fdd-device-dir\") pod \"aws-ebs-csi-driver-node-lrpqw\" (UID: \"6ed47e5e-bb49-4c04-a547-aadde61f5fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw"
Jul 09 18:45:47.233719 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232659    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-multus-socket-dir-parent\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.233719 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232686    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-host-var-lib-cni-multus\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.233719 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232713    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzbwr\" (UniqueName: \"kubernetes.io/projected/fa63441b-d9d3-4572-be55-ce08ce5d3cbe-kube-api-access-zzbwr\") pod \"node-resolver-9stx9\" (UID: \"fa63441b-d9d3-4572-be55-ce08ce5d3cbe\") " pod="openshift-dns/node-resolver-9stx9"
Jul 09 18:45:47.233719 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232739    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-run-systemd\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.233719 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232769    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-node-log\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.233719 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232796    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-log-socket\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.233719 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232826    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-lib-modules\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.233719 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232853    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/311e85d9-feb7-414a-9e8f-ca306874a6f3-multus-daemon-config\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.233719 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232880    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/409661cb-d599-4f25-a45b-58c69fd015f8-metrics-certs\") pod \"network-metrics-daemon-c4kbs\" (UID: \"409661cb-d599-4f25-a45b-58c69fd015f8\") " pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:45:47.233719 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6shcr\" (UniqueName: \"kubernetes.io/projected/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-kube-api-access-6shcr\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.234573 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232958    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-host-run-netns\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.234573 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.232988    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cg72\" (UniqueName: \"kubernetes.io/projected/c31709d1-1d67-431a-b24b-0020555b58e3-kube-api-access-6cg72\") pod \"iptables-alerter-9tkmf\" (UID: \"c31709d1-1d67-431a-b24b-0020555b58e3\") " pod="openshift-network-operator/iptables-alerter-9tkmf"
Jul 09 18:45:47.234573 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.233020    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6ed47e5e-bb49-4c04-a547-aadde61f5fdd-socket-dir\") pod \"aws-ebs-csi-driver-node-lrpqw\" (UID: \"6ed47e5e-bb49-4c04-a547-aadde61f5fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw"
Jul 09 18:45:47.234573 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.233048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6ed47e5e-bb49-4c04-a547-aadde61f5fdd-sys-fs\") pod \"aws-ebs-csi-driver-node-lrpqw\" (UID: \"6ed47e5e-bb49-4c04-a547-aadde61f5fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw"
Jul 09 18:45:47.234573 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.233077    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa63441b-d9d3-4572-be55-ce08ce5d3cbe-tmp-dir\") pod \"node-resolver-9stx9\" (UID: \"fa63441b-d9d3-4572-be55-ce08ce5d3cbe\") " pod="openshift-dns/node-resolver-9stx9"
Jul 09 18:45:47.234573 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.233104    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-etc-openvswitch\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.234573 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.233132    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-tmp\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.234573 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.233161    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfmhm\" (UniqueName: \"kubernetes.io/projected/c08f64a5-c9f2-4791-9cb0-0e3737d610cf-kube-api-access-lfmhm\") pod \"node-ca-kcv9j\" (UID: \"c08f64a5-c9f2-4791-9cb0-0e3737d610cf\") " pod="openshift-image-registry/node-ca-kcv9j"
Jul 09 18:45:47.234573 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.233193    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd62q\" (UniqueName: \"kubernetes.io/projected/6ed47e5e-bb49-4c04-a547-aadde61f5fdd-kube-api-access-pd62q\") pod \"aws-ebs-csi-driver-node-lrpqw\" (UID: \"6ed47e5e-bb49-4c04-a547-aadde61f5fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw"
Jul 09 18:45:47.234573 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.233221    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-host-cni-bin\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.234573 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.233249    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.234573 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.233278    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-etc-sysconfig\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.234573 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.233306    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eaa7461d-b281-4e7f-86f0-4caebd6a396d-cni-binary-copy\") pod \"multus-additional-cni-plugins-kqr58\" (UID: \"eaa7461d-b281-4e7f-86f0-4caebd6a396d\") " pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.234573 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.233346    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-multus-conf-dir\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.234573 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.233374    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-systemd-units\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.234573 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.233401    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-host-run-ovn-kubernetes\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.235345 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.233431    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eaa7461d-b281-4e7f-86f0-4caebd6a396d-system-cni-dir\") pod \"multus-additional-cni-plugins-kqr58\" (UID: \"eaa7461d-b281-4e7f-86f0-4caebd6a396d\") " pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.235345 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.234077    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c31709d1-1d67-431a-b24b-0020555b58e3-host-slash\") pod \"iptables-alerter-9tkmf\" (UID: \"c31709d1-1d67-431a-b24b-0020555b58e3\") " pod="openshift-network-operator/iptables-alerter-9tkmf"
Jul 09 18:45:47.235345 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.234998    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 18:45:47.235748 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.235656    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7c638eb0-3766-4e75-9a1e-5d22fdac873b-konnectivity-ca\") pod \"konnectivity-agent-r5584\" (UID: \"7c638eb0-3766-4e75-9a1e-5d22fdac873b\") " pod="kube-system/konnectivity-agent-r5584"
Jul 09 18:45:47.235748 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.235662    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c31709d1-1d67-431a-b24b-0020555b58e3-iptables-alerter-script\") pod \"iptables-alerter-9tkmf\" (UID: \"c31709d1-1d67-431a-b24b-0020555b58e3\") " pod="openshift-network-operator/iptables-alerter-9tkmf"
Jul 09 18:45:47.240119 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.240031    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7c638eb0-3766-4e75-9a1e-5d22fdac873b-agent-certs\") pod \"konnectivity-agent-r5584\" (UID: \"7c638eb0-3766-4e75-9a1e-5d22fdac873b\") " pod="kube-system/konnectivity-agent-r5584"
Jul 09 18:45:47.245674 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.245640    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:45:47.252351 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.252259    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cg72\" (UniqueName: \"kubernetes.io/projected/c31709d1-1d67-431a-b24b-0020555b58e3-kube-api-access-6cg72\") pod \"iptables-alerter-9tkmf\" (UID: \"c31709d1-1d67-431a-b24b-0020555b58e3\") " pod="openshift-network-operator/iptables-alerter-9tkmf"
Jul 09 18:45:47.257266 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.257186    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-236.ec2.internal" event={"ID":"f3668d4575d5d0e1336d26672db23ccf","Type":"ContainerStarted","Data":"dd3467ee993c533397a00372193583c74ccf9a7cf1bd06fd8bd8546ba8cd14ae"}
Jul 09 18:45:47.259636 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.259577    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-236.ec2.internal" event={"ID":"809123b5f16ae02e29c4290d953f3218","Type":"ContainerStarted","Data":"3249d1e4b370196913dce44e01dbe21f6a1c0f7a847c9190b1187e4c657668de"}
Jul 09 18:45:47.334666 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.334625    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-host-run-k8s-cni-cncf-io\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.334897 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.334684    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-host-slash\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.334897 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.334694    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-host-run-k8s-cni-cncf-io\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.334897 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.334716    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-host-cni-netd\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.334897 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.334742    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/493326cf-6bd0-480f-b459-66089efc73c8-dbus\") pod \"global-pull-secret-syncer-8zclz\" (UID: \"493326cf-6bd0-480f-b459-66089efc73c8\") " pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:45:47.334897 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.334753    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-host-cni-netd\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.334897 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.334757    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-host-slash\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.334897 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.334766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-host\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.334897 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.334806    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-host\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.334897 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.334825    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c08f64a5-c9f2-4791-9cb0-0e3737d610cf-serviceca\") pod \"node-ca-kcv9j\" (UID: \"c08f64a5-c9f2-4791-9cb0-0e3737d610cf\") " pod="openshift-image-registry/node-ca-kcv9j"
Jul 09 18:45:47.334897 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.334868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-etc-kubernetes\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.335425 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.334917    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-etc-kubernetes\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.335425 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.334917    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/493326cf-6bd0-480f-b459-66089efc73c8-dbus\") pod \"global-pull-secret-syncer-8zclz\" (UID: \"493326cf-6bd0-480f-b459-66089efc73c8\") " pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:45:47.335425 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.334939    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-host-kubelet\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.335425 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.334968    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-host-run-netns\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.335425 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.334991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2mqr\" (UniqueName: \"kubernetes.io/projected/30222ae0-b5d2-440e-a799-e808706d4b84-kube-api-access-r2mqr\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.335425 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335014    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/493326cf-6bd0-480f-b459-66089efc73c8-kubelet-config\") pod \"global-pull-secret-syncer-8zclz\" (UID: \"493326cf-6bd0-480f-b459-66089efc73c8\") " pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:45:47.335425 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335038    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-etc-modprobe-d\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.335425 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335063    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-var-lib-kubelet\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.335425 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335090    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eaa7461d-b281-4e7f-86f0-4caebd6a396d-cnibin\") pod \"multus-additional-cni-plugins-kqr58\" (UID: \"eaa7461d-b281-4e7f-86f0-4caebd6a396d\") " pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.335425 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335111    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/493326cf-6bd0-480f-b459-66089efc73c8-kubelet-config\") pod \"global-pull-secret-syncer-8zclz\" (UID: \"493326cf-6bd0-480f-b459-66089efc73c8\") " pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:45:47.335425 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-cnibin\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.335425 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335152    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/493326cf-6bd0-480f-b459-66089efc73c8-original-pull-secret\") pod \"global-pull-secret-syncer-8zclz\" (UID: \"493326cf-6bd0-480f-b459-66089efc73c8\") " pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:45:47.335425 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335158    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-cnibin\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.335425 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eaa7461d-b281-4e7f-86f0-4caebd6a396d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kqr58\" (UID: \"eaa7461d-b281-4e7f-86f0-4caebd6a396d\") " pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.335425 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335204    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-host-run-netns\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.335425 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335209    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-run-ovn\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.335425 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335235    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/30222ae0-b5d2-440e-a799-e808706d4b84-env-overrides\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.336291 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335259    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-etc-sysctl-d\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.336291 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335278    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sgj8\" (UniqueName: \"kubernetes.io/projected/eaa7461d-b281-4e7f-86f0-4caebd6a396d-kube-api-access-6sgj8\") pod \"multus-additional-cni-plugins-kqr58\" (UID: \"eaa7461d-b281-4e7f-86f0-4caebd6a396d\") " pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.336291 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-system-cni-dir\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.336291 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335301    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-etc-modprobe-d\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.336291 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335313    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-host-var-lib-cni-bin\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.336291 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335331    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-host-run-multus-certs\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.336291 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335340    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c08f64a5-c9f2-4791-9cb0-0e3737d610cf-serviceca\") pod \"node-ca-kcv9j\" (UID: \"c08f64a5-c9f2-4791-9cb0-0e3737d610cf\") " pod="openshift-image-registry/node-ca-kcv9j"
Jul 09 18:45:47.336291 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335349    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-var-lib-kubelet\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.336291 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335354    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-sys\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.336291 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335062    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-host-kubelet\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.336291 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335399    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-sys\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.336291 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335490    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-host-var-lib-cni-bin\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.336291 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335513    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-host-run-multus-certs\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.336291 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335526    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eaa7461d-b281-4e7f-86f0-4caebd6a396d-os-release\") pod \"multus-additional-cni-plugins-kqr58\" (UID: \"eaa7461d-b281-4e7f-86f0-4caebd6a396d\") " pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.336291 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335539    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-system-cni-dir\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.336291 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335569    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-multus-cni-dir\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.336291 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335595    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-host-var-lib-kubelet\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.336291 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335623    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ptc8\" (UniqueName: \"kubernetes.io/projected/311e85d9-feb7-414a-9e8f-ca306874a6f3-kube-api-access-2ptc8\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.337265 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335650    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-run-openvswitch\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.337265 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335713    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/30222ae0-b5d2-440e-a799-e808706d4b84-ovnkube-config\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.337265 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335740    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eaa7461d-b281-4e7f-86f0-4caebd6a396d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kqr58\" (UID: \"eaa7461d-b281-4e7f-86f0-4caebd6a396d\") " pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.337265 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335808    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-multus-cni-dir\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.337265 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335847    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-host-var-lib-kubelet\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.337265 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335866    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/311e85d9-feb7-414a-9e8f-ca306874a6f3-cni-binary-copy\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.337265 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335892    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-etc-sysctl-d\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.337265 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:47.335945    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:45:47.337265 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.335991    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eaa7461d-b281-4e7f-86f0-4caebd6a396d-cnibin\") pod \"multus-additional-cni-plugins-kqr58\" (UID: \"eaa7461d-b281-4e7f-86f0-4caebd6a396d\") " pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.337265 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336027    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-run-openvswitch\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.337265 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:47.336040    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/493326cf-6bd0-480f-b459-66089efc73c8-original-pull-secret podName:493326cf-6bd0-480f-b459-66089efc73c8 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:47.836015262 +0000 UTC m=+3.045604481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/493326cf-6bd0-480f-b459-66089efc73c8-original-pull-secret") pod "global-pull-secret-syncer-8zclz" (UID: "493326cf-6bd0-480f-b459-66089efc73c8") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:45:47.337265 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336063    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6ed47e5e-bb49-4c04-a547-aadde61f5fdd-etc-selinux\") pod \"aws-ebs-csi-driver-node-lrpqw\" (UID: \"6ed47e5e-bb49-4c04-a547-aadde61f5fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw"
Jul 09 18:45:47.337265 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336087    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eaa7461d-b281-4e7f-86f0-4caebd6a396d-os-release\") pod \"multus-additional-cni-plugins-kqr58\" (UID: \"eaa7461d-b281-4e7f-86f0-4caebd6a396d\") " pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.337265 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336108    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eaa7461d-b281-4e7f-86f0-4caebd6a396d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kqr58\" (UID: \"eaa7461d-b281-4e7f-86f0-4caebd6a396d\") " pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.337265 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336095    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/30222ae0-b5d2-440e-a799-e808706d4b84-ovn-node-metrics-cert\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.337265 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336156    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-etc-sysctl-conf\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.337265 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336189    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cnts\" (UniqueName: \"kubernetes.io/projected/be0a5922-6e9a-4314-bb47-e68afc2cdc7b-kube-api-access-8cnts\") pod \"network-check-target-5rkc2\" (UID: \"be0a5922-6e9a-4314-bb47-e68afc2cdc7b\") " pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:45:47.338170 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336244    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fspmt\" (UniqueName: \"kubernetes.io/projected/409661cb-d599-4f25-a45b-58c69fd015f8-kube-api-access-fspmt\") pod \"network-metrics-daemon-c4kbs\" (UID: \"409661cb-d599-4f25-a45b-58c69fd015f8\") " pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:45:47.338170 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336284    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fa63441b-d9d3-4572-be55-ce08ce5d3cbe-hosts-file\") pod \"node-resolver-9stx9\" (UID: \"fa63441b-d9d3-4572-be55-ce08ce5d3cbe\") " pod="openshift-dns/node-resolver-9stx9"
Jul 09 18:45:47.338170 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336344    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-var-lib-openvswitch\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.338170 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336372    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/30222ae0-b5d2-440e-a799-e808706d4b84-ovnkube-script-lib\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.338170 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336387    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/30222ae0-b5d2-440e-a799-e808706d4b84-ovnkube-config\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.338170 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336402    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-etc-systemd\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.338170 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336373    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6ed47e5e-bb49-4c04-a547-aadde61f5fdd-etc-selinux\") pod \"aws-ebs-csi-driver-node-lrpqw\" (UID: \"6ed47e5e-bb49-4c04-a547-aadde61f5fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw"
Jul 09 18:45:47.338170 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336441    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-var-lib-openvswitch\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.338170 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336463    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-etc-tuned\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.338170 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336490    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c08f64a5-c9f2-4791-9cb0-0e3737d610cf-host\") pod \"node-ca-kcv9j\" (UID: \"c08f64a5-c9f2-4791-9cb0-0e3737d610cf\") " pod="openshift-image-registry/node-ca-kcv9j"
Jul 09 18:45:47.338170 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336493    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-etc-sysctl-conf\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.338170 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336493    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-etc-systemd\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.338170 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336586    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/311e85d9-feb7-414a-9e8f-ca306874a6f3-cni-binary-copy\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.338170 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336601    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/30222ae0-b5d2-440e-a799-e808706d4b84-env-overrides\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.338170 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336638    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eaa7461d-b281-4e7f-86f0-4caebd6a396d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kqr58\" (UID: \"eaa7461d-b281-4e7f-86f0-4caebd6a396d\") " pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.338170 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336664    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-run-ovn\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.338170 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336684    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eaa7461d-b281-4e7f-86f0-4caebd6a396d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kqr58\" (UID: \"eaa7461d-b281-4e7f-86f0-4caebd6a396d\") " pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.339057 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336707    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c08f64a5-c9f2-4791-9cb0-0e3737d610cf-host\") pod \"node-ca-kcv9j\" (UID: \"c08f64a5-c9f2-4791-9cb0-0e3737d610cf\") " pod="openshift-image-registry/node-ca-kcv9j"
Jul 09 18:45:47.339057 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6ed47e5e-bb49-4c04-a547-aadde61f5fdd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lrpqw\" (UID: \"6ed47e5e-bb49-4c04-a547-aadde61f5fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw"
Jul 09 18:45:47.339057 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336818    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6ed47e5e-bb49-4c04-a547-aadde61f5fdd-device-dir\") pod \"aws-ebs-csi-driver-node-lrpqw\" (UID: \"6ed47e5e-bb49-4c04-a547-aadde61f5fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw"
Jul 09 18:45:47.339057 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336838    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6ed47e5e-bb49-4c04-a547-aadde61f5fdd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lrpqw\" (UID: \"6ed47e5e-bb49-4c04-a547-aadde61f5fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw"
Jul 09 18:45:47.339057 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336887    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-multus-socket-dir-parent\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.339057 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336895    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fa63441b-d9d3-4572-be55-ce08ce5d3cbe-hosts-file\") pod \"node-resolver-9stx9\" (UID: \"fa63441b-d9d3-4572-be55-ce08ce5d3cbe\") " pod="openshift-dns/node-resolver-9stx9"
Jul 09 18:45:47.339057 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336894    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6ed47e5e-bb49-4c04-a547-aadde61f5fdd-device-dir\") pod \"aws-ebs-csi-driver-node-lrpqw\" (UID: \"6ed47e5e-bb49-4c04-a547-aadde61f5fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw"
Jul 09 18:45:47.339057 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336956    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-host-var-lib-cni-multus\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.339057 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.336983    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-multus-socket-dir-parent\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.339057 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337041    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzbwr\" (UniqueName: \"kubernetes.io/projected/fa63441b-d9d3-4572-be55-ce08ce5d3cbe-kube-api-access-zzbwr\") pod \"node-resolver-9stx9\" (UID: \"fa63441b-d9d3-4572-be55-ce08ce5d3cbe\") " pod="openshift-dns/node-resolver-9stx9"
Jul 09 18:45:47.339057 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337043    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/30222ae0-b5d2-440e-a799-e808706d4b84-ovnkube-script-lib\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.339057 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-run-systemd\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.339057 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337186    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-host-var-lib-cni-multus\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.339057 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337176    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eaa7461d-b281-4e7f-86f0-4caebd6a396d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kqr58\" (UID: \"eaa7461d-b281-4e7f-86f0-4caebd6a396d\") " pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.339057 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337231    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-node-log\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.339057 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337247    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-run-systemd\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.339057 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337340    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-node-log\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.339920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337377    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-log-socket\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.339920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337410    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-lib-modules\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.339920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/311e85d9-feb7-414a-9e8f-ca306874a6f3-multus-daemon-config\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.339920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337466    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-log-socket\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.339920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337469    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/409661cb-d599-4f25-a45b-58c69fd015f8-metrics-certs\") pod \"network-metrics-daemon-c4kbs\" (UID: \"409661cb-d599-4f25-a45b-58c69fd015f8\") " pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:45:47.339920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337504    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6shcr\" (UniqueName: \"kubernetes.io/projected/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-kube-api-access-6shcr\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.339920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337529    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-host-run-netns\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.339920 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:47.337546    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:45:47.339920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337547    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-lib-modules\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.339920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337599    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-host-run-netns\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.339920 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:47.337613    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/409661cb-d599-4f25-a45b-58c69fd015f8-metrics-certs podName:409661cb-d599-4f25-a45b-58c69fd015f8 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:47.83759652 +0000 UTC m=+3.047185734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/409661cb-d599-4f25-a45b-58c69fd015f8-metrics-certs") pod "network-metrics-daemon-c4kbs" (UID: "409661cb-d599-4f25-a45b-58c69fd015f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:45:47.339920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337554    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6ed47e5e-bb49-4c04-a547-aadde61f5fdd-socket-dir\") pod \"aws-ebs-csi-driver-node-lrpqw\" (UID: \"6ed47e5e-bb49-4c04-a547-aadde61f5fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw"
Jul 09 18:45:47.339920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337670    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6ed47e5e-bb49-4c04-a547-aadde61f5fdd-sys-fs\") pod \"aws-ebs-csi-driver-node-lrpqw\" (UID: \"6ed47e5e-bb49-4c04-a547-aadde61f5fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw"
Jul 09 18:45:47.339920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337701    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa63441b-d9d3-4572-be55-ce08ce5d3cbe-tmp-dir\") pod \"node-resolver-9stx9\" (UID: \"fa63441b-d9d3-4572-be55-ce08ce5d3cbe\") " pod="openshift-dns/node-resolver-9stx9"
Jul 09 18:45:47.339920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337721    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6ed47e5e-bb49-4c04-a547-aadde61f5fdd-socket-dir\") pod \"aws-ebs-csi-driver-node-lrpqw\" (UID: \"6ed47e5e-bb49-4c04-a547-aadde61f5fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw"
Jul 09 18:45:47.339920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337727    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-etc-openvswitch\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.339920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337761    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-tmp\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.340786 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337789    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfmhm\" (UniqueName: \"kubernetes.io/projected/c08f64a5-c9f2-4791-9cb0-0e3737d610cf-kube-api-access-lfmhm\") pod \"node-ca-kcv9j\" (UID: \"c08f64a5-c9f2-4791-9cb0-0e3737d610cf\") " pod="openshift-image-registry/node-ca-kcv9j"
Jul 09 18:45:47.340786 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337767    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-etc-openvswitch\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.340786 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337816    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6ed47e5e-bb49-4c04-a547-aadde61f5fdd-sys-fs\") pod \"aws-ebs-csi-driver-node-lrpqw\" (UID: \"6ed47e5e-bb49-4c04-a547-aadde61f5fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw"
Jul 09 18:45:47.340786 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337818    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd62q\" (UniqueName: \"kubernetes.io/projected/6ed47e5e-bb49-4c04-a547-aadde61f5fdd-kube-api-access-pd62q\") pod \"aws-ebs-csi-driver-node-lrpqw\" (UID: \"6ed47e5e-bb49-4c04-a547-aadde61f5fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw"
Jul 09 18:45:47.340786 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337884    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-host-cni-bin\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.340786 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337915    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.340786 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337959    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/311e85d9-feb7-414a-9e8f-ca306874a6f3-multus-daemon-config\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.340786 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.337963    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-etc-sysconfig\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.340786 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.338008    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-etc-sysconfig\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.340786 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.338011    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eaa7461d-b281-4e7f-86f0-4caebd6a396d-cni-binary-copy\") pod \"multus-additional-cni-plugins-kqr58\" (UID: \"eaa7461d-b281-4e7f-86f0-4caebd6a396d\") " pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.340786 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.338043    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-multus-conf-dir\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.340786 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.338068    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-systemd-units\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.340786 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.338110    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-host-run-ovn-kubernetes\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.340786 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.338141    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eaa7461d-b281-4e7f-86f0-4caebd6a396d-system-cni-dir\") pod \"multus-additional-cni-plugins-kqr58\" (UID: \"eaa7461d-b281-4e7f-86f0-4caebd6a396d\") " pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.340786 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.338165    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-hostroot\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.340786 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.338190    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6ed47e5e-bb49-4c04-a547-aadde61f5fdd-registration-dir\") pod \"aws-ebs-csi-driver-node-lrpqw\" (UID: \"6ed47e5e-bb49-4c04-a547-aadde61f5fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw"
Jul 09 18:45:47.340786 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.338214    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-etc-kubernetes\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.341664 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.338238    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-run\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.341664 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.338261    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-os-release\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.341664 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.338268    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa63441b-d9d3-4572-be55-ce08ce5d3cbe-tmp-dir\") pod \"node-resolver-9stx9\" (UID: \"fa63441b-d9d3-4572-be55-ce08ce5d3cbe\") " pod="openshift-dns/node-resolver-9stx9"
Jul 09 18:45:47.341664 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.338353    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-os-release\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.341664 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.338387    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-host-cni-bin\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.341664 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.338398    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-hostroot\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.341664 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.338438    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.341664 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.338454    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eaa7461d-b281-4e7f-86f0-4caebd6a396d-cni-binary-copy\") pod \"multus-additional-cni-plugins-kqr58\" (UID: \"eaa7461d-b281-4e7f-86f0-4caebd6a396d\") " pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.341664 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.338469    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6ed47e5e-bb49-4c04-a547-aadde61f5fdd-registration-dir\") pod \"aws-ebs-csi-driver-node-lrpqw\" (UID: \"6ed47e5e-bb49-4c04-a547-aadde61f5fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw"
Jul 09 18:45:47.341664 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.338484    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/311e85d9-feb7-414a-9e8f-ca306874a6f3-multus-conf-dir\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.341664 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.338515    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-run\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.341664 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.338522    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-etc-kubernetes\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.341664 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.338524    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-systemd-units\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.341664 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.338557    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30222ae0-b5d2-440e-a799-e808706d4b84-host-run-ovn-kubernetes\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.341664 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.338599    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eaa7461d-b281-4e7f-86f0-4caebd6a396d-system-cni-dir\") pod \"multus-additional-cni-plugins-kqr58\" (UID: \"eaa7461d-b281-4e7f-86f0-4caebd6a396d\") " pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.341664 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.340829    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-etc-tuned\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.343223 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.343196    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/30222ae0-b5d2-440e-a799-e808706d4b84-ovn-node-metrics-cert\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.344864 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.344834    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-tmp\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.349232 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:47.348865    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:45:47.349232 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:47.348889    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:45:47.349232 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:47.348904    2580 projected.go:196] Error preparing data for projected volume kube-api-access-8cnts for pod openshift-network-diagnostics/network-check-target-5rkc2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:45:47.349232 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:47.348978    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be0a5922-6e9a-4314-bb47-e68afc2cdc7b-kube-api-access-8cnts podName:be0a5922-6e9a-4314-bb47-e68afc2cdc7b nodeName:}" failed. No retries permitted until 2026-07-09 18:45:47.848942655 +0000 UTC m=+3.058531857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8cnts" (UniqueName: "kubernetes.io/projected/be0a5922-6e9a-4314-bb47-e68afc2cdc7b-kube-api-access-8cnts") pod "network-check-target-5rkc2" (UID: "be0a5922-6e9a-4314-bb47-e68afc2cdc7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:45:47.349232 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.349134    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2mqr\" (UniqueName: \"kubernetes.io/projected/30222ae0-b5d2-440e-a799-e808706d4b84-kube-api-access-r2mqr\") pod \"ovnkube-node-hps7x\" (UID: \"30222ae0-b5d2-440e-a799-e808706d4b84\") " pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.351507 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.351479    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd62q\" (UniqueName: \"kubernetes.io/projected/6ed47e5e-bb49-4c04-a547-aadde61f5fdd-kube-api-access-pd62q\") pod \"aws-ebs-csi-driver-node-lrpqw\" (UID: \"6ed47e5e-bb49-4c04-a547-aadde61f5fdd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw"
Jul 09 18:45:47.353403 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.353357    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ptc8\" (UniqueName: \"kubernetes.io/projected/311e85d9-feb7-414a-9e8f-ca306874a6f3-kube-api-access-2ptc8\") pod \"multus-lf5c6\" (UID: \"311e85d9-feb7-414a-9e8f-ca306874a6f3\") " pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.353501 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.353487    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfmhm\" (UniqueName: \"kubernetes.io/projected/c08f64a5-c9f2-4791-9cb0-0e3737d610cf-kube-api-access-lfmhm\") pod \"node-ca-kcv9j\" (UID: \"c08f64a5-c9f2-4791-9cb0-0e3737d610cf\") " pod="openshift-image-registry/node-ca-kcv9j"
Jul 09 18:45:47.353845 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.353812    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fspmt\" (UniqueName: \"kubernetes.io/projected/409661cb-d599-4f25-a45b-58c69fd015f8-kube-api-access-fspmt\") pod \"network-metrics-daemon-c4kbs\" (UID: \"409661cb-d599-4f25-a45b-58c69fd015f8\") " pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:45:47.354295 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.354129    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzbwr\" (UniqueName: \"kubernetes.io/projected/fa63441b-d9d3-4572-be55-ce08ce5d3cbe-kube-api-access-zzbwr\") pod \"node-resolver-9stx9\" (UID: \"fa63441b-d9d3-4572-be55-ce08ce5d3cbe\") " pod="openshift-dns/node-resolver-9stx9"
Jul 09 18:45:47.354295 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.354272    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sgj8\" (UniqueName: \"kubernetes.io/projected/eaa7461d-b281-4e7f-86f0-4caebd6a396d-kube-api-access-6sgj8\") pod \"multus-additional-cni-plugins-kqr58\" (UID: \"eaa7461d-b281-4e7f-86f0-4caebd6a396d\") " pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.356407 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.356382    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6shcr\" (UniqueName: \"kubernetes.io/projected/b9f08650-7dde-44e8-9bbd-05b594e8bd3f-kube-api-access-6shcr\") pod \"tuned-7lt7f\" (UID: \"b9f08650-7dde-44e8-9bbd-05b594e8bd3f\") " pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.441657 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.441620    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9tkmf"
Jul 09 18:45:47.454277 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.454240    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r5584"
Jul 09 18:45:47.455116 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:47.455085    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc31709d1_1d67_431a_b24b_0020555b58e3.slice/crio-71665d0ad9929d27ccd542f24e18fdf2f764d521657cbee5f354b81777e98cb8 WatchSource:0}: Error finding container 71665d0ad9929d27ccd542f24e18fdf2f764d521657cbee5f354b81777e98cb8: Status 404 returned error can't find the container with id 71665d0ad9929d27ccd542f24e18fdf2f764d521657cbee5f354b81777e98cb8
Jul 09 18:45:47.462398 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.462341    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw"
Jul 09 18:45:47.466044 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:47.466010    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c638eb0_3766_4e75_9a1e_5d22fdac873b.slice/crio-092fe3900640c19ec90e2394a147b81e6775d0f25576d841cdbc265cb453a35d WatchSource:0}: Error finding container 092fe3900640c19ec90e2394a147b81e6775d0f25576d841cdbc265cb453a35d: Status 404 returned error can't find the container with id 092fe3900640c19ec90e2394a147b81e6775d0f25576d841cdbc265cb453a35d
Jul 09 18:45:47.469871 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.469672    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kcv9j"
Jul 09 18:45:47.473984 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:47.473957    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ed47e5e_bb49_4c04_a547_aadde61f5fdd.slice/crio-9f6f6ba5e9fe19c96a69780937c18c980bb87b66d351ce9af34c098a4083b5d0 WatchSource:0}: Error finding container 9f6f6ba5e9fe19c96a69780937c18c980bb87b66d351ce9af34c098a4083b5d0: Status 404 returned error can't find the container with id 9f6f6ba5e9fe19c96a69780937c18c980bb87b66d351ce9af34c098a4083b5d0
Jul 09 18:45:47.479449 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.479425    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kqr58"
Jul 09 18:45:47.479798 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:47.479772    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc08f64a5_c9f2_4791_9cb0_0e3737d610cf.slice/crio-a794773f1a28ba81178fa03b2df5d4ab8489e8f97c02f8dd2fcfeea198165f25 WatchSource:0}: Error finding container a794773f1a28ba81178fa03b2df5d4ab8489e8f97c02f8dd2fcfeea198165f25: Status 404 returned error can't find the container with id a794773f1a28ba81178fa03b2df5d4ab8489e8f97c02f8dd2fcfeea198165f25
Jul 09 18:45:47.489145 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.489122    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lf5c6"
Jul 09 18:45:47.491512 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:47.491486    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaa7461d_b281_4e7f_86f0_4caebd6a396d.slice/crio-13e57c03f654a0cb87da74408a021bec9cee6d14c045a9cbf7d92ddfc52dc302 WatchSource:0}: Error finding container 13e57c03f654a0cb87da74408a021bec9cee6d14c045a9cbf7d92ddfc52dc302: Status 404 returned error can't find the container with id 13e57c03f654a0cb87da74408a021bec9cee6d14c045a9cbf7d92ddfc52dc302
Jul 09 18:45:47.498015 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.497994    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9stx9"
Jul 09 18:45:47.499255 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:47.499228    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod311e85d9_feb7_414a_9e8f_ca306874a6f3.slice/crio-744a88909a18a209ba863536323f0fcc2f3b702716f6ea11b85b74233898e166 WatchSource:0}: Error finding container 744a88909a18a209ba863536323f0fcc2f3b702716f6ea11b85b74233898e166: Status 404 returned error can't find the container with id 744a88909a18a209ba863536323f0fcc2f3b702716f6ea11b85b74233898e166
Jul 09 18:45:47.506192 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.506170    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:45:47.508922 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:47.508892    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa63441b_d9d3_4572_be55_ce08ce5d3cbe.slice/crio-cc301d2efc224baaaee266c6d5bd4d63ba3559f5b7a291521f411bf76252c8e3 WatchSource:0}: Error finding container cc301d2efc224baaaee266c6d5bd4d63ba3559f5b7a291521f411bf76252c8e3: Status 404 returned error can't find the container with id cc301d2efc224baaaee266c6d5bd4d63ba3559f5b7a291521f411bf76252c8e3
Jul 09 18:45:47.512800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.512652    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7lt7f"
Jul 09 18:45:47.515930 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:47.515881    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30222ae0_b5d2_440e_a799_e808706d4b84.slice/crio-047f7a3231cb8897cc52f151d5822da17c22776d69b55402d36607cf03e23a7c WatchSource:0}: Error finding container 047f7a3231cb8897cc52f151d5822da17c22776d69b55402d36607cf03e23a7c: Status 404 returned error can't find the container with id 047f7a3231cb8897cc52f151d5822da17c22776d69b55402d36607cf03e23a7c
Jul 09 18:45:47.527455 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:45:47.527427    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9f08650_7dde_44e8_9bbd_05b594e8bd3f.slice/crio-921d3d4698f5395ca9fc8efb76e74c9b6c18ac9afa2dac3d5f1f5bcaf2f072e6 WatchSource:0}: Error finding container 921d3d4698f5395ca9fc8efb76e74c9b6c18ac9afa2dac3d5f1f5bcaf2f072e6: Status 404 returned error can't find the container with id 921d3d4698f5395ca9fc8efb76e74c9b6c18ac9afa2dac3d5f1f5bcaf2f072e6
Jul 09 18:45:47.843234 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.843195    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/493326cf-6bd0-480f-b459-66089efc73c8-original-pull-secret\") pod \"global-pull-secret-syncer-8zclz\" (UID: \"493326cf-6bd0-480f-b459-66089efc73c8\") " pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:45:47.843438 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.843277    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/409661cb-d599-4f25-a45b-58c69fd015f8-metrics-certs\") pod \"network-metrics-daemon-c4kbs\" (UID: \"409661cb-d599-4f25-a45b-58c69fd015f8\") " pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:45:47.843438 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:47.843377    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:45:47.843438 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:47.843390    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:45:47.843607 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:47.843461    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/409661cb-d599-4f25-a45b-58c69fd015f8-metrics-certs podName:409661cb-d599-4f25-a45b-58c69fd015f8 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:48.843442215 +0000 UTC m=+4.053031424 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/409661cb-d599-4f25-a45b-58c69fd015f8-metrics-certs") pod "network-metrics-daemon-c4kbs" (UID: "409661cb-d599-4f25-a45b-58c69fd015f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:45:47.843607 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:47.843487    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/493326cf-6bd0-480f-b459-66089efc73c8-original-pull-secret podName:493326cf-6bd0-480f-b459-66089efc73c8 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:48.843474484 +0000 UTC m=+4.053063697 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/493326cf-6bd0-480f-b459-66089efc73c8-original-pull-secret") pod "global-pull-secret-syncer-8zclz" (UID: "493326cf-6bd0-480f-b459-66089efc73c8") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:45:47.943671 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:47.943629    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cnts\" (UniqueName: \"kubernetes.io/projected/be0a5922-6e9a-4314-bb47-e68afc2cdc7b-kube-api-access-8cnts\") pod \"network-check-target-5rkc2\" (UID: \"be0a5922-6e9a-4314-bb47-e68afc2cdc7b\") " pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:45:47.943895 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:47.943876    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:45:47.943967 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:47.943899    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:45:47.943967 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:47.943912    2580 projected.go:196] Error preparing data for projected volume kube-api-access-8cnts for pod openshift-network-diagnostics/network-check-target-5rkc2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:45:47.944086 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:47.943974    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be0a5922-6e9a-4314-bb47-e68afc2cdc7b-kube-api-access-8cnts podName:be0a5922-6e9a-4314-bb47-e68afc2cdc7b nodeName:}" failed. No retries permitted until 2026-07-09 18:45:48.943958949 +0000 UTC m=+4.153548147 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8cnts" (UniqueName: "kubernetes.io/projected/be0a5922-6e9a-4314-bb47-e68afc2cdc7b-kube-api-access-8cnts") pod "network-check-target-5rkc2" (UID: "be0a5922-6e9a-4314-bb47-e68afc2cdc7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:45:48.170902 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:48.170750    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 18:40:47 +0000 UTC" deadline="2027-12-11 00:25:28.696602597 +0000 UTC"
Jul 09 18:45:48.170902 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:48.170826    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12461h39m40.525781158s"
Jul 09 18:45:48.286429 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:48.286380    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7lt7f" event={"ID":"b9f08650-7dde-44e8-9bbd-05b594e8bd3f","Type":"ContainerStarted","Data":"921d3d4698f5395ca9fc8efb76e74c9b6c18ac9afa2dac3d5f1f5bcaf2f072e6"}
Jul 09 18:45:48.288149 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:48.288119    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hps7x" event={"ID":"30222ae0-b5d2-440e-a799-e808706d4b84","Type":"ContainerStarted","Data":"047f7a3231cb8897cc52f151d5822da17c22776d69b55402d36607cf03e23a7c"}
Jul 09 18:45:48.291899 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:48.291839    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9stx9" event={"ID":"fa63441b-d9d3-4572-be55-ce08ce5d3cbe","Type":"ContainerStarted","Data":"cc301d2efc224baaaee266c6d5bd4d63ba3559f5b7a291521f411bf76252c8e3"}
Jul 09 18:45:48.293635 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:48.293513    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lf5c6" event={"ID":"311e85d9-feb7-414a-9e8f-ca306874a6f3","Type":"ContainerStarted","Data":"744a88909a18a209ba863536323f0fcc2f3b702716f6ea11b85b74233898e166"}
Jul 09 18:45:48.294907 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:48.294879    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kcv9j" event={"ID":"c08f64a5-c9f2-4791-9cb0-0e3737d610cf","Type":"ContainerStarted","Data":"a794773f1a28ba81178fa03b2df5d4ab8489e8f97c02f8dd2fcfeea198165f25"}
Jul 09 18:45:48.296873 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:48.296832    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw" event={"ID":"6ed47e5e-bb49-4c04-a547-aadde61f5fdd","Type":"ContainerStarted","Data":"9f6f6ba5e9fe19c96a69780937c18c980bb87b66d351ce9af34c098a4083b5d0"}
Jul 09 18:45:48.299459 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:48.299431    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kqr58" event={"ID":"eaa7461d-b281-4e7f-86f0-4caebd6a396d","Type":"ContainerStarted","Data":"13e57c03f654a0cb87da74408a021bec9cee6d14c045a9cbf7d92ddfc52dc302"}
Jul 09 18:45:48.301896 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:48.301870    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r5584" event={"ID":"7c638eb0-3766-4e75-9a1e-5d22fdac873b","Type":"ContainerStarted","Data":"092fe3900640c19ec90e2394a147b81e6775d0f25576d841cdbc265cb453a35d"}
Jul 09 18:45:48.304727 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:48.304663    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9tkmf" event={"ID":"c31709d1-1d67-431a-b24b-0020555b58e3","Type":"ContainerStarted","Data":"71665d0ad9929d27ccd542f24e18fdf2f764d521657cbee5f354b81777e98cb8"}
Jul 09 18:45:48.851809 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:48.851765    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/409661cb-d599-4f25-a45b-58c69fd015f8-metrics-certs\") pod \"network-metrics-daemon-c4kbs\" (UID: \"409661cb-d599-4f25-a45b-58c69fd015f8\") " pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:45:48.852031 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:48.851846    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/493326cf-6bd0-480f-b459-66089efc73c8-original-pull-secret\") pod \"global-pull-secret-syncer-8zclz\" (UID: \"493326cf-6bd0-480f-b459-66089efc73c8\") " pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:45:48.852114 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:48.852060    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:45:48.852174 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:48.852135    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/493326cf-6bd0-480f-b459-66089efc73c8-original-pull-secret podName:493326cf-6bd0-480f-b459-66089efc73c8 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:50.852106422 +0000 UTC m=+6.061695633 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/493326cf-6bd0-480f-b459-66089efc73c8-original-pull-secret") pod "global-pull-secret-syncer-8zclz" (UID: "493326cf-6bd0-480f-b459-66089efc73c8") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:45:48.852245 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:48.852213    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:45:48.852303 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:48.852253    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/409661cb-d599-4f25-a45b-58c69fd015f8-metrics-certs podName:409661cb-d599-4f25-a45b-58c69fd015f8 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:50.852239283 +0000 UTC m=+6.061828481 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/409661cb-d599-4f25-a45b-58c69fd015f8-metrics-certs") pod "network-metrics-daemon-c4kbs" (UID: "409661cb-d599-4f25-a45b-58c69fd015f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:45:48.953769 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:48.953301    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cnts\" (UniqueName: \"kubernetes.io/projected/be0a5922-6e9a-4314-bb47-e68afc2cdc7b-kube-api-access-8cnts\") pod \"network-check-target-5rkc2\" (UID: \"be0a5922-6e9a-4314-bb47-e68afc2cdc7b\") " pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:45:48.953769 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:48.953589    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:45:48.953769 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:48.953621    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:45:48.953769 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:48.953636    2580 projected.go:196] Error preparing data for projected volume kube-api-access-8cnts for pod openshift-network-diagnostics/network-check-target-5rkc2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:45:48.953769 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:48.953746    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be0a5922-6e9a-4314-bb47-e68afc2cdc7b-kube-api-access-8cnts podName:be0a5922-6e9a-4314-bb47-e68afc2cdc7b nodeName:}" failed. No retries permitted until 2026-07-09 18:45:50.953723337 +0000 UTC m=+6.163312561 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8cnts" (UniqueName: "kubernetes.io/projected/be0a5922-6e9a-4314-bb47-e68afc2cdc7b-kube-api-access-8cnts") pod "network-check-target-5rkc2" (UID: "be0a5922-6e9a-4314-bb47-e68afc2cdc7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:45:49.171352 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:49.171241    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 18:40:47 +0000 UTC" deadline="2028-01-06 01:16:55.993067289 +0000 UTC"
Jul 09 18:45:49.171352 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:49.171285    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13086h31m6.82178755s"
Jul 09 18:45:49.226610 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:49.226577    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:45:49.248836 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:49.248797    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:45:49.249043 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:49.248957    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zclz" podUID="493326cf-6bd0-480f-b459-66089efc73c8"
Jul 09 18:45:49.249661 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:49.249338    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:45:49.249661 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:49.249439    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rkc2" podUID="be0a5922-6e9a-4314-bb47-e68afc2cdc7b"
Jul 09 18:45:49.249661 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:49.249508    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:45:49.249661 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:49.249595    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kbs" podUID="409661cb-d599-4f25-a45b-58c69fd015f8"
Jul 09 18:45:50.328715 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:50.328653    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-236.ec2.internal" event={"ID":"f3668d4575d5d0e1336d26672db23ccf","Type":"ContainerStarted","Data":"c94e7b22e7ca24392516c913187ecb333078e583ab2bdeab736fff14e5f9aa91"}
Jul 09 18:45:50.338750 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:50.338716    2580 generic.go:356] "Generic (PLEG): container finished" podID="809123b5f16ae02e29c4290d953f3218" containerID="d30b702c612eb6a0365b156eef4bf2205ca2be571b5d23b9e21975ad67cbb833" exitCode=0
Jul 09 18:45:50.338931 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:50.338767    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-236.ec2.internal" event={"ID":"809123b5f16ae02e29c4290d953f3218","Type":"ContainerDied","Data":"d30b702c612eb6a0365b156eef4bf2205ca2be571b5d23b9e21975ad67cbb833"}
Jul 09 18:45:50.370489 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:50.369174    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-236.ec2.internal" podStartSLOduration=4.369151301 podStartE2EDuration="4.369151301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:45:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:45:50.347404042 +0000 UTC m=+5.556993267" watchObservedRunningTime="2026-07-09 18:45:50.369151301 +0000 UTC m=+5.578740526"
Jul 09 18:45:50.872780 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:50.872740    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/493326cf-6bd0-480f-b459-66089efc73c8-original-pull-secret\") pod \"global-pull-secret-syncer-8zclz\" (UID: \"493326cf-6bd0-480f-b459-66089efc73c8\") " pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:45:50.873026 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:50.872828    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/409661cb-d599-4f25-a45b-58c69fd015f8-metrics-certs\") pod \"network-metrics-daemon-c4kbs\" (UID: \"409661cb-d599-4f25-a45b-58c69fd015f8\") " pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:45:50.873026 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:50.872982    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:45:50.873161 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:50.873050    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/409661cb-d599-4f25-a45b-58c69fd015f8-metrics-certs podName:409661cb-d599-4f25-a45b-58c69fd015f8 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:54.873030517 +0000 UTC m=+10.082619730 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/409661cb-d599-4f25-a45b-58c69fd015f8-metrics-certs") pod "network-metrics-daemon-c4kbs" (UID: "409661cb-d599-4f25-a45b-58c69fd015f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:45:50.873503 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:50.873485    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:45:50.873561 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:50.873546    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/493326cf-6bd0-480f-b459-66089efc73c8-original-pull-secret podName:493326cf-6bd0-480f-b459-66089efc73c8 nodeName:}" failed. No retries permitted until 2026-07-09 18:45:54.873529266 +0000 UTC m=+10.083118471 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/493326cf-6bd0-480f-b459-66089efc73c8-original-pull-secret") pod "global-pull-secret-syncer-8zclz" (UID: "493326cf-6bd0-480f-b459-66089efc73c8") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:45:50.974273 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:50.974233    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cnts\" (UniqueName: \"kubernetes.io/projected/be0a5922-6e9a-4314-bb47-e68afc2cdc7b-kube-api-access-8cnts\") pod \"network-check-target-5rkc2\" (UID: \"be0a5922-6e9a-4314-bb47-e68afc2cdc7b\") " pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:45:50.974625 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:50.974603    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:45:50.974741 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:50.974633    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:45:50.974741 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:50.974647    2580 projected.go:196] Error preparing data for projected volume kube-api-access-8cnts for pod openshift-network-diagnostics/network-check-target-5rkc2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:45:50.974741 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:50.974711    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be0a5922-6e9a-4314-bb47-e68afc2cdc7b-kube-api-access-8cnts podName:be0a5922-6e9a-4314-bb47-e68afc2cdc7b nodeName:}" failed. No retries permitted until 2026-07-09 18:45:54.974691669 +0000 UTC m=+10.184280883 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8cnts" (UniqueName: "kubernetes.io/projected/be0a5922-6e9a-4314-bb47-e68afc2cdc7b-kube-api-access-8cnts") pod "network-check-target-5rkc2" (UID: "be0a5922-6e9a-4314-bb47-e68afc2cdc7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:45:51.248037 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:51.247993    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:45:51.248259 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:51.248142    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rkc2" podUID="be0a5922-6e9a-4314-bb47-e68afc2cdc7b"
Jul 09 18:45:51.248709 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:51.247999    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:45:51.248709 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:51.248523    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kbs" podUID="409661cb-d599-4f25-a45b-58c69fd015f8"
Jul 09 18:45:51.248709 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:51.248540    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:45:51.248709 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:51.248636    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zclz" podUID="493326cf-6bd0-480f-b459-66089efc73c8"
Jul 09 18:45:53.247373 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:53.247327    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:45:53.247824 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:53.247457    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rkc2" podUID="be0a5922-6e9a-4314-bb47-e68afc2cdc7b"
Jul 09 18:45:53.247824 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:53.247537    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:45:53.247824 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:53.247637    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kbs" podUID="409661cb-d599-4f25-a45b-58c69fd015f8"
Jul 09 18:45:53.247824 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:53.247687    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:45:53.247824 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:53.247748    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zclz" podUID="493326cf-6bd0-480f-b459-66089efc73c8"
Jul 09 18:45:54.909581 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:54.909546    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/409661cb-d599-4f25-a45b-58c69fd015f8-metrics-certs\") pod \"network-metrics-daemon-c4kbs\" (UID: \"409661cb-d599-4f25-a45b-58c69fd015f8\") " pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:45:54.910073 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:54.909619    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/493326cf-6bd0-480f-b459-66089efc73c8-original-pull-secret\") pod \"global-pull-secret-syncer-8zclz\" (UID: \"493326cf-6bd0-480f-b459-66089efc73c8\") " pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:45:54.910073 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:54.909747    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:45:54.910073 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:54.909809    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/493326cf-6bd0-480f-b459-66089efc73c8-original-pull-secret podName:493326cf-6bd0-480f-b459-66089efc73c8 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:02.909789466 +0000 UTC m=+18.119378668 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/493326cf-6bd0-480f-b459-66089efc73c8-original-pull-secret") pod "global-pull-secret-syncer-8zclz" (UID: "493326cf-6bd0-480f-b459-66089efc73c8") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:45:54.910246 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:54.910198    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:45:54.910246 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:54.910246    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/409661cb-d599-4f25-a45b-58c69fd015f8-metrics-certs podName:409661cb-d599-4f25-a45b-58c69fd015f8 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:02.91023042 +0000 UTC m=+18.119819625 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/409661cb-d599-4f25-a45b-58c69fd015f8-metrics-certs") pod "network-metrics-daemon-c4kbs" (UID: "409661cb-d599-4f25-a45b-58c69fd015f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:45:55.010613 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:55.010572    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cnts\" (UniqueName: \"kubernetes.io/projected/be0a5922-6e9a-4314-bb47-e68afc2cdc7b-kube-api-access-8cnts\") pod \"network-check-target-5rkc2\" (UID: \"be0a5922-6e9a-4314-bb47-e68afc2cdc7b\") " pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:45:55.010762 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:55.010709    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:45:55.010762 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:55.010732    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:45:55.010762 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:55.010747    2580 projected.go:196] Error preparing data for projected volume kube-api-access-8cnts for pod openshift-network-diagnostics/network-check-target-5rkc2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:45:55.010945 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:55.010796    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be0a5922-6e9a-4314-bb47-e68afc2cdc7b-kube-api-access-8cnts podName:be0a5922-6e9a-4314-bb47-e68afc2cdc7b nodeName:}" failed. No retries permitted until 2026-07-09 18:46:03.010782362 +0000 UTC m=+18.220371563 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8cnts" (UniqueName: "kubernetes.io/projected/be0a5922-6e9a-4314-bb47-e68afc2cdc7b-kube-api-access-8cnts") pod "network-check-target-5rkc2" (UID: "be0a5922-6e9a-4314-bb47-e68afc2cdc7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:45:55.248167 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:55.248135    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:45:55.248367 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:55.248240    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rkc2" podUID="be0a5922-6e9a-4314-bb47-e68afc2cdc7b"
Jul 09 18:45:55.248367 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:55.248256    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:45:55.248471 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:55.248382    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zclz" podUID="493326cf-6bd0-480f-b459-66089efc73c8"
Jul 09 18:45:55.248471 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:55.248433    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:45:55.248564 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:55.248510    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kbs" podUID="409661cb-d599-4f25-a45b-58c69fd015f8"
Jul 09 18:45:57.247445 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:57.247076    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:45:57.247445 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:57.247196    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rkc2" podUID="be0a5922-6e9a-4314-bb47-e68afc2cdc7b"
Jul 09 18:45:57.247445 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:57.247383    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:45:57.247994 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:57.247564    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kbs" podUID="409661cb-d599-4f25-a45b-58c69fd015f8"
Jul 09 18:45:57.247994 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:57.247635    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:45:57.247994 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:57.247742    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zclz" podUID="493326cf-6bd0-480f-b459-66089efc73c8"
Jul 09 18:45:59.247233 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:59.246927    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:45:59.247754 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:59.247237    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rkc2" podUID="be0a5922-6e9a-4314-bb47-e68afc2cdc7b"
Jul 09 18:45:59.247754 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:59.246969    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:45:59.247754 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:59.247351    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kbs" podUID="409661cb-d599-4f25-a45b-58c69fd015f8"
Jul 09 18:45:59.247754 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:59.246928    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:45:59.247754 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:45:59.247429    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zclz" podUID="493326cf-6bd0-480f-b459-66089efc73c8"
Jul 09 18:45:59.362895 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:59.362858    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-236.ec2.internal" event={"ID":"809123b5f16ae02e29c4290d953f3218","Type":"ContainerStarted","Data":"d10e262abae38bd51fbe5db1bd6df81093ebd893a37335d072e0110977d0f5d3"}
Jul 09 18:45:59.365539 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:59.365488    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7lt7f" event={"ID":"b9f08650-7dde-44e8-9bbd-05b594e8bd3f","Type":"ContainerStarted","Data":"b5f728f7c681cb542214b135e260a63f7ff6138b191376bcdf073f9ba58d9e3c"}
Jul 09 18:45:59.367857 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:59.367190    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9stx9" event={"ID":"fa63441b-d9d3-4572-be55-ce08ce5d3cbe","Type":"ContainerStarted","Data":"f47ca930cc4ab701c600d1a7119f55664b6abfe124bddd632ee12f0f39e2b04c"}
Jul 09 18:45:59.369556 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:59.369228    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kcv9j" event={"ID":"c08f64a5-c9f2-4791-9cb0-0e3737d610cf","Type":"ContainerStarted","Data":"152b0adc70adce3f526ae0b3cf3ebae2ecb457653dc33cc1816eed7d085e9b34"}
Jul 09 18:45:59.370844 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:59.370804    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw" event={"ID":"6ed47e5e-bb49-4c04-a547-aadde61f5fdd","Type":"ContainerStarted","Data":"2030b5d9e8a0097d24b4ea86842b66da7a1fac30a22a1fbac42ebf92dec1f5d7"}
Jul 09 18:45:59.372540 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:59.372515    2580 generic.go:356] "Generic (PLEG): container finished" podID="eaa7461d-b281-4e7f-86f0-4caebd6a396d" containerID="6522ea200ca31ba22f74657b343b3d251840a3a09f40deaeb89fccade6f45c66" exitCode=0
Jul 09 18:45:59.372627 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:59.372607    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kqr58" event={"ID":"eaa7461d-b281-4e7f-86f0-4caebd6a396d","Type":"ContainerDied","Data":"6522ea200ca31ba22f74657b343b3d251840a3a09f40deaeb89fccade6f45c66"}
Jul 09 18:45:59.374286 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:59.374161    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r5584" event={"ID":"7c638eb0-3766-4e75-9a1e-5d22fdac873b","Type":"ContainerStarted","Data":"dda1746ae06e8da279152ba3cf7ba81dc78a5dd8675f1dc617a761c29f9b4b09"}
Jul 09 18:45:59.384391 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:59.384350    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-236.ec2.internal" podStartSLOduration=13.384337636 podStartE2EDuration="13.384337636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:45:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:45:59.384185371 +0000 UTC m=+14.593774589" watchObservedRunningTime="2026-07-09 18:45:59.384337636 +0000 UTC m=+14.593926854"
Jul 09 18:45:59.401062 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:59.401013    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r5584" podStartSLOduration=3.448131491 podStartE2EDuration="14.400995517s" totalImagesPullingTime="10.952864026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:45:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:45:59.400796538 +0000 UTC m=+14.610385757" watchObservedRunningTime="2026-07-09 18:45:59.400995517 +0000 UTC m=+14.610584735"
Jul 09 18:45:59.439663 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:59.439619    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9stx9" podStartSLOduration=2.539449181 podStartE2EDuration="13.439600702s" totalImagesPullingTime="10.900151521s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:45:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:45:59.439282488 +0000 UTC m=+14.648871707" watchObservedRunningTime="2026-07-09 18:45:59.439600702 +0000 UTC m=+14.649189921"
Jul 09 18:45:59.454971 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:59.454913    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kcv9j" podStartSLOduration=2.525375705 podStartE2EDuration="13.4548938s" totalImagesPullingTime="10.929518095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:45:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:45:59.454753759 +0000 UTC m=+14.664342980" watchObservedRunningTime="2026-07-09 18:45:59.4548938 +0000 UTC m=+14.664483021"
Jul 09 18:45:59.472127 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:45:59.472067    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7lt7f" podStartSLOduration=2.382608736 podStartE2EDuration="13.47205548s" totalImagesPullingTime="11.089446744s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:45:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:45:59.471409932 +0000 UTC m=+14.680999149" watchObservedRunningTime="2026-07-09 18:45:59.47205548 +0000 UTC m=+14.681644700"
Jul 09 18:46:00.378191 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:00.378149    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9tkmf" event={"ID":"c31709d1-1d67-431a-b24b-0020555b58e3","Type":"ContainerStarted","Data":"c0edd2dce8a78f7237de99978e2e977e25ddf54b468a1e68c9f5161d810b82e4"}
Jul 09 18:46:00.396742 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:00.396669    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9tkmf" podStartSLOduration=4.442759119 podStartE2EDuration="15.396652219s" totalImagesPullingTime="10.9538931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:45:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:00.396278263 +0000 UTC m=+15.605867482" watchObservedRunningTime="2026-07-09 18:46:00.396652219 +0000 UTC m=+15.606241438"
Jul 09 18:46:01.247161 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:01.247127    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:46:01.247344 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:01.247197    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:46:01.247344 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:01.247213    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:46:01.247344 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:01.247326    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zclz" podUID="493326cf-6bd0-480f-b459-66089efc73c8"
Jul 09 18:46:01.247507 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:01.247355    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rkc2" podUID="be0a5922-6e9a-4314-bb47-e68afc2cdc7b"
Jul 09 18:46:01.247507 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:01.247434    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kbs" podUID="409661cb-d599-4f25-a45b-58c69fd015f8"
Jul 09 18:46:01.272180 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:01.272147    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r5584"
Jul 09 18:46:01.272781 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:01.272757    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r5584"
Jul 09 18:46:02.196084 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:02.196058    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9stx9_fa63441b-d9d3-4572-be55-ce08ce5d3cbe/dns-node-resolver/0.log"
Jul 09 18:46:02.381609 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:02.381577    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 18:46:02.973204 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:02.973156    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/493326cf-6bd0-480f-b459-66089efc73c8-original-pull-secret\") pod \"global-pull-secret-syncer-8zclz\" (UID: \"493326cf-6bd0-480f-b459-66089efc73c8\") " pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:46:02.973432 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:02.973251    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/409661cb-d599-4f25-a45b-58c69fd015f8-metrics-certs\") pod \"network-metrics-daemon-c4kbs\" (UID: \"409661cb-d599-4f25-a45b-58c69fd015f8\") " pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:46:02.973432 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:02.973345    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:46:02.973432 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:02.973429    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/493326cf-6bd0-480f-b459-66089efc73c8-original-pull-secret podName:493326cf-6bd0-480f-b459-66089efc73c8 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:18.973413519 +0000 UTC m=+34.183002719 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/493326cf-6bd0-480f-b459-66089efc73c8-original-pull-secret") pod "global-pull-secret-syncer-8zclz" (UID: "493326cf-6bd0-480f-b459-66089efc73c8") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:46:02.973598 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:02.973350    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:46:02.973598 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:02.973495    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/409661cb-d599-4f25-a45b-58c69fd015f8-metrics-certs podName:409661cb-d599-4f25-a45b-58c69fd015f8 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:18.973481201 +0000 UTC m=+34.183070414 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/409661cb-d599-4f25-a45b-58c69fd015f8-metrics-certs") pod "network-metrics-daemon-c4kbs" (UID: "409661cb-d599-4f25-a45b-58c69fd015f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:46:03.074435 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:03.074395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cnts\" (UniqueName: \"kubernetes.io/projected/be0a5922-6e9a-4314-bb47-e68afc2cdc7b-kube-api-access-8cnts\") pod \"network-check-target-5rkc2\" (UID: \"be0a5922-6e9a-4314-bb47-e68afc2cdc7b\") " pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:46:03.074623 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:03.074585    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:46:03.074623 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:03.074615    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:46:03.074709 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:03.074630    2580 projected.go:196] Error preparing data for projected volume kube-api-access-8cnts for pod openshift-network-diagnostics/network-check-target-5rkc2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:46:03.074709 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:03.074688    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be0a5922-6e9a-4314-bb47-e68afc2cdc7b-kube-api-access-8cnts podName:be0a5922-6e9a-4314-bb47-e68afc2cdc7b nodeName:}" failed. No retries permitted until 2026-07-09 18:46:19.074673096 +0000 UTC m=+34.284262292 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8cnts" (UniqueName: "kubernetes.io/projected/be0a5922-6e9a-4314-bb47-e68afc2cdc7b-kube-api-access-8cnts") pod "network-check-target-5rkc2" (UID: "be0a5922-6e9a-4314-bb47-e68afc2cdc7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:46:03.168350 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:03.168315    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kcv9j_c08f64a5-c9f2-4791-9cb0-0e3737d610cf/node-ca/0.log"
Jul 09 18:46:03.246692 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:03.246609    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:46:03.247234 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:03.246609    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:46:03.247234 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:03.246747    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rkc2" podUID="be0a5922-6e9a-4314-bb47-e68afc2cdc7b"
Jul 09 18:46:03.247234 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:03.246617    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:46:03.247234 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:03.246864    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kbs" podUID="409661cb-d599-4f25-a45b-58c69fd015f8"
Jul 09 18:46:03.247234 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:03.246931    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zclz" podUID="493326cf-6bd0-480f-b459-66089efc73c8"
Jul 09 18:46:04.202586 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:04.202094    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r5584"
Jul 09 18:46:04.202586 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:04.202455    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 18:46:04.202940 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:04.202920    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r5584"
Jul 09 18:46:05.247429 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:05.246967    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:46:05.247429 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:05.247086    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:46:05.247429 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:05.247095    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zclz" podUID="493326cf-6bd0-480f-b459-66089efc73c8"
Jul 09 18:46:05.248293 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:05.248257    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rkc2" podUID="be0a5922-6e9a-4314-bb47-e68afc2cdc7b"
Jul 09 18:46:05.248293 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:05.248295    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:46:05.248479 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:05.248386    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kbs" podUID="409661cb-d599-4f25-a45b-58c69fd015f8"
Jul 09 18:46:07.247467 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:07.247431    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:46:07.247965 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:07.247431    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:46:07.247965 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:07.247562    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zclz" podUID="493326cf-6bd0-480f-b459-66089efc73c8"
Jul 09 18:46:07.247965 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:07.247429    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:46:07.247965 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:07.247672    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kbs" podUID="409661cb-d599-4f25-a45b-58c69fd015f8"
Jul 09 18:46:07.247965 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:07.247758    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rkc2" podUID="be0a5922-6e9a-4314-bb47-e68afc2cdc7b"
Jul 09 18:46:09.249846 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:09.249811    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:46:09.250255 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:09.249945    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:46:09.250255 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:09.249952    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zclz" podUID="493326cf-6bd0-480f-b459-66089efc73c8"
Jul 09 18:46:09.250255 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:09.249977    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:46:09.250255 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:09.250127    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rkc2" podUID="be0a5922-6e9a-4314-bb47-e68afc2cdc7b"
Jul 09 18:46:09.250255 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:09.250219    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kbs" podUID="409661cb-d599-4f25-a45b-58c69fd015f8"
Jul 09 18:46:10.125668 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:10.125638    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 18:46:10.206359 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:10.206207    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T18:46:10.125665135Z","UUID":"7a329baa-1917-4ca6-99ca-baca0cadc9ee","Handler":null,"Name":"","Endpoint":""}
Jul 09 18:46:10.207579 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:10.207562    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 18:46:10.207695 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:10.207600    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 18:46:10.400367 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:10.400242    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hps7x_30222ae0-b5d2-440e-a799-e808706d4b84/ovn-acl-logging/0.log"
Jul 09 18:46:10.400942 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:10.400919    2580 generic.go:356] "Generic (PLEG): container finished" podID="30222ae0-b5d2-440e-a799-e808706d4b84" containerID="6055f2844cbacf64881ec70aef69db7421105a617c92106fa4e3e5f62e035745" exitCode=1
Jul 09 18:46:10.401053 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:10.400994    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hps7x" event={"ID":"30222ae0-b5d2-440e-a799-e808706d4b84","Type":"ContainerStarted","Data":"a3d6c79fb1f52c8851b5027edd0c2f55d0536c4afc37a3605e9f2d5a2a56cd3c"}
Jul 09 18:46:10.401141 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:10.401123    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hps7x" event={"ID":"30222ae0-b5d2-440e-a799-e808706d4b84","Type":"ContainerDied","Data":"6055f2844cbacf64881ec70aef69db7421105a617c92106fa4e3e5f62e035745"}
Jul 09 18:46:10.401202 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:10.401185    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hps7x" event={"ID":"30222ae0-b5d2-440e-a799-e808706d4b84","Type":"ContainerStarted","Data":"2a99375c1d7b6e5126cd56fc86cdac65ec2e7042cea202cc3a2a67595daa8a4f"}
Jul 09 18:46:10.402325 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:10.402296    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lf5c6" event={"ID":"311e85d9-feb7-414a-9e8f-ca306874a6f3","Type":"ContainerStarted","Data":"dd8d1b2a982192c98bab01854b14f477ce378bd081af3481db9472fa8cdada69"}
Jul 09 18:46:10.404104 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:10.404085    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw" event={"ID":"6ed47e5e-bb49-4c04-a547-aadde61f5fdd","Type":"ContainerStarted","Data":"52d4d824835ee6cb287dd9ff6672858ee64275ecb993b7193405794378c95957"}
Jul 09 18:46:10.421721 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:10.421682    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lf5c6" podStartSLOduration=1.909948827 podStartE2EDuration="24.421666522s" totalImagesPullingTime="22.511717695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:45:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:10.421336448 +0000 UTC m=+25.630925665" watchObservedRunningTime="2026-07-09 18:46:10.421666522 +0000 UTC m=+25.631255747"
Jul 09 18:46:11.246806 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:11.246778    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:46:11.247029 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:11.246775    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:46:11.247029 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:11.246901    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kbs" podUID="409661cb-d599-4f25-a45b-58c69fd015f8"
Jul 09 18:46:11.247029 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:11.246950    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:46:11.247147 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:11.247024    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rkc2" podUID="be0a5922-6e9a-4314-bb47-e68afc2cdc7b"
Jul 09 18:46:11.247147 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:11.247101    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zclz" podUID="493326cf-6bd0-480f-b459-66089efc73c8"
Jul 09 18:46:11.410286 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:11.410261    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hps7x_30222ae0-b5d2-440e-a799-e808706d4b84/ovn-acl-logging/0.log"
Jul 09 18:46:11.411059 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:11.410671    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hps7x" event={"ID":"30222ae0-b5d2-440e-a799-e808706d4b84","Type":"ContainerStarted","Data":"966e1d3906ad3c880994790fb44d9cc502075664f4b59424cedb9a346d86a687"}
Jul 09 18:46:11.411059 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:11.410741    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hps7x" event={"ID":"30222ae0-b5d2-440e-a799-e808706d4b84","Type":"ContainerStarted","Data":"ba9970a9dbd312bc712ac4d9a6580f943bee72dfeabfbc200f0d4f85b93e1bc9"}
Jul 09 18:46:11.411059 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:11.410793    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hps7x" event={"ID":"30222ae0-b5d2-440e-a799-e808706d4b84","Type":"ContainerStarted","Data":"4c89180a1b58396c4381a4af89e749028a384a4b756173814f10ecb7df8fa7ae"}
Jul 09 18:46:11.412691 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:11.412656    2580 generic.go:356] "Generic (PLEG): container finished" podID="eaa7461d-b281-4e7f-86f0-4caebd6a396d" containerID="381960cbb6ea9561edaddba33b78158a470f5ae55c6ffb7caf1dc6a07df4d783" exitCode=0
Jul 09 18:46:11.412804 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:11.412690    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kqr58" event={"ID":"eaa7461d-b281-4e7f-86f0-4caebd6a396d","Type":"ContainerDied","Data":"381960cbb6ea9561edaddba33b78158a470f5ae55c6ffb7caf1dc6a07df4d783"}
Jul 09 18:46:12.417236 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:12.417194    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw" event={"ID":"6ed47e5e-bb49-4c04-a547-aadde61f5fdd","Type":"ContainerStarted","Data":"407335756e889d02a71f1331c3ecf97a271524c7ddd2690a1bb086184164fe3d"}
Jul 09 18:46:12.438024 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:12.437973    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrpqw" podStartSLOduration=4.402664712 podStartE2EDuration="26.437958242s" totalImagesPullingTime="22.03529353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:45:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:12.437662293 +0000 UTC m=+27.647251510" watchObservedRunningTime="2026-07-09 18:46:12.437958242 +0000 UTC m=+27.647547459"
Jul 09 18:46:13.247113 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:13.247078    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:46:13.247113 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:13.247096    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:46:13.247353 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:13.247078    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:46:13.247353 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:13.247179    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rkc2" podUID="be0a5922-6e9a-4314-bb47-e68afc2cdc7b"
Jul 09 18:46:13.247353 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:13.247253    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kbs" podUID="409661cb-d599-4f25-a45b-58c69fd015f8"
Jul 09 18:46:13.247353 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:13.247339    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zclz" podUID="493326cf-6bd0-480f-b459-66089efc73c8"
Jul 09 18:46:13.422505 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:13.422430    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hps7x_30222ae0-b5d2-440e-a799-e808706d4b84/ovn-acl-logging/0.log"
Jul 09 18:46:13.422936 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:13.422795    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hps7x" event={"ID":"30222ae0-b5d2-440e-a799-e808706d4b84","Type":"ContainerStarted","Data":"89d32502cff1b39ecf6d4ab28f888b2bff602cb7ff9dbc27cd6fff97a76ebcba"}
Jul 09 18:46:13.424737 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:13.424714    2580 generic.go:356] "Generic (PLEG): container finished" podID="eaa7461d-b281-4e7f-86f0-4caebd6a396d" containerID="ff59b58557b9e15f85237d0679a682e961d3d052830b37f329c132c8121e554c" exitCode=0
Jul 09 18:46:13.424868 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:13.424791    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kqr58" event={"ID":"eaa7461d-b281-4e7f-86f0-4caebd6a396d","Type":"ContainerDied","Data":"ff59b58557b9e15f85237d0679a682e961d3d052830b37f329c132c8121e554c"}
Jul 09 18:46:15.250252 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:15.250073    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:46:15.250818 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:15.250103    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:46:15.250818 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:15.250340    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zclz" podUID="493326cf-6bd0-480f-b459-66089efc73c8"
Jul 09 18:46:15.250818 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:15.250135    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:46:15.250818 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:15.250386    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rkc2" podUID="be0a5922-6e9a-4314-bb47-e68afc2cdc7b"
Jul 09 18:46:15.250818 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:15.250486    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kbs" podUID="409661cb-d599-4f25-a45b-58c69fd015f8"
Jul 09 18:46:15.433103 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:15.433037    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hps7x_30222ae0-b5d2-440e-a799-e808706d4b84/ovn-acl-logging/0.log"
Jul 09 18:46:15.433452 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:15.433428    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hps7x" event={"ID":"30222ae0-b5d2-440e-a799-e808706d4b84","Type":"ContainerStarted","Data":"d1d9ce309fc35c74fef11063929071ac0bd946991141e74fb20c67f6e2a7b39d"}
Jul 09 18:46:15.433698 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:15.433679    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:46:15.433795 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:15.433755    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:46:15.433917 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:15.433901    2580 scope.go:117] "RemoveContainer" containerID="6055f2844cbacf64881ec70aef69db7421105a617c92106fa4e3e5f62e035745"
Jul 09 18:46:15.438104 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:15.438073    2580 generic.go:356] "Generic (PLEG): container finished" podID="eaa7461d-b281-4e7f-86f0-4caebd6a396d" containerID="2ac39dffc25100580368175d4f5e72b10df96b0ce4226f42ef52222394fb074c" exitCode=0
Jul 09 18:46:15.438198 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:15.438106    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kqr58" event={"ID":"eaa7461d-b281-4e7f-86f0-4caebd6a396d","Type":"ContainerDied","Data":"2ac39dffc25100580368175d4f5e72b10df96b0ce4226f42ef52222394fb074c"}
Jul 09 18:46:15.452223 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:15.452204    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:46:16.444879 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:16.444823    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hps7x_30222ae0-b5d2-440e-a799-e808706d4b84/ovn-acl-logging/0.log"
Jul 09 18:46:16.445391 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:16.445228    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hps7x" event={"ID":"30222ae0-b5d2-440e-a799-e808706d4b84","Type":"ContainerStarted","Data":"91da6e82d97b4132e000f5cba790403af98e3ae1de318cdb8daef880c65933e0"}
Jul 09 18:46:16.445481 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:16.445464    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:46:16.462674 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:16.462646    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:46:16.481118 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:16.481059    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hps7x" podStartSLOduration=9.596736077 podStartE2EDuration="30.481044168s" totalImagesPullingTime="20.884308091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:45:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:16.479463459 +0000 UTC m=+31.689052688" watchObservedRunningTime="2026-07-09 18:46:16.481044168 +0000 UTC m=+31.690633386"
Jul 09 18:46:17.247151 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:17.247119    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:46:17.247342 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:17.247124    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:46:17.247342 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:17.247235    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zclz" podUID="493326cf-6bd0-480f-b459-66089efc73c8"
Jul 09 18:46:17.247342 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:17.247247    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:46:17.247342 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:17.247321    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rkc2" podUID="be0a5922-6e9a-4314-bb47-e68afc2cdc7b"
Jul 09 18:46:17.247561 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:17.247420    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kbs" podUID="409661cb-d599-4f25-a45b-58c69fd015f8"
Jul 09 18:46:19.005177 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:19.005139    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/409661cb-d599-4f25-a45b-58c69fd015f8-metrics-certs\") pod \"network-metrics-daemon-c4kbs\" (UID: \"409661cb-d599-4f25-a45b-58c69fd015f8\") " pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:46:19.005619 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:19.005202    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/493326cf-6bd0-480f-b459-66089efc73c8-original-pull-secret\") pod \"global-pull-secret-syncer-8zclz\" (UID: \"493326cf-6bd0-480f-b459-66089efc73c8\") " pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:46:19.005619 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:19.005308    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:46:19.005619 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:19.005385    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/409661cb-d599-4f25-a45b-58c69fd015f8-metrics-certs podName:409661cb-d599-4f25-a45b-58c69fd015f8 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:51.005366046 +0000 UTC m=+66.214955246 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/409661cb-d599-4f25-a45b-58c69fd015f8-metrics-certs") pod "network-metrics-daemon-c4kbs" (UID: "409661cb-d599-4f25-a45b-58c69fd015f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:46:19.005619 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:19.005308    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:46:19.005619 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:19.005451    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/493326cf-6bd0-480f-b459-66089efc73c8-original-pull-secret podName:493326cf-6bd0-480f-b459-66089efc73c8 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:51.005436846 +0000 UTC m=+66.215026045 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/493326cf-6bd0-480f-b459-66089efc73c8-original-pull-secret") pod "global-pull-secret-syncer-8zclz" (UID: "493326cf-6bd0-480f-b459-66089efc73c8") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:46:19.105819 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:19.105782    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cnts\" (UniqueName: \"kubernetes.io/projected/be0a5922-6e9a-4314-bb47-e68afc2cdc7b-kube-api-access-8cnts\") pod \"network-check-target-5rkc2\" (UID: \"be0a5922-6e9a-4314-bb47-e68afc2cdc7b\") " pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:46:19.105995 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:19.105951    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:46:19.105995 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:19.105973    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:46:19.105995 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:19.105983    2580 projected.go:196] Error preparing data for projected volume kube-api-access-8cnts for pod openshift-network-diagnostics/network-check-target-5rkc2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:46:19.106126 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:19.106038    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be0a5922-6e9a-4314-bb47-e68afc2cdc7b-kube-api-access-8cnts podName:be0a5922-6e9a-4314-bb47-e68afc2cdc7b nodeName:}" failed. No retries permitted until 2026-07-09 18:46:51.106020295 +0000 UTC m=+66.315609492 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8cnts" (UniqueName: "kubernetes.io/projected/be0a5922-6e9a-4314-bb47-e68afc2cdc7b-kube-api-access-8cnts") pod "network-check-target-5rkc2" (UID: "be0a5922-6e9a-4314-bb47-e68afc2cdc7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:46:19.246467 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:19.246431    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:46:19.246467 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:19.246463    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:46:19.246684 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:19.246431    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:46:19.246684 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:19.246561    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zclz" podUID="493326cf-6bd0-480f-b459-66089efc73c8"
Jul 09 18:46:19.246684 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:19.246628    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rkc2" podUID="be0a5922-6e9a-4314-bb47-e68afc2cdc7b"
Jul 09 18:46:19.246869 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:19.246722    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kbs" podUID="409661cb-d599-4f25-a45b-58c69fd015f8"
Jul 09 18:46:21.247030 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:21.246995    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:46:21.247484 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:21.246995    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:46:21.247484 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:21.247114    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zclz" podUID="493326cf-6bd0-480f-b459-66089efc73c8"
Jul 09 18:46:21.247484 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:21.247180    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rkc2" podUID="be0a5922-6e9a-4314-bb47-e68afc2cdc7b"
Jul 09 18:46:21.247484 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:21.246995    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:46:21.247484 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:21.247298    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kbs" podUID="409661cb-d599-4f25-a45b-58c69fd015f8"
Jul 09 18:46:21.459700 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:21.459512    2580 generic.go:356] "Generic (PLEG): container finished" podID="eaa7461d-b281-4e7f-86f0-4caebd6a396d" containerID="dba104fd09d9e2f5fafa20673bbe41e86832524d962e1f3e6152d02c85531896" exitCode=0
Jul 09 18:46:21.459857 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:21.459596    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kqr58" event={"ID":"eaa7461d-b281-4e7f-86f0-4caebd6a396d","Type":"ContainerDied","Data":"dba104fd09d9e2f5fafa20673bbe41e86832524d962e1f3e6152d02c85531896"}
Jul 09 18:46:22.464894 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:22.464853    2580 generic.go:356] "Generic (PLEG): container finished" podID="eaa7461d-b281-4e7f-86f0-4caebd6a396d" containerID="1d165c6861a62d811a8cf0b64fb82eac4cb0e879cb6ddca96c7f4b213f81295b" exitCode=0
Jul 09 18:46:22.464894 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:22.464897    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kqr58" event={"ID":"eaa7461d-b281-4e7f-86f0-4caebd6a396d","Type":"ContainerDied","Data":"1d165c6861a62d811a8cf0b64fb82eac4cb0e879cb6ddca96c7f4b213f81295b"}
Jul 09 18:46:23.246480 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:23.246448    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:46:23.246480 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:23.246464    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:46:23.246805 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:23.246458    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:46:23.246805 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:23.246538    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zclz" podUID="493326cf-6bd0-480f-b459-66089efc73c8"
Jul 09 18:46:23.246805 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:23.246615    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rkc2" podUID="be0a5922-6e9a-4314-bb47-e68afc2cdc7b"
Jul 09 18:46:23.246805 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:23.246717    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kbs" podUID="409661cb-d599-4f25-a45b-58c69fd015f8"
Jul 09 18:46:23.469656 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:23.469618    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kqr58" event={"ID":"eaa7461d-b281-4e7f-86f0-4caebd6a396d","Type":"ContainerStarted","Data":"4d9de563f4529ced474c5f161d005809c85fd501918195c67cc02c1e0ef97c5a"}
Jul 09 18:46:23.495608 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:23.495551    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kqr58" podStartSLOduration=7.510451318 podStartE2EDuration="37.495524352s" totalImagesPullingTime="29.985073034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:45:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:23.493781366 +0000 UTC m=+38.703370581" watchObservedRunningTime="2026-07-09 18:46:23.495524352 +0000 UTC m=+38.705113572"
Jul 09 18:46:25.247363 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:25.247324    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:46:25.247873 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:25.247424    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rkc2" podUID="be0a5922-6e9a-4314-bb47-e68afc2cdc7b"
Jul 09 18:46:25.247873 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:25.247466    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:46:25.247873 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:25.247611    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kbs" podUID="409661cb-d599-4f25-a45b-58c69fd015f8"
Jul 09 18:46:25.247873 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:25.247640    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:46:25.247873 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:25.247725    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zclz" podUID="493326cf-6bd0-480f-b459-66089efc73c8"
Jul 09 18:46:26.143821 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:26.143749    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8zclz"]
Jul 09 18:46:26.144007 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:26.143943    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:46:26.144086 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:26.144061    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zclz" podUID="493326cf-6bd0-480f-b459-66089efc73c8"
Jul 09 18:46:26.146854 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:26.146768    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5rkc2"]
Jul 09 18:46:26.147055 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:26.146897    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:46:26.147055 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:26.146994    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rkc2" podUID="be0a5922-6e9a-4314-bb47-e68afc2cdc7b"
Jul 09 18:46:26.147453 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:26.147434    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c4kbs"]
Jul 09 18:46:26.147522 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:26.147516    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:46:26.147683 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:26.147602    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kbs" podUID="409661cb-d599-4f25-a45b-58c69fd015f8"
Jul 09 18:46:28.247402 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:28.247358    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:46:28.247402 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:28.247391    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:46:28.248156 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:28.247393    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:46:28.248156 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:28.247458    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5rkc2" podUID="be0a5922-6e9a-4314-bb47-e68afc2cdc7b"
Jul 09 18:46:28.248156 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:28.247557    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kbs" podUID="409661cb-d599-4f25-a45b-58c69fd015f8"
Jul 09 18:46:28.248156 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:28.247629    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zclz" podUID="493326cf-6bd0-480f-b459-66089efc73c8"
Jul 09 18:46:29.612439 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.612263    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-236.ec2.internal" event="NodeReady"
Jul 09 18:46:29.612904 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.612563    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 18:46:29.666646 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.666617    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-255x7"]
Jul 09 18:46:29.687435 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.687363    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pbpbb"]
Jul 09 18:46:29.687567 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.687485    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-255x7"
Jul 09 18:46:29.690340 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.690315    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 18:46:29.690340 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.690328    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qssxl\""
Jul 09 18:46:29.690340 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.690344    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 18:46:29.690737 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.690711    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 18:46:29.690864 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.690772    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 18:46:29.703322 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.703303    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pbpbb"]
Jul 09 18:46:29.703401 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.703330    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-255x7"]
Jul 09 18:46:29.703437 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.703409    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pbpbb"
Jul 09 18:46:29.706205 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.706184    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9zdkl\""
Jul 09 18:46:29.706302 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.706184    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 18:46:29.706365 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.706343    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 18:46:29.706493 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.706469    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 18:46:29.765245 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.765215    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s44qr"]
Jul 09 18:46:29.782898 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.782869    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/936f9fdc-29a0-4383-a5f8-7d3e9ddc4ca3-cert\") pod \"ingress-canary-pbpbb\" (UID: \"936f9fdc-29a0-4383-a5f8-7d3e9ddc4ca3\") " pod="openshift-ingress-canary/ingress-canary-pbpbb"
Jul 09 18:46:29.783045 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.782908    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e8f2682-e04e-4988-9a54-3b56a2a8d10a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-255x7\" (UID: \"7e8f2682-e04e-4988-9a54-3b56a2a8d10a\") " pod="openshift-insights/insights-runtime-extractor-255x7"
Jul 09 18:46:29.783045 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.782935    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z64rq\" (UniqueName: \"kubernetes.io/projected/7e8f2682-e04e-4988-9a54-3b56a2a8d10a-kube-api-access-z64rq\") pod \"insights-runtime-extractor-255x7\" (UID: \"7e8f2682-e04e-4988-9a54-3b56a2a8d10a\") " pod="openshift-insights/insights-runtime-extractor-255x7"
Jul 09 18:46:29.783045 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.782971    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nztb9\" (UniqueName: \"kubernetes.io/projected/936f9fdc-29a0-4383-a5f8-7d3e9ddc4ca3-kube-api-access-nztb9\") pod \"ingress-canary-pbpbb\" (UID: \"936f9fdc-29a0-4383-a5f8-7d3e9ddc4ca3\") " pod="openshift-ingress-canary/ingress-canary-pbpbb"
Jul 09 18:46:29.783045 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.782999    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e8f2682-e04e-4988-9a54-3b56a2a8d10a-data-volume\") pod \"insights-runtime-extractor-255x7\" (UID: \"7e8f2682-e04e-4988-9a54-3b56a2a8d10a\") " pod="openshift-insights/insights-runtime-extractor-255x7"
Jul 09 18:46:29.783178 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.783083    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e8f2682-e04e-4988-9a54-3b56a2a8d10a-crio-socket\") pod \"insights-runtime-extractor-255x7\" (UID: \"7e8f2682-e04e-4988-9a54-3b56a2a8d10a\") " pod="openshift-insights/insights-runtime-extractor-255x7"
Jul 09 18:46:29.783178 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.783107    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e8f2682-e04e-4988-9a54-3b56a2a8d10a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-255x7\" (UID: \"7e8f2682-e04e-4988-9a54-3b56a2a8d10a\") " pod="openshift-insights/insights-runtime-extractor-255x7"
Jul 09 18:46:29.789627 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.789605    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s44qr"]
Jul 09 18:46:29.789738 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.789645    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s44qr"
Jul 09 18:46:29.792408 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.792390    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 18:46:29.792408 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.792400    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 18:46:29.792547 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.792431    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5t98t\""
Jul 09 18:46:29.884362 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.884323    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/936f9fdc-29a0-4383-a5f8-7d3e9ddc4ca3-cert\") pod \"ingress-canary-pbpbb\" (UID: \"936f9fdc-29a0-4383-a5f8-7d3e9ddc4ca3\") " pod="openshift-ingress-canary/ingress-canary-pbpbb"
Jul 09 18:46:29.884362 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.884358    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e8f2682-e04e-4988-9a54-3b56a2a8d10a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-255x7\" (UID: \"7e8f2682-e04e-4988-9a54-3b56a2a8d10a\") " pod="openshift-insights/insights-runtime-extractor-255x7"
Jul 09 18:46:29.884606 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.884379    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z64rq\" (UniqueName: \"kubernetes.io/projected/7e8f2682-e04e-4988-9a54-3b56a2a8d10a-kube-api-access-z64rq\") pod \"insights-runtime-extractor-255x7\" (UID: \"7e8f2682-e04e-4988-9a54-3b56a2a8d10a\") " pod="openshift-insights/insights-runtime-extractor-255x7"
Jul 09 18:46:29.884606 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.884399    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a551c810-7d9f-45dc-b952-61a190a39f0a-tmp-dir\") pod \"dns-default-s44qr\" (UID: \"a551c810-7d9f-45dc-b952-61a190a39f0a\") " pod="openshift-dns/dns-default-s44qr"
Jul 09 18:46:29.884606 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.884419    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txtbj\" (UniqueName: \"kubernetes.io/projected/a551c810-7d9f-45dc-b952-61a190a39f0a-kube-api-access-txtbj\") pod \"dns-default-s44qr\" (UID: \"a551c810-7d9f-45dc-b952-61a190a39f0a\") " pod="openshift-dns/dns-default-s44qr"
Jul 09 18:46:29.884606 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.884494    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nztb9\" (UniqueName: \"kubernetes.io/projected/936f9fdc-29a0-4383-a5f8-7d3e9ddc4ca3-kube-api-access-nztb9\") pod \"ingress-canary-pbpbb\" (UID: \"936f9fdc-29a0-4383-a5f8-7d3e9ddc4ca3\") " pod="openshift-ingress-canary/ingress-canary-pbpbb"
Jul 09 18:46:29.884606 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.884532    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e8f2682-e04e-4988-9a54-3b56a2a8d10a-data-volume\") pod \"insights-runtime-extractor-255x7\" (UID: \"7e8f2682-e04e-4988-9a54-3b56a2a8d10a\") " pod="openshift-insights/insights-runtime-extractor-255x7"
Jul 09 18:46:29.884606 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.884560    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a551c810-7d9f-45dc-b952-61a190a39f0a-metrics-tls\") pod \"dns-default-s44qr\" (UID: \"a551c810-7d9f-45dc-b952-61a190a39f0a\") " pod="openshift-dns/dns-default-s44qr"
Jul 09 18:46:29.884606 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.884603    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e8f2682-e04e-4988-9a54-3b56a2a8d10a-crio-socket\") pod \"insights-runtime-extractor-255x7\" (UID: \"7e8f2682-e04e-4988-9a54-3b56a2a8d10a\") " pod="openshift-insights/insights-runtime-extractor-255x7"
Jul 09 18:46:29.884923 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.884628    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e8f2682-e04e-4988-9a54-3b56a2a8d10a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-255x7\" (UID: \"7e8f2682-e04e-4988-9a54-3b56a2a8d10a\") " pod="openshift-insights/insights-runtime-extractor-255x7"
Jul 09 18:46:29.884923 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.884660    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a551c810-7d9f-45dc-b952-61a190a39f0a-config-volume\") pod \"dns-default-s44qr\" (UID: \"a551c810-7d9f-45dc-b952-61a190a39f0a\") " pod="openshift-dns/dns-default-s44qr"
Jul 09 18:46:29.884923 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.884800    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e8f2682-e04e-4988-9a54-3b56a2a8d10a-crio-socket\") pod \"insights-runtime-extractor-255x7\" (UID: \"7e8f2682-e04e-4988-9a54-3b56a2a8d10a\") " pod="openshift-insights/insights-runtime-extractor-255x7"
Jul 09 18:46:29.885010 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.884927    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e8f2682-e04e-4988-9a54-3b56a2a8d10a-data-volume\") pod \"insights-runtime-extractor-255x7\" (UID: \"7e8f2682-e04e-4988-9a54-3b56a2a8d10a\") " pod="openshift-insights/insights-runtime-extractor-255x7"
Jul 09 18:46:29.885045 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.885022    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e8f2682-e04e-4988-9a54-3b56a2a8d10a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-255x7\" (UID: \"7e8f2682-e04e-4988-9a54-3b56a2a8d10a\") " pod="openshift-insights/insights-runtime-extractor-255x7"
Jul 09 18:46:29.888414 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.888389    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e8f2682-e04e-4988-9a54-3b56a2a8d10a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-255x7\" (UID: \"7e8f2682-e04e-4988-9a54-3b56a2a8d10a\") " pod="openshift-insights/insights-runtime-extractor-255x7"
Jul 09 18:46:29.888548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.888532    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/936f9fdc-29a0-4383-a5f8-7d3e9ddc4ca3-cert\") pod \"ingress-canary-pbpbb\" (UID: \"936f9fdc-29a0-4383-a5f8-7d3e9ddc4ca3\") " pod="openshift-ingress-canary/ingress-canary-pbpbb"
Jul 09 18:46:29.894202 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.894173    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nztb9\" (UniqueName: \"kubernetes.io/projected/936f9fdc-29a0-4383-a5f8-7d3e9ddc4ca3-kube-api-access-nztb9\") pod \"ingress-canary-pbpbb\" (UID: \"936f9fdc-29a0-4383-a5f8-7d3e9ddc4ca3\") " pod="openshift-ingress-canary/ingress-canary-pbpbb"
Jul 09 18:46:29.894283 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.894259    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z64rq\" (UniqueName: \"kubernetes.io/projected/7e8f2682-e04e-4988-9a54-3b56a2a8d10a-kube-api-access-z64rq\") pod \"insights-runtime-extractor-255x7\" (UID: \"7e8f2682-e04e-4988-9a54-3b56a2a8d10a\") " pod="openshift-insights/insights-runtime-extractor-255x7"
Jul 09 18:46:29.984970 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.984937    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a551c810-7d9f-45dc-b952-61a190a39f0a-metrics-tls\") pod \"dns-default-s44qr\" (UID: \"a551c810-7d9f-45dc-b952-61a190a39f0a\") " pod="openshift-dns/dns-default-s44qr"
Jul 09 18:46:29.985149 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.984987    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a551c810-7d9f-45dc-b952-61a190a39f0a-config-volume\") pod \"dns-default-s44qr\" (UID: \"a551c810-7d9f-45dc-b952-61a190a39f0a\") " pod="openshift-dns/dns-default-s44qr"
Jul 09 18:46:29.985149 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.985021    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a551c810-7d9f-45dc-b952-61a190a39f0a-tmp-dir\") pod \"dns-default-s44qr\" (UID: \"a551c810-7d9f-45dc-b952-61a190a39f0a\") " pod="openshift-dns/dns-default-s44qr"
Jul 09 18:46:29.985149 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.985036    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txtbj\" (UniqueName: \"kubernetes.io/projected/a551c810-7d9f-45dc-b952-61a190a39f0a-kube-api-access-txtbj\") pod \"dns-default-s44qr\" (UID: \"a551c810-7d9f-45dc-b952-61a190a39f0a\") " pod="openshift-dns/dns-default-s44qr"
Jul 09 18:46:29.985459 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.985436    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a551c810-7d9f-45dc-b952-61a190a39f0a-tmp-dir\") pod \"dns-default-s44qr\" (UID: \"a551c810-7d9f-45dc-b952-61a190a39f0a\") " pod="openshift-dns/dns-default-s44qr"
Jul 09 18:46:29.985630 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.985612    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a551c810-7d9f-45dc-b952-61a190a39f0a-config-volume\") pod \"dns-default-s44qr\" (UID: \"a551c810-7d9f-45dc-b952-61a190a39f0a\") " pod="openshift-dns/dns-default-s44qr"
Jul 09 18:46:29.987270 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.987247    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a551c810-7d9f-45dc-b952-61a190a39f0a-metrics-tls\") pod \"dns-default-s44qr\" (UID: \"a551c810-7d9f-45dc-b952-61a190a39f0a\") " pod="openshift-dns/dns-default-s44qr"
Jul 09 18:46:29.996484 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.996464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txtbj\" (UniqueName: \"kubernetes.io/projected/a551c810-7d9f-45dc-b952-61a190a39f0a-kube-api-access-txtbj\") pod \"dns-default-s44qr\" (UID: \"a551c810-7d9f-45dc-b952-61a190a39f0a\") " pod="openshift-dns/dns-default-s44qr"
Jul 09 18:46:29.998416 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:29.998401    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-255x7"
Jul 09 18:46:30.011042 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:30.011018    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pbpbb"
Jul 09 18:46:30.097432 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:30.097402    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s44qr"
Jul 09 18:46:30.218205 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:30.218177    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pbpbb"]
Jul 09 18:46:30.221538 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:30.221515    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-255x7"]
Jul 09 18:46:30.222509 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:46:30.222487    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod936f9fdc_29a0_4383_a5f8_7d3e9ddc4ca3.slice/crio-a52e3a4412acdf75982465c0b2272a23b18ebd75f39be806a02bbb4f464a2d5f WatchSource:0}: Error finding container a52e3a4412acdf75982465c0b2272a23b18ebd75f39be806a02bbb4f464a2d5f: Status 404 returned error can't find the container with id a52e3a4412acdf75982465c0b2272a23b18ebd75f39be806a02bbb4f464a2d5f
Jul 09 18:46:30.224671 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:46:30.224628    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e8f2682_e04e_4988_9a54_3b56a2a8d10a.slice/crio-6c6975e37e0f7a17542dba873b4430717ec19e6e6842721ef7970a95bfcb7432 WatchSource:0}: Error finding container 6c6975e37e0f7a17542dba873b4430717ec19e6e6842721ef7970a95bfcb7432: Status 404 returned error can't find the container with id 6c6975e37e0f7a17542dba873b4430717ec19e6e6842721ef7970a95bfcb7432
Jul 09 18:46:30.246439 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:30.246369    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:46:30.246546 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:30.246496    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:46:30.246546 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:30.246532    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:46:30.249193 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:30.249172    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 18:46:30.250478 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:30.250334    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 18:46:30.250478 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:30.250337    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-prgmc\""
Jul 09 18:46:30.250478 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:30.250378    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ckpt2\""
Jul 09 18:46:30.250478 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:30.250446    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 18:46:30.250702 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:30.250500    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 18:46:30.265538 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:30.265514    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s44qr"]
Jul 09 18:46:30.268250 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:46:30.268229    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda551c810_7d9f_45dc_b952_61a190a39f0a.slice/crio-d384dc44cc4a1073453484a7e3e81a43e722bba191681a91d00cdb660b4e4c40 WatchSource:0}: Error finding container d384dc44cc4a1073453484a7e3e81a43e722bba191681a91d00cdb660b4e4c40: Status 404 returned error can't find the container with id d384dc44cc4a1073453484a7e3e81a43e722bba191681a91d00cdb660b4e4c40
Jul 09 18:46:30.485067 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:30.485033    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s44qr" event={"ID":"a551c810-7d9f-45dc-b952-61a190a39f0a","Type":"ContainerStarted","Data":"d384dc44cc4a1073453484a7e3e81a43e722bba191681a91d00cdb660b4e4c40"}
Jul 09 18:46:30.486047 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:30.486025    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pbpbb" event={"ID":"936f9fdc-29a0-4383-a5f8-7d3e9ddc4ca3","Type":"ContainerStarted","Data":"a52e3a4412acdf75982465c0b2272a23b18ebd75f39be806a02bbb4f464a2d5f"}
Jul 09 18:46:30.487156 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:30.487134    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-255x7" event={"ID":"7e8f2682-e04e-4988-9a54-3b56a2a8d10a","Type":"ContainerStarted","Data":"6c6975e37e0f7a17542dba873b4430717ec19e6e6842721ef7970a95bfcb7432"}
Jul 09 18:46:31.727993 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:31.727959    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hjqf2"]
Jul 09 18:46:31.736720 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:31.736694    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hjqf2"
Jul 09 18:46:31.740441 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:31.740413    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 09 18:46:31.741011 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:31.740987    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-l2qcc\""
Jul 09 18:46:31.744745 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:31.744707    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hjqf2"]
Jul 09 18:46:31.802411 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:31.802371    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9fb288ee-fd54-478a-957f-fc37200a3cdb-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-hjqf2\" (UID: \"9fb288ee-fd54-478a-957f-fc37200a3cdb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hjqf2"
Jul 09 18:46:31.903565 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:31.903453    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9fb288ee-fd54-478a-957f-fc37200a3cdb-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-hjqf2\" (UID: \"9fb288ee-fd54-478a-957f-fc37200a3cdb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hjqf2"
Jul 09 18:46:31.913480 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:31.913445    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9fb288ee-fd54-478a-957f-fc37200a3cdb-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-hjqf2\" (UID: \"9fb288ee-fd54-478a-957f-fc37200a3cdb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hjqf2"
Jul 09 18:46:32.053726 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:32.053647    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hjqf2"
Jul 09 18:46:36.727619 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:36.727011    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hjqf2"]
Jul 09 18:46:36.732357 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:46:36.732322    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fb288ee_fd54_478a_957f_fc37200a3cdb.slice/crio-0e76501f3d83f1a727dff71e5148f4bddae9dbbf94d20bd6f2e00032836a50ff WatchSource:0}: Error finding container 0e76501f3d83f1a727dff71e5148f4bddae9dbbf94d20bd6f2e00032836a50ff: Status 404 returned error can't find the container with id 0e76501f3d83f1a727dff71e5148f4bddae9dbbf94d20bd6f2e00032836a50ff
Jul 09 18:46:37.507926 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:37.507842    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-255x7" event={"ID":"7e8f2682-e04e-4988-9a54-3b56a2a8d10a","Type":"ContainerStarted","Data":"947f74ffcdb60f01ccebc90e6aa82a3b6916a6cd2f8d60c32c92afbdf437b94c"}
Jul 09 18:46:37.507926 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:37.507908    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-255x7" event={"ID":"7e8f2682-e04e-4988-9a54-3b56a2a8d10a","Type":"ContainerStarted","Data":"082501948cb3068deabbcfd17c92e35707cb27edc566bf14449e86681245cb04"}
Jul 09 18:46:37.509119 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:37.509089    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hjqf2" event={"ID":"9fb288ee-fd54-478a-957f-fc37200a3cdb","Type":"ContainerStarted","Data":"0e76501f3d83f1a727dff71e5148f4bddae9dbbf94d20bd6f2e00032836a50ff"}
Jul 09 18:46:37.511051 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:37.511024    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s44qr" event={"ID":"a551c810-7d9f-45dc-b952-61a190a39f0a","Type":"ContainerStarted","Data":"f7e845ad2d9fe56990039fb3dec75a5d03c796fce09d7f19588a200a41477a73"}
Jul 09 18:46:37.511163 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:37.511079    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s44qr" event={"ID":"a551c810-7d9f-45dc-b952-61a190a39f0a","Type":"ContainerStarted","Data":"07e20bcd466d704634851bf5976b8d27ef7b6d293055ea4730629aff44520b89"}
Jul 09 18:46:37.511163 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:37.511146    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s44qr"
Jul 09 18:46:37.512544 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:37.512513    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pbpbb" event={"ID":"936f9fdc-29a0-4383-a5f8-7d3e9ddc4ca3","Type":"ContainerStarted","Data":"6a4b0fa4423ed1a61d0420c4753832059a42ee435e569734000a669174a3a013"}
Jul 09 18:46:37.540034 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:37.539974    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s44qr" podStartSLOduration=2.229507488 podStartE2EDuration="8.539957935s" totalImagesPullingTime="6.310450447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:37.539431294 +0000 UTC m=+52.749020512" watchObservedRunningTime="2026-07-09 18:46:37.539957935 +0000 UTC m=+52.749547154"
Jul 09 18:46:37.560321 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:37.560265    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pbpbb" podStartSLOduration=2.203147427 podStartE2EDuration="8.56024558s" totalImagesPullingTime="6.357098153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:37.55941315 +0000 UTC m=+52.769002379" watchObservedRunningTime="2026-07-09 18:46:37.56024558 +0000 UTC m=+52.769834799"
Jul 09 18:46:38.517657 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:38.517617    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hjqf2" event={"ID":"9fb288ee-fd54-478a-957f-fc37200a3cdb","Type":"ContainerStarted","Data":"4031ffb3ca9ee7713706db187a8129021d7d6f639f39b37dfe5e47647138486b"}
Jul 09 18:46:38.518211 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:38.518038    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hjqf2"
Jul 09 18:46:38.523165 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:38.523141    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hjqf2"
Jul 09 18:46:38.536357 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:38.536278    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hjqf2" podStartSLOduration=6.406286203 podStartE2EDuration="7.536259575s" totalImagesPullingTime="1.129973372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:38.535795469 +0000 UTC m=+53.745384688" watchObservedRunningTime="2026-07-09 18:46:38.536259575 +0000 UTC m=+53.745848794"
Jul 09 18:46:38.801437 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:38.801365    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-r8q67"]
Jul 09 18:46:38.803852 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:38.803819    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-r8q67"
Jul 09 18:46:38.806624 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:38.806602    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 09 18:46:38.807920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:38.807901    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 09 18:46:38.808161 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:38.808140    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 18:46:38.808259 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:38.808201    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 18:46:38.808259 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:38.808146    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 18:46:38.808674 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:38.808650    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-rq88t\""
Jul 09 18:46:38.815759 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:38.815739    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-r8q67"]
Jul 09 18:46:38.853642 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:38.853615    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/995c8aee-eb2a-4982-a139-c799a348e842-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-r8q67\" (UID: \"995c8aee-eb2a-4982-a139-c799a348e842\") " pod="openshift-monitoring/prometheus-operator-64785b6675-r8q67"
Jul 09 18:46:38.853782 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:38.853678    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/995c8aee-eb2a-4982-a139-c799a348e842-metrics-client-ca\") pod \"prometheus-operator-64785b6675-r8q67\" (UID: \"995c8aee-eb2a-4982-a139-c799a348e842\") " pod="openshift-monitoring/prometheus-operator-64785b6675-r8q67"
Jul 09 18:46:38.853782 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:38.853706    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/995c8aee-eb2a-4982-a139-c799a348e842-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-r8q67\" (UID: \"995c8aee-eb2a-4982-a139-c799a348e842\") " pod="openshift-monitoring/prometheus-operator-64785b6675-r8q67"
Jul 09 18:46:38.853782 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:38.853730    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjtjl\" (UniqueName: \"kubernetes.io/projected/995c8aee-eb2a-4982-a139-c799a348e842-kube-api-access-gjtjl\") pod \"prometheus-operator-64785b6675-r8q67\" (UID: \"995c8aee-eb2a-4982-a139-c799a348e842\") " pod="openshift-monitoring/prometheus-operator-64785b6675-r8q67"
Jul 09 18:46:38.954148 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:38.954112    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/995c8aee-eb2a-4982-a139-c799a348e842-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-r8q67\" (UID: \"995c8aee-eb2a-4982-a139-c799a348e842\") " pod="openshift-monitoring/prometheus-operator-64785b6675-r8q67"
Jul 09 18:46:38.954333 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:38.954177    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/995c8aee-eb2a-4982-a139-c799a348e842-metrics-client-ca\") pod \"prometheus-operator-64785b6675-r8q67\" (UID: \"995c8aee-eb2a-4982-a139-c799a348e842\") " pod="openshift-monitoring/prometheus-operator-64785b6675-r8q67"
Jul 09 18:46:38.954333 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:38.954205    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/995c8aee-eb2a-4982-a139-c799a348e842-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-r8q67\" (UID: \"995c8aee-eb2a-4982-a139-c799a348e842\") " pod="openshift-monitoring/prometheus-operator-64785b6675-r8q67"
Jul 09 18:46:38.954333 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:38.954228    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjtjl\" (UniqueName: \"kubernetes.io/projected/995c8aee-eb2a-4982-a139-c799a348e842-kube-api-access-gjtjl\") pod \"prometheus-operator-64785b6675-r8q67\" (UID: \"995c8aee-eb2a-4982-a139-c799a348e842\") " pod="openshift-monitoring/prometheus-operator-64785b6675-r8q67"
Jul 09 18:46:38.954333 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:38.954296    2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 09 18:46:38.954539 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:46:38.954379    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/995c8aee-eb2a-4982-a139-c799a348e842-prometheus-operator-tls podName:995c8aee-eb2a-4982-a139-c799a348e842 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:39.454357022 +0000 UTC m=+54.663946220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/995c8aee-eb2a-4982-a139-c799a348e842-prometheus-operator-tls") pod "prometheus-operator-64785b6675-r8q67" (UID: "995c8aee-eb2a-4982-a139-c799a348e842") : secret "prometheus-operator-tls" not found
Jul 09 18:46:38.955021 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:38.954997    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/995c8aee-eb2a-4982-a139-c799a348e842-metrics-client-ca\") pod \"prometheus-operator-64785b6675-r8q67\" (UID: \"995c8aee-eb2a-4982-a139-c799a348e842\") " pod="openshift-monitoring/prometheus-operator-64785b6675-r8q67"
Jul 09 18:46:38.956965 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:38.956947    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/995c8aee-eb2a-4982-a139-c799a348e842-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-r8q67\" (UID: \"995c8aee-eb2a-4982-a139-c799a348e842\") " pod="openshift-monitoring/prometheus-operator-64785b6675-r8q67"
Jul 09 18:46:38.965230 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:38.965203    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjtjl\" (UniqueName: \"kubernetes.io/projected/995c8aee-eb2a-4982-a139-c799a348e842-kube-api-access-gjtjl\") pod \"prometheus-operator-64785b6675-r8q67\" (UID: \"995c8aee-eb2a-4982-a139-c799a348e842\") " pod="openshift-monitoring/prometheus-operator-64785b6675-r8q67"
Jul 09 18:46:39.459073 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:39.459039    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/995c8aee-eb2a-4982-a139-c799a348e842-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-r8q67\" (UID: \"995c8aee-eb2a-4982-a139-c799a348e842\") " pod="openshift-monitoring/prometheus-operator-64785b6675-r8q67"
Jul 09 18:46:39.461630 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:39.461598    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/995c8aee-eb2a-4982-a139-c799a348e842-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-r8q67\" (UID: \"995c8aee-eb2a-4982-a139-c799a348e842\") " pod="openshift-monitoring/prometheus-operator-64785b6675-r8q67"
Jul 09 18:46:39.713106 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:39.713031    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-r8q67"
Jul 09 18:46:40.130363 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:40.130341    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-r8q67"]
Jul 09 18:46:40.132354 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:46:40.132333    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod995c8aee_eb2a_4982_a139_c799a348e842.slice/crio-e633be0058c2fd63d2cc955fe4f63d2d8ed4c691b72839176899f2f0f46958cd WatchSource:0}: Error finding container e633be0058c2fd63d2cc955fe4f63d2d8ed4c691b72839176899f2f0f46958cd: Status 404 returned error can't find the container with id e633be0058c2fd63d2cc955fe4f63d2d8ed4c691b72839176899f2f0f46958cd
Jul 09 18:46:40.525384 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:40.525352    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-255x7" event={"ID":"7e8f2682-e04e-4988-9a54-3b56a2a8d10a","Type":"ContainerStarted","Data":"4e13da9f791eafbd45b113d3e6d9a44e3def3253ef1a054419e44f0276ea0f74"}
Jul 09 18:46:40.526432 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:40.526405    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-r8q67" event={"ID":"995c8aee-eb2a-4982-a139-c799a348e842","Type":"ContainerStarted","Data":"e633be0058c2fd63d2cc955fe4f63d2d8ed4c691b72839176899f2f0f46958cd"}
Jul 09 18:46:40.547920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:40.547872    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-255x7" podStartSLOduration=1.887507192 podStartE2EDuration="11.547856219s" totalImagesPullingTime="9.660349027s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:46:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:40.547505059 +0000 UTC m=+55.757094276" watchObservedRunningTime="2026-07-09 18:46:40.547856219 +0000 UTC m=+55.757445438"
Jul 09 18:46:42.534113 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:42.534078    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-r8q67" event={"ID":"995c8aee-eb2a-4982-a139-c799a348e842","Type":"ContainerStarted","Data":"52febf2e2d0ab4333ab4fdb89cb3fb188454a40b5c6a1b3c11ebc3347be53a3e"}
Jul 09 18:46:42.534493 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:42.534132    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-r8q67" event={"ID":"995c8aee-eb2a-4982-a139-c799a348e842","Type":"ContainerStarted","Data":"f64fd5b53969619e8cb6bfcfd7923a3f99691fd221c51bd2f3b42613006343bb"}
Jul 09 18:46:42.560703 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:42.560655    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-r8q67" podStartSLOduration=3.120337702 podStartE2EDuration="4.560639549s" totalImagesPullingTime="1.440301847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:42.559572859 +0000 UTC m=+57.769162078" watchObservedRunningTime="2026-07-09 18:46:42.560639549 +0000 UTC m=+57.770228761"
Jul 09 18:46:44.368758 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.368681    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-ldfdz"]
Jul 09 18:46:44.391789 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.391751    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-8k72m"]
Jul 09 18:46:44.391960 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.391882    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ldfdz"
Jul 09 18:46:44.396075 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.396056    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lcslb\""
Jul 09 18:46:44.396289 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.396275    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 09 18:46:44.396379 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.396309    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 09 18:46:44.405325 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.405302    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-ldfdz"]
Jul 09 18:46:44.405434 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.405337    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-8k72m"]
Jul 09 18:46:44.405496 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.405431    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-8k72m"
Jul 09 18:46:44.427755 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.427734    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xtwnl\""
Jul 09 18:46:44.433343 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.433321    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 09 18:46:44.445215 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.445186    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-j7wdv"]
Jul 09 18:46:44.446679 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.446661    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 09 18:46:44.447316 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.447302    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 09 18:46:44.463641 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.463620    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.471645 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.471626    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 18:46:44.471720 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.471686    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 18:46:44.471891 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.471878    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 18:46:44.472071 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.472060    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-svpf7\""
Jul 09 18:46:44.491306 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.491286    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ab88fcea-bfec-4089-a99a-c0d8826fddc7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-8k72m\" (UID: \"ab88fcea-bfec-4089-a99a-c0d8826fddc7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8k72m"
Jul 09 18:46:44.491383 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.491334    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab88fcea-bfec-4089-a99a-c0d8826fddc7-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-8k72m\" (UID: \"ab88fcea-bfec-4089-a99a-c0d8826fddc7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8k72m"
Jul 09 18:46:44.491383 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.491356    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvrpq\" (UniqueName: \"kubernetes.io/projected/ab88fcea-bfec-4089-a99a-c0d8826fddc7-kube-api-access-qvrpq\") pod \"kube-state-metrics-785778ff74-8k72m\" (UID: \"ab88fcea-bfec-4089-a99a-c0d8826fddc7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8k72m"
Jul 09 18:46:44.491445 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.491387    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab88fcea-bfec-4089-a99a-c0d8826fddc7-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-8k72m\" (UID: \"ab88fcea-bfec-4089-a99a-c0d8826fddc7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8k72m"
Jul 09 18:46:44.491445 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.491418    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7339cea5-78bc-4051-b35a-af9307b1fb4e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-ldfdz\" (UID: \"7339cea5-78bc-4051-b35a-af9307b1fb4e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ldfdz"
Jul 09 18:46:44.491445 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.491436    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab88fcea-bfec-4089-a99a-c0d8826fddc7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-8k72m\" (UID: \"ab88fcea-bfec-4089-a99a-c0d8826fddc7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8k72m"
Jul 09 18:46:44.491545 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.491454    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7339cea5-78bc-4051-b35a-af9307b1fb4e-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-ldfdz\" (UID: \"7339cea5-78bc-4051-b35a-af9307b1fb4e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ldfdz"
Jul 09 18:46:44.491545 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.491470    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7sp4\" (UniqueName: \"kubernetes.io/projected/7339cea5-78bc-4051-b35a-af9307b1fb4e-kube-api-access-b7sp4\") pod \"openshift-state-metrics-84bd68b896-ldfdz\" (UID: \"7339cea5-78bc-4051-b35a-af9307b1fb4e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ldfdz"
Jul 09 18:46:44.491545 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.491491    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ab88fcea-bfec-4089-a99a-c0d8826fddc7-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-8k72m\" (UID: \"ab88fcea-bfec-4089-a99a-c0d8826fddc7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8k72m"
Jul 09 18:46:44.491680 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.491622    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7339cea5-78bc-4051-b35a-af9307b1fb4e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-ldfdz\" (UID: \"7339cea5-78bc-4051-b35a-af9307b1fb4e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ldfdz"
Jul 09 18:46:44.592139 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.592113    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/41e4d200-0985-42ca-bd82-cd71c81a8751-node-exporter-textfile\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.592311 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.592149    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41e4d200-0985-42ca-bd82-cd71c81a8751-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.592311 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.592183    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab88fcea-bfec-4089-a99a-c0d8826fddc7-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-8k72m\" (UID: \"ab88fcea-bfec-4089-a99a-c0d8826fddc7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8k72m"
Jul 09 18:46:44.592311 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.592221    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ab88fcea-bfec-4089-a99a-c0d8826fddc7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-8k72m\" (UID: \"ab88fcea-bfec-4089-a99a-c0d8826fddc7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8k72m"
Jul 09 18:46:44.592474 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.592371    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/41e4d200-0985-42ca-bd82-cd71c81a8751-root\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.592474 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.592403    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7339cea5-78bc-4051-b35a-af9307b1fb4e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-ldfdz\" (UID: \"7339cea5-78bc-4051-b35a-af9307b1fb4e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ldfdz"
Jul 09 18:46:44.592474 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.592429    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab88fcea-bfec-4089-a99a-c0d8826fddc7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-8k72m\" (UID: \"ab88fcea-bfec-4089-a99a-c0d8826fddc7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8k72m"
Jul 09 18:46:44.592474 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.592455    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/41e4d200-0985-42ca-bd82-cd71c81a8751-node-exporter-tls\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.592637 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.592481    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/41e4d200-0985-42ca-bd82-cd71c81a8751-node-exporter-wtmp\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.592637 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.592513    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7339cea5-78bc-4051-b35a-af9307b1fb4e-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-ldfdz\" (UID: \"7339cea5-78bc-4051-b35a-af9307b1fb4e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ldfdz"
Jul 09 18:46:44.592637 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.592538    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7sp4\" (UniqueName: \"kubernetes.io/projected/7339cea5-78bc-4051-b35a-af9307b1fb4e-kube-api-access-b7sp4\") pod \"openshift-state-metrics-84bd68b896-ldfdz\" (UID: \"7339cea5-78bc-4051-b35a-af9307b1fb4e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ldfdz"
Jul 09 18:46:44.592791 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.592627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7339cea5-78bc-4051-b35a-af9307b1fb4e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-ldfdz\" (UID: \"7339cea5-78bc-4051-b35a-af9307b1fb4e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ldfdz"
Jul 09 18:46:44.592791 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.592670    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/41e4d200-0985-42ca-bd82-cd71c81a8751-node-exporter-accelerators-collector-config\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.592791 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.592706    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab88fcea-bfec-4089-a99a-c0d8826fddc7-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-8k72m\" (UID: \"ab88fcea-bfec-4089-a99a-c0d8826fddc7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8k72m"
Jul 09 18:46:44.592791 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.592735    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvrpq\" (UniqueName: \"kubernetes.io/projected/ab88fcea-bfec-4089-a99a-c0d8826fddc7-kube-api-access-qvrpq\") pod \"kube-state-metrics-785778ff74-8k72m\" (UID: \"ab88fcea-bfec-4089-a99a-c0d8826fddc7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8k72m"
Jul 09 18:46:44.593027 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.592790    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ab88fcea-bfec-4089-a99a-c0d8826fddc7-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-8k72m\" (UID: \"ab88fcea-bfec-4089-a99a-c0d8826fddc7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8k72m"
Jul 09 18:46:44.593027 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.592842    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41e4d200-0985-42ca-bd82-cd71c81a8751-metrics-client-ca\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.593027 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.592876    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs9dx\" (UniqueName: \"kubernetes.io/projected/41e4d200-0985-42ca-bd82-cd71c81a8751-kube-api-access-xs9dx\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.593027 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.592903    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41e4d200-0985-42ca-bd82-cd71c81a8751-sys\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.593276 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.593069    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ab88fcea-bfec-4089-a99a-c0d8826fddc7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-8k72m\" (UID: \"ab88fcea-bfec-4089-a99a-c0d8826fddc7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8k72m"
Jul 09 18:46:44.593330 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.593312    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7339cea5-78bc-4051-b35a-af9307b1fb4e-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-ldfdz\" (UID: \"7339cea5-78bc-4051-b35a-af9307b1fb4e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ldfdz"
Jul 09 18:46:44.593405 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.593377    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab88fcea-bfec-4089-a99a-c0d8826fddc7-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-8k72m\" (UID: \"ab88fcea-bfec-4089-a99a-c0d8826fddc7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8k72m"
Jul 09 18:46:44.593540 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.593493    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ab88fcea-bfec-4089-a99a-c0d8826fddc7-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-8k72m\" (UID: \"ab88fcea-bfec-4089-a99a-c0d8826fddc7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8k72m"
Jul 09 18:46:44.595091 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.595065    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab88fcea-bfec-4089-a99a-c0d8826fddc7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-8k72m\" (UID: \"ab88fcea-bfec-4089-a99a-c0d8826fddc7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8k72m"
Jul 09 18:46:44.595091 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.595088    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab88fcea-bfec-4089-a99a-c0d8826fddc7-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-8k72m\" (UID: \"ab88fcea-bfec-4089-a99a-c0d8826fddc7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8k72m"
Jul 09 18:46:44.595204 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.595157    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7339cea5-78bc-4051-b35a-af9307b1fb4e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-ldfdz\" (UID: \"7339cea5-78bc-4051-b35a-af9307b1fb4e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ldfdz"
Jul 09 18:46:44.595391 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.595371    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7339cea5-78bc-4051-b35a-af9307b1fb4e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-ldfdz\" (UID: \"7339cea5-78bc-4051-b35a-af9307b1fb4e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ldfdz"
Jul 09 18:46:44.607229 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.607207    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7sp4\" (UniqueName: \"kubernetes.io/projected/7339cea5-78bc-4051-b35a-af9307b1fb4e-kube-api-access-b7sp4\") pod \"openshift-state-metrics-84bd68b896-ldfdz\" (UID: \"7339cea5-78bc-4051-b35a-af9307b1fb4e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ldfdz"
Jul 09 18:46:44.618646 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.618625    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvrpq\" (UniqueName: \"kubernetes.io/projected/ab88fcea-bfec-4089-a99a-c0d8826fddc7-kube-api-access-qvrpq\") pod \"kube-state-metrics-785778ff74-8k72m\" (UID: \"ab88fcea-bfec-4089-a99a-c0d8826fddc7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-8k72m"
Jul 09 18:46:44.693759 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.693671    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs9dx\" (UniqueName: \"kubernetes.io/projected/41e4d200-0985-42ca-bd82-cd71c81a8751-kube-api-access-xs9dx\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.693759 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.693714    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41e4d200-0985-42ca-bd82-cd71c81a8751-sys\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.693759 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.693745    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/41e4d200-0985-42ca-bd82-cd71c81a8751-node-exporter-textfile\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.693759 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.693761    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41e4d200-0985-42ca-bd82-cd71c81a8751-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.694141 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.693784    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/41e4d200-0985-42ca-bd82-cd71c81a8751-root\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.694141 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.693800    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/41e4d200-0985-42ca-bd82-cd71c81a8751-node-exporter-tls\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.694141 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.693816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/41e4d200-0985-42ca-bd82-cd71c81a8751-node-exporter-wtmp\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.694141 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.693880    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/41e4d200-0985-42ca-bd82-cd71c81a8751-node-exporter-accelerators-collector-config\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.694141 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.693888    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/41e4d200-0985-42ca-bd82-cd71c81a8751-root\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.694141 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.693919    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41e4d200-0985-42ca-bd82-cd71c81a8751-sys\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.694141 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.693940    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41e4d200-0985-42ca-bd82-cd71c81a8751-metrics-client-ca\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.694141 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.694040    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/41e4d200-0985-42ca-bd82-cd71c81a8751-node-exporter-wtmp\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.694437 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.694217    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/41e4d200-0985-42ca-bd82-cd71c81a8751-node-exporter-textfile\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.694437 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.694411    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41e4d200-0985-42ca-bd82-cd71c81a8751-metrics-client-ca\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.694513 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.694459    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/41e4d200-0985-42ca-bd82-cd71c81a8751-node-exporter-accelerators-collector-config\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.696642 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.696620    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41e4d200-0985-42ca-bd82-cd71c81a8751-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.696743 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.696709    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/41e4d200-0985-42ca-bd82-cd71c81a8751-node-exporter-tls\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.702628 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.702610    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ldfdz"
Jul 09 18:46:44.712127 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.712107    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs9dx\" (UniqueName: \"kubernetes.io/projected/41e4d200-0985-42ca-bd82-cd71c81a8751-kube-api-access-xs9dx\") pod \"node-exporter-j7wdv\" (UID: \"41e4d200-0985-42ca-bd82-cd71c81a8751\") " pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.713971 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.713956    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-8k72m"
Jul 09 18:46:44.772761 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.772733    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j7wdv"
Jul 09 18:46:44.814024 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:46:44.813964    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41e4d200_0985_42ca_bd82_cd71c81a8751.slice/crio-e0351ff03d42c4520c34cb0c20abbcc13dbfdc0bcafd88167c41986e433b7d7f WatchSource:0}: Error finding container e0351ff03d42c4520c34cb0c20abbcc13dbfdc0bcafd88167c41986e433b7d7f: Status 404 returned error can't find the container with id e0351ff03d42c4520c34cb0c20abbcc13dbfdc0bcafd88167c41986e433b7d7f
Jul 09 18:46:44.881787 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.881753    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-ldfdz"]
Jul 09 18:46:44.885438 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:46:44.885407    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7339cea5_78bc_4051_b35a_af9307b1fb4e.slice/crio-5b8cebeef6563890fe05440048388f37e5fa0f9d4074f90610b64bbbb9cca87b WatchSource:0}: Error finding container 5b8cebeef6563890fe05440048388f37e5fa0f9d4074f90610b64bbbb9cca87b: Status 404 returned error can't find the container with id 5b8cebeef6563890fe05440048388f37e5fa0f9d4074f90610b64bbbb9cca87b
Jul 09 18:46:44.901542 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:44.901521    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-8k72m"]
Jul 09 18:46:44.903707 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:46:44.903688    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab88fcea_bfec_4089_a99a_c0d8826fddc7.slice/crio-c18e6fc368c271740bdf65c1be59857ec41e1062a2bbc1f38266788db99533cf WatchSource:0}: Error finding container c18e6fc368c271740bdf65c1be59857ec41e1062a2bbc1f38266788db99533cf: Status 404 returned error can't find the container with id c18e6fc368c271740bdf65c1be59857ec41e1062a2bbc1f38266788db99533cf
Jul 09 18:46:45.479638 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.479601    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 18:46:45.482948 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.482925    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.486727 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.486703    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 09 18:46:45.488341 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.488319    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 09 18:46:45.488467 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.488401    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nd9kn\""
Jul 09 18:46:45.488692 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.488672    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 09 18:46:45.489633 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.489377    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 09 18:46:45.489633 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.489501    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 09 18:46:45.489633 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.489515    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 09 18:46:45.489633 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.489525    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 09 18:46:45.489633 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.489571    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 09 18:46:45.491160 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.491123    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 09 18:46:45.527428 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.527395    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 18:46:45.547621 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.547585    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-8k72m" event={"ID":"ab88fcea-bfec-4089-a99a-c0d8826fddc7","Type":"ContainerStarted","Data":"c18e6fc368c271740bdf65c1be59857ec41e1062a2bbc1f38266788db99533cf"}
Jul 09 18:46:45.548984 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.548954    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j7wdv" event={"ID":"41e4d200-0985-42ca-bd82-cd71c81a8751","Type":"ContainerStarted","Data":"e0351ff03d42c4520c34cb0c20abbcc13dbfdc0bcafd88167c41986e433b7d7f"}
Jul 09 18:46:45.551048 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.551014    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ldfdz" event={"ID":"7339cea5-78bc-4051-b35a-af9307b1fb4e","Type":"ContainerStarted","Data":"a3c279f3039632f874f55de126b781247e0c339c6a7923f904fbbfce9adc732b"}
Jul 09 18:46:45.551156 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.551063    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ldfdz" event={"ID":"7339cea5-78bc-4051-b35a-af9307b1fb4e","Type":"ContainerStarted","Data":"c51b361139efa679dd1d4bda68c8675cf62f1ba9e4a8d1b84dd244a2a3cc4104"}
Jul 09 18:46:45.551156 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.551085    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ldfdz" event={"ID":"7339cea5-78bc-4051-b35a-af9307b1fb4e","Type":"ContainerStarted","Data":"5b8cebeef6563890fe05440048388f37e5fa0f9d4074f90610b64bbbb9cca87b"}
Jul 09 18:46:45.600186 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.600147    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db61830b-ad33-46dd-be6a-9580e3603a56-config-out\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.600186 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.600182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.600399 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.600249    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-web-config\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.600399 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.600267    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db61830b-ad33-46dd-be6a-9580e3603a56-tls-assets\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.600399 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.600284    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.600399 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.600310    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.600399 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.600335    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qb9h\" (UniqueName: \"kubernetes.io/projected/db61830b-ad33-46dd-be6a-9580e3603a56-kube-api-access-8qb9h\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.600399 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.600354    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db61830b-ad33-46dd-be6a-9580e3603a56-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.600399 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.600396    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-config-volume\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.600740 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.600477    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/db61830b-ad33-46dd-be6a-9580e3603a56-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.600740 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.600518    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.600740 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.600581    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.600740 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.600629    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db61830b-ad33-46dd-be6a-9580e3603a56-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.701969 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.701934    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db61830b-ad33-46dd-be6a-9580e3603a56-tls-assets\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.702134 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.701970    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.702211 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.702161    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.702211 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.702190    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qb9h\" (UniqueName: \"kubernetes.io/projected/db61830b-ad33-46dd-be6a-9580e3603a56-kube-api-access-8qb9h\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.702296 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.702226    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db61830b-ad33-46dd-be6a-9580e3603a56-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.702296 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.702277    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-config-volume\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.702368 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.702309    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/db61830b-ad33-46dd-be6a-9580e3603a56-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.702368 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.702334    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.702464 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.702379    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.702464 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.702423    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db61830b-ad33-46dd-be6a-9580e3603a56-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.702464 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.702447    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db61830b-ad33-46dd-be6a-9580e3603a56-config-out\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.702605 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.702478    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.702605 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.702543    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-web-config\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.705606 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.703299    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db61830b-ad33-46dd-be6a-9580e3603a56-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.705606 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.704208    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db61830b-ad33-46dd-be6a-9580e3603a56-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.705606 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.704662    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/db61830b-ad33-46dd-be6a-9580e3603a56-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.705606 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.705193    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db61830b-ad33-46dd-be6a-9580e3603a56-tls-assets\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.705606 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.705556    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-config-volume\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.705962 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.705789    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-web-config\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.706963 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.706587    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db61830b-ad33-46dd-be6a-9580e3603a56-config-out\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.706963 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.706921    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.707228 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.707206    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.708118 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.708075    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.708362 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.708319    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.708494 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.708403    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.717769 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.717751    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qb9h\" (UniqueName: \"kubernetes.io/projected/db61830b-ad33-46dd-be6a-9580e3603a56-kube-api-access-8qb9h\") pod \"alertmanager-main-0\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.794770 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.794698    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:46:45.959520 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:45.959489    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 18:46:45.959961 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:46:45.959933    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb61830b_ad33_46dd_be6a_9580e3603a56.slice/crio-46854957379d852b843421db438c120db43f2bb74a769b05124fce6f6b3ea94e WatchSource:0}: Error finding container 46854957379d852b843421db438c120db43f2bb74a769b05124fce6f6b3ea94e: Status 404 returned error can't find the container with id 46854957379d852b843421db438c120db43f2bb74a769b05124fce6f6b3ea94e
Jul 09 18:46:46.424159 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.424124    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-67c9866758-xqg89"]
Jul 09 18:46:46.427894 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.427872    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.432773 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.432754    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 09 18:46:46.433073 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.433053    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 09 18:46:46.433318 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.433301    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 09 18:46:46.433412 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.433321    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2l76g\""
Jul 09 18:46:46.433552 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.433536    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bb9tsuntsrc7u\""
Jul 09 18:46:46.433808 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.433786    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 09 18:46:46.434647 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.434585    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 09 18:46:46.453404 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.453376    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-67c9866758-xqg89"]
Jul 09 18:46:46.508986 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.508954    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/25590d78-0735-4607-b442-97f364905500-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67c9866758-xqg89\" (UID: \"25590d78-0735-4607-b442-97f364905500\") " pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.509355 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.509000    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/25590d78-0735-4607-b442-97f364905500-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67c9866758-xqg89\" (UID: \"25590d78-0735-4607-b442-97f364905500\") " pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.509355 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.509031    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhjn9\" (UniqueName: \"kubernetes.io/projected/25590d78-0735-4607-b442-97f364905500-kube-api-access-mhjn9\") pod \"thanos-querier-67c9866758-xqg89\" (UID: \"25590d78-0735-4607-b442-97f364905500\") " pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.509355 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.509111    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/25590d78-0735-4607-b442-97f364905500-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67c9866758-xqg89\" (UID: \"25590d78-0735-4607-b442-97f364905500\") " pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.509355 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.509154    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/25590d78-0735-4607-b442-97f364905500-secret-thanos-querier-tls\") pod \"thanos-querier-67c9866758-xqg89\" (UID: \"25590d78-0735-4607-b442-97f364905500\") " pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.509355 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.509212    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/25590d78-0735-4607-b442-97f364905500-secret-grpc-tls\") pod \"thanos-querier-67c9866758-xqg89\" (UID: \"25590d78-0735-4607-b442-97f364905500\") " pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.509355 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.509278    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/25590d78-0735-4607-b442-97f364905500-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67c9866758-xqg89\" (UID: \"25590d78-0735-4607-b442-97f364905500\") " pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.509355 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.509301    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25590d78-0735-4607-b442-97f364905500-metrics-client-ca\") pod \"thanos-querier-67c9866758-xqg89\" (UID: \"25590d78-0735-4607-b442-97f364905500\") " pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.556312 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.556271    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db61830b-ad33-46dd-be6a-9580e3603a56","Type":"ContainerStarted","Data":"46854957379d852b843421db438c120db43f2bb74a769b05124fce6f6b3ea94e"}
Jul 09 18:46:46.558121 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.558094    2580 generic.go:356] "Generic (PLEG): container finished" podID="41e4d200-0985-42ca-bd82-cd71c81a8751" containerID="ef1b2491bba1296bc6b8b915bc48fd634de30948bcf6883690269f2a6d1b6cb5" exitCode=0
Jul 09 18:46:46.558252 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.558135    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j7wdv" event={"ID":"41e4d200-0985-42ca-bd82-cd71c81a8751","Type":"ContainerDied","Data":"ef1b2491bba1296bc6b8b915bc48fd634de30948bcf6883690269f2a6d1b6cb5"}
Jul 09 18:46:46.610329 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.610294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/25590d78-0735-4607-b442-97f364905500-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67c9866758-xqg89\" (UID: \"25590d78-0735-4607-b442-97f364905500\") " pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.610329 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.610333    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/25590d78-0735-4607-b442-97f364905500-secret-thanos-querier-tls\") pod \"thanos-querier-67c9866758-xqg89\" (UID: \"25590d78-0735-4607-b442-97f364905500\") " pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.610563 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.610379    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/25590d78-0735-4607-b442-97f364905500-secret-grpc-tls\") pod \"thanos-querier-67c9866758-xqg89\" (UID: \"25590d78-0735-4607-b442-97f364905500\") " pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.610563 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.610457    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/25590d78-0735-4607-b442-97f364905500-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67c9866758-xqg89\" (UID: \"25590d78-0735-4607-b442-97f364905500\") " pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.610563 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.610485    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25590d78-0735-4607-b442-97f364905500-metrics-client-ca\") pod \"thanos-querier-67c9866758-xqg89\" (UID: \"25590d78-0735-4607-b442-97f364905500\") " pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.610721 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.610636    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/25590d78-0735-4607-b442-97f364905500-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67c9866758-xqg89\" (UID: \"25590d78-0735-4607-b442-97f364905500\") " pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.610721 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.610704    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/25590d78-0735-4607-b442-97f364905500-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67c9866758-xqg89\" (UID: \"25590d78-0735-4607-b442-97f364905500\") " pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.611303 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.611274    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhjn9\" (UniqueName: \"kubernetes.io/projected/25590d78-0735-4607-b442-97f364905500-kube-api-access-mhjn9\") pod \"thanos-querier-67c9866758-xqg89\" (UID: \"25590d78-0735-4607-b442-97f364905500\") " pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.611602 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.611577    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25590d78-0735-4607-b442-97f364905500-metrics-client-ca\") pod \"thanos-querier-67c9866758-xqg89\" (UID: \"25590d78-0735-4607-b442-97f364905500\") " pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.613424 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.613397    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/25590d78-0735-4607-b442-97f364905500-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67c9866758-xqg89\" (UID: \"25590d78-0735-4607-b442-97f364905500\") " pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.613607 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.613556    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/25590d78-0735-4607-b442-97f364905500-secret-thanos-querier-tls\") pod \"thanos-querier-67c9866758-xqg89\" (UID: \"25590d78-0735-4607-b442-97f364905500\") " pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.613607 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.613581    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/25590d78-0735-4607-b442-97f364905500-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67c9866758-xqg89\" (UID: \"25590d78-0735-4607-b442-97f364905500\") " pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.613953 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.613930    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/25590d78-0735-4607-b442-97f364905500-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67c9866758-xqg89\" (UID: \"25590d78-0735-4607-b442-97f364905500\") " pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.614041 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.613937    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/25590d78-0735-4607-b442-97f364905500-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67c9866758-xqg89\" (UID: \"25590d78-0735-4607-b442-97f364905500\") " pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.614670 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.614650    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/25590d78-0735-4607-b442-97f364905500-secret-grpc-tls\") pod \"thanos-querier-67c9866758-xqg89\" (UID: \"25590d78-0735-4607-b442-97f364905500\") " pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.624782 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.624763    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhjn9\" (UniqueName: \"kubernetes.io/projected/25590d78-0735-4607-b442-97f364905500-kube-api-access-mhjn9\") pod \"thanos-querier-67c9866758-xqg89\" (UID: \"25590d78-0735-4607-b442-97f364905500\") " pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.738776 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.738745    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:46.928396 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:46.928325    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-67c9866758-xqg89"]
Jul 09 18:46:46.934754 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:46:46.934723    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25590d78_0735_4607_b442_97f364905500.slice/crio-6bbd1f76af4a0b27e3a93691e0c31edc6379b023905a6b5d14a6939084c990ee WatchSource:0}: Error finding container 6bbd1f76af4a0b27e3a93691e0c31edc6379b023905a6b5d14a6939084c990ee: Status 404 returned error can't find the container with id 6bbd1f76af4a0b27e3a93691e0c31edc6379b023905a6b5d14a6939084c990ee
Jul 09 18:46:47.519866 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:47.519813    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s44qr"
Jul 09 18:46:47.563697 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:47.563662    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67c9866758-xqg89" event={"ID":"25590d78-0735-4607-b442-97f364905500","Type":"ContainerStarted","Data":"6bbd1f76af4a0b27e3a93691e0c31edc6379b023905a6b5d14a6939084c990ee"}
Jul 09 18:46:47.566813 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:47.566786    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-8k72m" event={"ID":"ab88fcea-bfec-4089-a99a-c0d8826fddc7","Type":"ContainerStarted","Data":"578c669709a3dc25ca3e5bf96caa6e909fcad1cfec6f21ab1c3ffbdea046f1fb"}
Jul 09 18:46:47.566924 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:47.566866    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-8k72m" event={"ID":"ab88fcea-bfec-4089-a99a-c0d8826fddc7","Type":"ContainerStarted","Data":"c25afaaf9a23570bdd4c28f132c28da14fc224ea74708ac1292f20e1a257c3e7"}
Jul 09 18:46:47.566924 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:47.566912    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-8k72m" event={"ID":"ab88fcea-bfec-4089-a99a-c0d8826fddc7","Type":"ContainerStarted","Data":"4a6d96331fe1f3db17b08f445d838014b6e105af82d473b8c8e949e31eace0fe"}
Jul 09 18:46:47.569144 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:47.569114    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j7wdv" event={"ID":"41e4d200-0985-42ca-bd82-cd71c81a8751","Type":"ContainerStarted","Data":"1be0f9dc6efcb2796d4eab3df3971c4a517751c684b24aa14a0dce9879251443"}
Jul 09 18:46:47.569266 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:47.569168    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j7wdv" event={"ID":"41e4d200-0985-42ca-bd82-cd71c81a8751","Type":"ContainerStarted","Data":"fc22a035a9d7cc4488f0b1d25618e97bcb6d5ef47ad27a55a604d524031ca662"}
Jul 09 18:46:47.571472 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:47.571449    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ldfdz" event={"ID":"7339cea5-78bc-4051-b35a-af9307b1fb4e","Type":"ContainerStarted","Data":"02e1dbbeaa102b9ed6b761e23b300c8c6948135dce570aad08e9c84284c2de66"}
Jul 09 18:46:47.590763 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:47.590706    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-8k72m" podStartSLOduration=1.76864091 podStartE2EDuration="3.590683382s" totalImagesPullingTime="1.822042472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:47.588732347 +0000 UTC m=+62.798321565" watchObservedRunningTime="2026-07-09 18:46:47.590683382 +0000 UTC m=+62.800272600"
Jul 09 18:46:47.660942 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:47.660889    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-j7wdv" podStartSLOduration=2.548677166 podStartE2EDuration="3.660867432s" totalImagesPullingTime="1.035404507s" totalInitContainerRuntime="76.785759ms" isStatefulPod=true podCreationTimestamp="2026-07-09 18:46:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:47.660747008 +0000 UTC m=+62.870336229" watchObservedRunningTime="2026-07-09 18:46:47.660867432 +0000 UTC m=+62.870456647"
Jul 09 18:46:47.661228 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:47.661202    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ldfdz" podStartSLOduration=2.064945038 podStartE2EDuration="3.661194497s" totalImagesPullingTime="1.596249459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:47.629702165 +0000 UTC m=+62.839291383" watchObservedRunningTime="2026-07-09 18:46:47.661194497 +0000 UTC m=+62.870783714"
Jul 09 18:46:48.461382 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:48.461351    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hps7x"
Jul 09 18:46:48.577873 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:48.577816    2580 generic.go:356] "Generic (PLEG): container finished" podID="db61830b-ad33-46dd-be6a-9580e3603a56" containerID="9df87aaba8960ae80265d201c44f113f6769bd680af765b18fa8d2c180cc0f1c" exitCode=0
Jul 09 18:46:48.578301 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:48.577959    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db61830b-ad33-46dd-be6a-9580e3603a56","Type":"ContainerDied","Data":"9df87aaba8960ae80265d201c44f113f6769bd680af765b18fa8d2c180cc0f1c"}
Jul 09 18:46:48.903151 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:48.903128    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"]
Jul 09 18:46:48.906534 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:48.906515    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:46:48.913194 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:48.913172    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 09 18:46:48.913299 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:48.913173    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 09 18:46:48.914399 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:48.914375    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 09 18:46:48.914399 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:48.914392    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-k6cbf\""
Jul 09 18:46:48.914543 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:48.914449    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 09 18:46:48.914625 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:48.914546    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-gak3tbpmn5b7\""
Jul 09 18:46:48.921573 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:48.921550    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"]
Jul 09 18:46:49.005692 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.005663    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-bk4sn"]
Jul 09 18:46:49.010378 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.010348    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bk4sn"
Jul 09 18:46:49.013634 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.013619    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 09 18:46:49.013717 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.013644    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-6nf5p\""
Jul 09 18:46:49.024916 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.024895    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-bk4sn"]
Jul 09 18:46:49.035311 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.035287    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a9511e5-7e16-4392-bbac-a870cdf36731-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cf5c88d78-gkqb7\" (UID: \"1a9511e5-7e16-4392-bbac-a870cdf36731\") " pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:46:49.035417 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.035324    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1a9511e5-7e16-4392-bbac-a870cdf36731-secret-metrics-server-client-certs\") pod \"metrics-server-7cf5c88d78-gkqb7\" (UID: \"1a9511e5-7e16-4392-bbac-a870cdf36731\") " pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:46:49.035417 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.035349    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1a9511e5-7e16-4392-bbac-a870cdf36731-audit-log\") pod \"metrics-server-7cf5c88d78-gkqb7\" (UID: \"1a9511e5-7e16-4392-bbac-a870cdf36731\") " pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:46:49.035515 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.035493    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a9511e5-7e16-4392-bbac-a870cdf36731-client-ca-bundle\") pod \"metrics-server-7cf5c88d78-gkqb7\" (UID: \"1a9511e5-7e16-4392-bbac-a870cdf36731\") " pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:46:49.035597 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.035580    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1a9511e5-7e16-4392-bbac-a870cdf36731-secret-metrics-server-tls\") pod \"metrics-server-7cf5c88d78-gkqb7\" (UID: \"1a9511e5-7e16-4392-bbac-a870cdf36731\") " pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:46:49.035650 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.035621    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7fml\" (UniqueName: \"kubernetes.io/projected/1a9511e5-7e16-4392-bbac-a870cdf36731-kube-api-access-g7fml\") pod \"metrics-server-7cf5c88d78-gkqb7\" (UID: \"1a9511e5-7e16-4392-bbac-a870cdf36731\") " pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:46:49.035698 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.035649    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1a9511e5-7e16-4392-bbac-a870cdf36731-metrics-server-audit-profiles\") pod \"metrics-server-7cf5c88d78-gkqb7\" (UID: \"1a9511e5-7e16-4392-bbac-a870cdf36731\") " pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:46:49.136176 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.136075    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a9511e5-7e16-4392-bbac-a870cdf36731-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cf5c88d78-gkqb7\" (UID: \"1a9511e5-7e16-4392-bbac-a870cdf36731\") " pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:46:49.136176 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.136127    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3f4de02-9de1-4a96-b990-d8ea76e72bcf-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-bk4sn\" (UID: \"e3f4de02-9de1-4a96-b990-d8ea76e72bcf\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bk4sn"
Jul 09 18:46:49.136176 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.136149    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1a9511e5-7e16-4392-bbac-a870cdf36731-secret-metrics-server-client-certs\") pod \"metrics-server-7cf5c88d78-gkqb7\" (UID: \"1a9511e5-7e16-4392-bbac-a870cdf36731\") " pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:46:49.136449 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.136183    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1a9511e5-7e16-4392-bbac-a870cdf36731-audit-log\") pod \"metrics-server-7cf5c88d78-gkqb7\" (UID: \"1a9511e5-7e16-4392-bbac-a870cdf36731\") " pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:46:49.136449 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.136255    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrg58\" (UniqueName: \"kubernetes.io/projected/e3f4de02-9de1-4a96-b990-d8ea76e72bcf-kube-api-access-mrg58\") pod \"monitoring-plugin-5f68df7f58-bk4sn\" (UID: \"e3f4de02-9de1-4a96-b990-d8ea76e72bcf\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bk4sn"
Jul 09 18:46:49.136449 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.136284    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a9511e5-7e16-4392-bbac-a870cdf36731-client-ca-bundle\") pod \"metrics-server-7cf5c88d78-gkqb7\" (UID: \"1a9511e5-7e16-4392-bbac-a870cdf36731\") " pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:46:49.136449 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.136389    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1a9511e5-7e16-4392-bbac-a870cdf36731-secret-metrics-server-tls\") pod \"metrics-server-7cf5c88d78-gkqb7\" (UID: \"1a9511e5-7e16-4392-bbac-a870cdf36731\") " pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:46:49.136449 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.136441    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7fml\" (UniqueName: \"kubernetes.io/projected/1a9511e5-7e16-4392-bbac-a870cdf36731-kube-api-access-g7fml\") pod \"metrics-server-7cf5c88d78-gkqb7\" (UID: \"1a9511e5-7e16-4392-bbac-a870cdf36731\") " pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:46:49.136695 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.136474    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1a9511e5-7e16-4392-bbac-a870cdf36731-metrics-server-audit-profiles\") pod \"metrics-server-7cf5c88d78-gkqb7\" (UID: \"1a9511e5-7e16-4392-bbac-a870cdf36731\") " pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:46:49.136749 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.136718    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1a9511e5-7e16-4392-bbac-a870cdf36731-audit-log\") pod \"metrics-server-7cf5c88d78-gkqb7\" (UID: \"1a9511e5-7e16-4392-bbac-a870cdf36731\") " pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:46:49.136987 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.136961    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a9511e5-7e16-4392-bbac-a870cdf36731-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cf5c88d78-gkqb7\" (UID: \"1a9511e5-7e16-4392-bbac-a870cdf36731\") " pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:46:49.137517 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.137476    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1a9511e5-7e16-4392-bbac-a870cdf36731-metrics-server-audit-profiles\") pod \"metrics-server-7cf5c88d78-gkqb7\" (UID: \"1a9511e5-7e16-4392-bbac-a870cdf36731\") " pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:46:49.139287 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.139268    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a9511e5-7e16-4392-bbac-a870cdf36731-client-ca-bundle\") pod \"metrics-server-7cf5c88d78-gkqb7\" (UID: \"1a9511e5-7e16-4392-bbac-a870cdf36731\") " pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:46:49.139543 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.139516    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1a9511e5-7e16-4392-bbac-a870cdf36731-secret-metrics-server-tls\") pod \"metrics-server-7cf5c88d78-gkqb7\" (UID: \"1a9511e5-7e16-4392-bbac-a870cdf36731\") " pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:46:49.139931 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.139912    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1a9511e5-7e16-4392-bbac-a870cdf36731-secret-metrics-server-client-certs\") pod \"metrics-server-7cf5c88d78-gkqb7\" (UID: \"1a9511e5-7e16-4392-bbac-a870cdf36731\") " pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:46:49.156676 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.156651    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7fml\" (UniqueName: \"kubernetes.io/projected/1a9511e5-7e16-4392-bbac-a870cdf36731-kube-api-access-g7fml\") pod \"metrics-server-7cf5c88d78-gkqb7\" (UID: \"1a9511e5-7e16-4392-bbac-a870cdf36731\") " pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:46:49.235266 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.235228    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:46:49.237505 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.237483    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrg58\" (UniqueName: \"kubernetes.io/projected/e3f4de02-9de1-4a96-b990-d8ea76e72bcf-kube-api-access-mrg58\") pod \"monitoring-plugin-5f68df7f58-bk4sn\" (UID: \"e3f4de02-9de1-4a96-b990-d8ea76e72bcf\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bk4sn"
Jul 09 18:46:49.237584 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.237563    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3f4de02-9de1-4a96-b990-d8ea76e72bcf-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-bk4sn\" (UID: \"e3f4de02-9de1-4a96-b990-d8ea76e72bcf\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bk4sn"
Jul 09 18:46:49.240132 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.240090    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3f4de02-9de1-4a96-b990-d8ea76e72bcf-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-bk4sn\" (UID: \"e3f4de02-9de1-4a96-b990-d8ea76e72bcf\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bk4sn"
Jul 09 18:46:49.257778 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.257749    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrg58\" (UniqueName: \"kubernetes.io/projected/e3f4de02-9de1-4a96-b990-d8ea76e72bcf-kube-api-access-mrg58\") pod \"monitoring-plugin-5f68df7f58-bk4sn\" (UID: \"e3f4de02-9de1-4a96-b990-d8ea76e72bcf\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bk4sn"
Jul 09 18:46:49.269212 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.269182    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-pnfzt"]
Jul 09 18:46:49.273660 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.273637    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-pnfzt"
Jul 09 18:46:49.280341 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.280315    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 18:46:49.280742 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.280691    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-cf6cj\""
Jul 09 18:46:49.281234 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.281169    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 18:46:49.302125 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.302049    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-pnfzt"]
Jul 09 18:46:49.320016 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.319978    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bk4sn"
Jul 09 18:46:49.338734 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.338539    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s85zs\" (UniqueName: \"kubernetes.io/projected/e1b91068-b1a8-4128-8c0d-59ee1bb15b04-kube-api-access-s85zs\") pod \"downloads-68c9cbb497-pnfzt\" (UID: \"e1b91068-b1a8-4128-8c0d-59ee1bb15b04\") " pod="openshift-console/downloads-68c9cbb497-pnfzt"
Jul 09 18:46:49.403412 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.403296    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"]
Jul 09 18:46:49.407052 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:46:49.407026    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a9511e5_7e16_4392_bbac_a870cdf36731.slice/crio-45964c539d662b947fbd31b5a193d98c46acec4ff9f598b095e7408dfd34e23c WatchSource:0}: Error finding container 45964c539d662b947fbd31b5a193d98c46acec4ff9f598b095e7408dfd34e23c: Status 404 returned error can't find the container with id 45964c539d662b947fbd31b5a193d98c46acec4ff9f598b095e7408dfd34e23c
Jul 09 18:46:49.439451 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.439411    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s85zs\" (UniqueName: \"kubernetes.io/projected/e1b91068-b1a8-4128-8c0d-59ee1bb15b04-kube-api-access-s85zs\") pod \"downloads-68c9cbb497-pnfzt\" (UID: \"e1b91068-b1a8-4128-8c0d-59ee1bb15b04\") " pod="openshift-console/downloads-68c9cbb497-pnfzt"
Jul 09 18:46:49.450953 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.450919    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s85zs\" (UniqueName: \"kubernetes.io/projected/e1b91068-b1a8-4128-8c0d-59ee1bb15b04-kube-api-access-s85zs\") pod \"downloads-68c9cbb497-pnfzt\" (UID: \"e1b91068-b1a8-4128-8c0d-59ee1bb15b04\") " pod="openshift-console/downloads-68c9cbb497-pnfzt"
Jul 09 18:46:49.474003 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.473962    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-bk4sn"]
Jul 09 18:46:49.478131 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:46:49.478103    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3f4de02_9de1_4a96_b990_d8ea76e72bcf.slice/crio-687f6087c43653ce79cc420d6d515d179b37ba028b7a31e455cbbe80645e94a1 WatchSource:0}: Error finding container 687f6087c43653ce79cc420d6d515d179b37ba028b7a31e455cbbe80645e94a1: Status 404 returned error can't find the container with id 687f6087c43653ce79cc420d6d515d179b37ba028b7a31e455cbbe80645e94a1
Jul 09 18:46:49.586387 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.586173    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67c9866758-xqg89" event={"ID":"25590d78-0735-4607-b442-97f364905500","Type":"ContainerStarted","Data":"a94dbf1b1a6a691742c8199e085c0b8b53098cbd7ffff8142683f9587a6526ad"}
Jul 09 18:46:49.586387 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.586268    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67c9866758-xqg89" event={"ID":"25590d78-0735-4607-b442-97f364905500","Type":"ContainerStarted","Data":"97d9ad56c00158b09f6007ee016770e5dce5809f2997a4145e90af33c516cbfe"}
Jul 09 18:46:49.586387 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.586313    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67c9866758-xqg89" event={"ID":"25590d78-0735-4607-b442-97f364905500","Type":"ContainerStarted","Data":"2c71f9d0d806123a36a0918e0083ed7094ae4d2080557d50c41ab93965c93510"}
Jul 09 18:46:49.586387 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.586346    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-pnfzt"
Jul 09 18:46:49.587506 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.587473    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bk4sn" event={"ID":"e3f4de02-9de1-4a96-b990-d8ea76e72bcf","Type":"ContainerStarted","Data":"687f6087c43653ce79cc420d6d515d179b37ba028b7a31e455cbbe80645e94a1"}
Jul 09 18:46:49.588810 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.588783    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7" event={"ID":"1a9511e5-7e16-4392-bbac-a870cdf36731","Type":"ContainerStarted","Data":"45964c539d662b947fbd31b5a193d98c46acec4ff9f598b095e7408dfd34e23c"}
Jul 09 18:46:49.865347 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:49.865320    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-pnfzt"]
Jul 09 18:46:50.108432 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:46:50.108359    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1b91068_b1a8_4128_8c0d_59ee1bb15b04.slice/crio-507a71321d7bceaa8ad4b444b5e3b8190d47a7aeadc39ae08a5e3208636eb8fe WatchSource:0}: Error finding container 507a71321d7bceaa8ad4b444b5e3b8190d47a7aeadc39ae08a5e3208636eb8fe: Status 404 returned error can't find the container with id 507a71321d7bceaa8ad4b444b5e3b8190d47a7aeadc39ae08a5e3208636eb8fe
Jul 09 18:46:50.600873 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.600204    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67c9866758-xqg89" event={"ID":"25590d78-0735-4607-b442-97f364905500","Type":"ContainerStarted","Data":"a9ab74ae01f0616dd83f262819eb2d2f99093e3122e1c1a27f86adf87fa2e65b"}
Jul 09 18:46:50.600873 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.600358    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:46:50.600873 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.600406    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67c9866758-xqg89" event={"ID":"25590d78-0735-4607-b442-97f364905500","Type":"ContainerStarted","Data":"d32fc76df26ec04726d1bf840132844b323c42772cead883fe1b3267b8f7af56"}
Jul 09 18:46:50.600873 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.600450    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67c9866758-xqg89" event={"ID":"25590d78-0735-4607-b442-97f364905500","Type":"ContainerStarted","Data":"abcd51af52209a3e93678f8558446cd597913fa862ab4e56400ef3338ad39d62"}
Jul 09 18:46:50.611244 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.608603    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db61830b-ad33-46dd-be6a-9580e3603a56","Type":"ContainerStarted","Data":"f8c984ff67ab94f0e26f6194381a44f55e5260988bd3f906e220ca5fbbbca2c5"}
Jul 09 18:46:50.611244 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.608681    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db61830b-ad33-46dd-be6a-9580e3603a56","Type":"ContainerStarted","Data":"97548178e27eff5ff1eae777b33c61d5c846efc91fc3fd8e354a025df118169c"}
Jul 09 18:46:50.611244 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.608724    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db61830b-ad33-46dd-be6a-9580e3603a56","Type":"ContainerStarted","Data":"f65f1e109e7f84163a6e80e334622c4508b5b75296ac0a198f949c029d29f32a"}
Jul 09 18:46:50.611244 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.608763    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db61830b-ad33-46dd-be6a-9580e3603a56","Type":"ContainerStarted","Data":"09764f89077459a9906e5992da27d5d462a7175f41765b39c1a2362113ad34c5"}
Jul 09 18:46:50.611244 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.608801    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db61830b-ad33-46dd-be6a-9580e3603a56","Type":"ContainerStarted","Data":"ec02212b22f3941236a18b060c9a57394f340589c5ca530399291b8162934b11"}
Jul 09 18:46:50.611244 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.608864    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db61830b-ad33-46dd-be6a-9580e3603a56","Type":"ContainerStarted","Data":"0ccca9ae6cd8576bc9cdecaed237cc8a22ad7473be4a5be441ace3bf389f5bc0"}
Jul 09 18:46:50.612505 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.612372    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-pnfzt" event={"ID":"e1b91068-b1a8-4128-8c0d-59ee1bb15b04","Type":"ContainerStarted","Data":"507a71321d7bceaa8ad4b444b5e3b8190d47a7aeadc39ae08a5e3208636eb8fe"}
Jul 09 18:46:50.640620 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.640504    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-67c9866758-xqg89" podStartSLOduration=1.6479357129999999 podStartE2EDuration="4.640481778s" totalImagesPullingTime="2.992546065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:50.639073786 +0000 UTC m=+65.848663004" watchObservedRunningTime="2026-07-09 18:46:50.640481778 +0000 UTC m=+65.850070996"
Jul 09 18:46:50.702464 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.701631    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.546523095 podStartE2EDuration="5.701610117s" totalImagesPullingTime="3.13677941s" totalInitContainerRuntime="18.307612ms" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:50.700041717 +0000 UTC m=+65.909630938" watchObservedRunningTime="2026-07-09 18:46:50.701610117 +0000 UTC m=+65.911199337"
Jul 09 18:46:50.888770 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.888269    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 18:46:50.931560 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.926235    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 18:46:50.931560 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.926418    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:50.944850 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.938958    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 09 18:46:50.944850 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.939269    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 09 18:46:50.944850 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.939512    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9ag6ipukpunhb\""
Jul 09 18:46:50.944850 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.940228    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 09 18:46:50.944850 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.940441    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 09 18:46:50.944850 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.940718    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 09 18:46:50.944850 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.942758    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 09 18:46:50.944850 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.943093    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 09 18:46:50.944850 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.943322    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 09 18:46:50.944850 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.943975    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jxrdn\""
Jul 09 18:46:50.945848 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.945721    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 09 18:46:50.946221 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.946081    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 09 18:46:50.946221 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.946101    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 09 18:46:50.946379 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.946313    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 09 18:46:50.946601 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.946476    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 09 18:46:50.952030 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:50.952008    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 09 18:46:51.059150 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.059115    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c7398dc-4de4-4edd-8af8-c9539902ea0b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.059150 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.059157    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.059507 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.059185    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.059507 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.059235    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/493326cf-6bd0-480f-b459-66089efc73c8-original-pull-secret\") pod \"global-pull-secret-syncer-8zclz\" (UID: \"493326cf-6bd0-480f-b459-66089efc73c8\") " pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:46:51.059507 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.059264    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c7398dc-4de4-4edd-8af8-c9539902ea0b-config-out\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.059507 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.059323    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.059507 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.059485    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-web-config\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.059677 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.059536    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.059677 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.059605    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.059737 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.059678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/409661cb-d599-4f25-a45b-58c69fd015f8-metrics-certs\") pod \"network-metrics-daemon-c4kbs\" (UID: \"409661cb-d599-4f25-a45b-58c69fd015f8\") " pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:46:51.059737 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.059710    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-config\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.059796 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.059761    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.059846 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.059807    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.059879 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.059858    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktzl8\" (UniqueName: \"kubernetes.io/projected/7c7398dc-4de4-4edd-8af8-c9539902ea0b-kube-api-access-ktzl8\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.059908 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.059896    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.059937 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.059919    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.059973 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.059948    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.060003 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.059972    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.060040 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.060013    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.060129 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.060100    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.060199 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.060135    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.060199 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.060171    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.062592 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.062407    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 18:46:51.062592 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.062524    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 18:46:51.072549 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.072524    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/493326cf-6bd0-480f-b459-66089efc73c8-original-pull-secret\") pod \"global-pull-secret-syncer-8zclz\" (UID: \"493326cf-6bd0-480f-b459-66089efc73c8\") " pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:46:51.072686 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.072658    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/409661cb-d599-4f25-a45b-58c69fd015f8-metrics-certs\") pod \"network-metrics-daemon-c4kbs\" (UID: \"409661cb-d599-4f25-a45b-58c69fd015f8\") " pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:46:51.161664 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.161627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.161907 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.161676    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.161907 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.161701    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.161907 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.161723    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.161907 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.161755    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.161907 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.161796    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cnts\" (UniqueName: \"kubernetes.io/projected/be0a5922-6e9a-4314-bb47-e68afc2cdc7b-kube-api-access-8cnts\") pod \"network-check-target-5rkc2\" (UID: \"be0a5922-6e9a-4314-bb47-e68afc2cdc7b\") " pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:46:51.161907 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.161839    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.161907 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.161863    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.161907 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.161895    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.162356 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.161937    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c7398dc-4de4-4edd-8af8-c9539902ea0b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.162356 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.161962    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.162356 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.161990    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.162356 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.162033    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c7398dc-4de4-4edd-8af8-c9539902ea0b-config-out\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.162356 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.162058    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.162356 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.162082    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-web-config\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.162356 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.162106    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.162695 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.162554    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.165771 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.164219    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.166782 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.166174    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.168030 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.167310    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.168030 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.167742    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.168030 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.167979    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.169905 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.168855    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.169905 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.168921    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-config\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.169905 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.169100    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.169905 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.169147    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.169905 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.169317    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktzl8\" (UniqueName: \"kubernetes.io/projected/7c7398dc-4de4-4edd-8af8-c9539902ea0b-kube-api-access-ktzl8\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.173998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.170551    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 18:46:51.173998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.171147    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c7398dc-4de4-4edd-8af8-c9539902ea0b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.173998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.171282    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.173998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.171871    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.173998 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.173309    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-config\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.177541 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.176040    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-web-config\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.177541 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.176663    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.180562 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.180531    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 18:46:51.181803 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.181209    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c7398dc-4de4-4edd-8af8-c9539902ea0b-config-out\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.181803 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.181411    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.181803 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.181723    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.182024 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.181970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.182462 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.182435    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.184021 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.183997    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.187042 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.187018    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.187668 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.187644    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktzl8\" (UniqueName: \"kubernetes.io/projected/7c7398dc-4de4-4edd-8af8-c9539902ea0b-kube-api-access-ktzl8\") pod \"prometheus-k8s-0\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.189397 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.189377    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cnts\" (UniqueName: \"kubernetes.io/projected/be0a5922-6e9a-4314-bb47-e68afc2cdc7b-kube-api-access-8cnts\") pod \"network-check-target-5rkc2\" (UID: \"be0a5922-6e9a-4314-bb47-e68afc2cdc7b\") " pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:46:51.255088 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.255052    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:46:51.257264 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.257223    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zclz"
Jul 09 18:46:51.265921 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.265889    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ckpt2\""
Jul 09 18:46:51.270281 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.269710    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-prgmc\""
Jul 09 18:46:51.274584 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.274515    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kbs"
Jul 09 18:46:51.277671 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:51.277644    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:46:52.435016 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:52.434689    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8zclz"]
Jul 09 18:46:52.523559 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:52.523488    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c4kbs"]
Jul 09 18:46:52.526430 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:46:52.526406    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod409661cb_d599_4f25_a45b_58c69fd015f8.slice/crio-ef685e4ae852fd354ed5ae5d9b025353d141b91c00e130278a9706441dcebd01 WatchSource:0}: Error finding container ef685e4ae852fd354ed5ae5d9b025353d141b91c00e130278a9706441dcebd01: Status 404 returned error can't find the container with id ef685e4ae852fd354ed5ae5d9b025353d141b91c00e130278a9706441dcebd01
Jul 09 18:46:52.623365 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:52.623048    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bk4sn" event={"ID":"e3f4de02-9de1-4a96-b990-d8ea76e72bcf","Type":"ContainerStarted","Data":"159e189b6852d7a2db6cd92af2e346608613cf04ee798caa113d617939243838"}
Jul 09 18:46:52.623365 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:52.623332    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bk4sn"
Jul 09 18:46:52.625304 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:52.624865    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7" event={"ID":"1a9511e5-7e16-4392-bbac-a870cdf36731","Type":"ContainerStarted","Data":"1226d0d99472bd6001c51c73a72b48438616bc8466dc7b5442e257e08fb3dd04"}
Jul 09 18:46:52.627196 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:52.627165    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8zclz" event={"ID":"493326cf-6bd0-480f-b459-66089efc73c8","Type":"ContainerStarted","Data":"c06b5d66937d7b9a677b2dc69e32f12d98ddf5717be8616a3e1a9b0b519fc222"}
Jul 09 18:46:52.628771 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:52.628736    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c4kbs" event={"ID":"409661cb-d599-4f25-a45b-58c69fd015f8","Type":"ContainerStarted","Data":"ef685e4ae852fd354ed5ae5d9b025353d141b91c00e130278a9706441dcebd01"}
Jul 09 18:46:52.631157 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:52.631138    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bk4sn"
Jul 09 18:46:52.673017 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:52.672958    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bk4sn" podStartSLOduration=1.898107752 podStartE2EDuration="4.672936402s" totalImagesPullingTime="2.77482865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:52.646215903 +0000 UTC m=+67.855805123" watchObservedRunningTime="2026-07-09 18:46:52.672936402 +0000 UTC m=+67.882525612"
Jul 09 18:46:52.674519 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:52.674423    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5rkc2"]
Jul 09 18:46:52.675864 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:52.675617    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7" podStartSLOduration=1.835877161 podStartE2EDuration="4.675600484s" totalImagesPullingTime="2.839723323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:52.674294085 +0000 UTC m=+67.883883305" watchObservedRunningTime="2026-07-09 18:46:52.675600484 +0000 UTC m=+67.885189704"
Jul 09 18:46:52.676674 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:46:52.676648    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe0a5922_6e9a_4314_bb47_e68afc2cdc7b.slice/crio-b17804b4a24363c0fd5daf920a1d845077cd563d50349d9c48e69d6f1e8427fb WatchSource:0}: Error finding container b17804b4a24363c0fd5daf920a1d845077cd563d50349d9c48e69d6f1e8427fb: Status 404 returned error can't find the container with id b17804b4a24363c0fd5daf920a1d845077cd563d50349d9c48e69d6f1e8427fb
Jul 09 18:46:52.686907 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:52.686881    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 18:46:52.691006 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:46:52.690979    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c7398dc_4de4_4edd_8af8_c9539902ea0b.slice/crio-79251d5ea06b827c8a286b48aaf7ffec514f2bc7fd4de30bb643fc241bedb6ee WatchSource:0}: Error finding container 79251d5ea06b827c8a286b48aaf7ffec514f2bc7fd4de30bb643fc241bedb6ee: Status 404 returned error can't find the container with id 79251d5ea06b827c8a286b48aaf7ffec514f2bc7fd4de30bb643fc241bedb6ee
Jul 09 18:46:53.636460 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:53.636415    2580 generic.go:356] "Generic (PLEG): container finished" podID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerID="5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a" exitCode=0
Jul 09 18:46:53.636947 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:53.636646    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c7398dc-4de4-4edd-8af8-c9539902ea0b","Type":"ContainerDied","Data":"5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a"}
Jul 09 18:46:53.636947 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:53.636745    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c7398dc-4de4-4edd-8af8-c9539902ea0b","Type":"ContainerStarted","Data":"79251d5ea06b827c8a286b48aaf7ffec514f2bc7fd4de30bb643fc241bedb6ee"}
Jul 09 18:46:53.639697 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:53.639675    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5rkc2" event={"ID":"be0a5922-6e9a-4314-bb47-e68afc2cdc7b","Type":"ContainerStarted","Data":"b17804b4a24363c0fd5daf920a1d845077cd563d50349d9c48e69d6f1e8427fb"}
Jul 09 18:46:54.651036 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:54.650917    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c4kbs" event={"ID":"409661cb-d599-4f25-a45b-58c69fd015f8","Type":"ContainerStarted","Data":"77329f0a276571b6db31df9b6d75a7e47f8539f2609a98d6677e793cf4afacaa"}
Jul 09 18:46:54.651036 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:54.650989    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c4kbs" event={"ID":"409661cb-d599-4f25-a45b-58c69fd015f8","Type":"ContainerStarted","Data":"6de1af39a15d7362a1bb6019436d7c4bf36e16b12b3dce2a92ee19c84dd62c73"}
Jul 09 18:46:54.677515 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:54.677450    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-c4kbs" podStartSLOduration=67.419865557 podStartE2EDuration="1m8.677430164s" totalImagesPullingTime="1.257564607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:45:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:54.676867924 +0000 UTC m=+69.886457142" watchObservedRunningTime="2026-07-09 18:46:54.677430164 +0000 UTC m=+69.887019382"
Jul 09 18:46:56.624247 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:46:56.624216    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-67c9866758-xqg89"
Jul 09 18:47:00.686516 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:47:00.686351    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8zclz" event={"ID":"493326cf-6bd0-480f-b459-66089efc73c8","Type":"ContainerStarted","Data":"c225fd507cb6f63ffa0b19d814a987ff848b4605a643ddc3fac2a9bee78b167a"}
Jul 09 18:47:00.689273 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:47:00.688987    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5rkc2" event={"ID":"be0a5922-6e9a-4314-bb47-e68afc2cdc7b","Type":"ContainerStarted","Data":"e19a8c26c03ef7aa8ff4dcff416b9fcc704ab89d6f07b7f2032f153217dff9d4"}
Jul 09 18:47:00.689273 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:47:00.689064    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:47:00.694211 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:47:00.694187    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c7398dc-4de4-4edd-8af8-c9539902ea0b","Type":"ContainerStarted","Data":"c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34"}
Jul 09 18:47:00.694325 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:47:00.694258    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c7398dc-4de4-4edd-8af8-c9539902ea0b","Type":"ContainerStarted","Data":"ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b"}
Jul 09 18:47:00.694325 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:47:00.694289    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c7398dc-4de4-4edd-8af8-c9539902ea0b","Type":"ContainerStarted","Data":"7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8"}
Jul 09 18:47:00.694325 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:47:00.694313    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c7398dc-4de4-4edd-8af8-c9539902ea0b","Type":"ContainerStarted","Data":"1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f"}
Jul 09 18:47:00.694488 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:47:00.694335    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c7398dc-4de4-4edd-8af8-c9539902ea0b","Type":"ContainerStarted","Data":"4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4"}
Jul 09 18:47:00.711227 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:47:00.711178    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8zclz" podStartSLOduration=66.947092259 podStartE2EDuration="1m14.711161147s" totalImagesPullingTime="7.764068888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:45:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:47:00.709260937 +0000 UTC m=+75.918850156" watchObservedRunningTime="2026-07-09 18:47:00.711161147 +0000 UTC m=+75.920750375"
Jul 09 18:47:00.731851 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:47:00.731328    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5rkc2" podStartSLOduration=67.215740517 podStartE2EDuration="1m14.731310522s" totalImagesPullingTime="7.515570005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:45:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:47:00.730164886 +0000 UTC m=+75.939754098" watchObservedRunningTime="2026-07-09 18:47:00.731310522 +0000 UTC m=+75.940899739"
Jul 09 18:47:01.702019 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:47:01.701986    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c7398dc-4de4-4edd-8af8-c9539902ea0b","Type":"ContainerStarted","Data":"8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4"}
Jul 09 18:47:01.751266 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:47:01.751206    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.161441277 podStartE2EDuration="11.751181066s" totalImagesPullingTime="6.567438797s" totalInitContainerRuntime="22.300992ms" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:47:01.749102419 +0000 UTC m=+76.958691680" watchObservedRunningTime="2026-07-09 18:47:01.751181066 +0000 UTC m=+76.960770286"
Jul 09 18:47:06.256373 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:47:06.256335    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:47:09.235980 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:47:09.235819    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:47:09.235980 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:47:09.235910    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:47:11.752324 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:47:11.752279    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-pnfzt" event={"ID":"e1b91068-b1a8-4128-8c0d-59ee1bb15b04","Type":"ContainerStarted","Data":"a48c14c5fb589dc8bf820fe62af2c05bdb7322199c31dc64949134c4df4dda67"}
Jul 09 18:47:11.752854 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:47:11.752475    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-pnfzt"
Jul 09 18:47:11.767471 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:47:11.767440    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-pnfzt"
Jul 09 18:47:11.777554 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:47:11.777498    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-pnfzt" podStartSLOduration=1.988949745 podStartE2EDuration="22.777478311s" totalImagesPullingTime="20.788528566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:47:11.776538201 +0000 UTC m=+86.986127420" watchObservedRunningTime="2026-07-09 18:47:11.777478311 +0000 UTC m=+86.987067530"
Jul 09 18:47:29.241494 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:47:29.241463    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:47:29.245548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:47:29.245521    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7cf5c88d78-gkqb7"
Jul 09 18:47:31.705057 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:47:31.705030    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5rkc2"
Jul 09 18:47:51.256228 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:47:51.256194    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:47:51.306734 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:47:51.306703    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:47:51.938454 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:47:51.938429    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:04.929667 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:04.929625    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 18:48:04.930173 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:04.930021    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="alertmanager" containerID="cri-o://0ccca9ae6cd8576bc9cdecaed237cc8a22ad7473be4a5be441ace3bf389f5bc0" gracePeriod=120
Jul 09 18:48:04.930173 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:04.930079    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="kube-rbac-proxy-web" containerID="cri-o://09764f89077459a9906e5992da27d5d462a7175f41765b39c1a2362113ad34c5" gracePeriod=120
Jul 09 18:48:04.930173 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:04.930123    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="prom-label-proxy" containerID="cri-o://f8c984ff67ab94f0e26f6194381a44f55e5260988bd3f906e220ca5fbbbca2c5" gracePeriod=120
Jul 09 18:48:04.930173 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:04.930128    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="kube-rbac-proxy" containerID="cri-o://f65f1e109e7f84163a6e80e334622c4508b5b75296ac0a198f949c029d29f32a" gracePeriod=120
Jul 09 18:48:04.930173 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:04.930150    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="config-reloader" containerID="cri-o://ec02212b22f3941236a18b060c9a57394f340589c5ca530399291b8162934b11" gracePeriod=120
Jul 09 18:48:04.930406 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:04.930086    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="kube-rbac-proxy-metric" containerID="cri-o://97548178e27eff5ff1eae777b33c61d5c846efc91fc3fd8e354a025df118169c" gracePeriod=120
Jul 09 18:48:05.981570 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:05.981533    2580 generic.go:356] "Generic (PLEG): container finished" podID="db61830b-ad33-46dd-be6a-9580e3603a56" containerID="f8c984ff67ab94f0e26f6194381a44f55e5260988bd3f906e220ca5fbbbca2c5" exitCode=0
Jul 09 18:48:05.981570 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:05.981557    2580 generic.go:356] "Generic (PLEG): container finished" podID="db61830b-ad33-46dd-be6a-9580e3603a56" containerID="f65f1e109e7f84163a6e80e334622c4508b5b75296ac0a198f949c029d29f32a" exitCode=0
Jul 09 18:48:05.981570 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:05.981563    2580 generic.go:356] "Generic (PLEG): container finished" podID="db61830b-ad33-46dd-be6a-9580e3603a56" containerID="ec02212b22f3941236a18b060c9a57394f340589c5ca530399291b8162934b11" exitCode=0
Jul 09 18:48:05.981570 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:05.981569    2580 generic.go:356] "Generic (PLEG): container finished" podID="db61830b-ad33-46dd-be6a-9580e3603a56" containerID="0ccca9ae6cd8576bc9cdecaed237cc8a22ad7473be4a5be441ace3bf389f5bc0" exitCode=0
Jul 09 18:48:05.982045 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:05.981601    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db61830b-ad33-46dd-be6a-9580e3603a56","Type":"ContainerDied","Data":"f8c984ff67ab94f0e26f6194381a44f55e5260988bd3f906e220ca5fbbbca2c5"}
Jul 09 18:48:05.982045 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:05.981665    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db61830b-ad33-46dd-be6a-9580e3603a56","Type":"ContainerDied","Data":"f65f1e109e7f84163a6e80e334622c4508b5b75296ac0a198f949c029d29f32a"}
Jul 09 18:48:05.982045 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:05.981694    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db61830b-ad33-46dd-be6a-9580e3603a56","Type":"ContainerDied","Data":"ec02212b22f3941236a18b060c9a57394f340589c5ca530399291b8162934b11"}
Jul 09 18:48:05.982045 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:05.981720    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db61830b-ad33-46dd-be6a-9580e3603a56","Type":"ContainerDied","Data":"0ccca9ae6cd8576bc9cdecaed237cc8a22ad7473be4a5be441ace3bf389f5bc0"}
Jul 09 18:48:06.186913 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.186890    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:06.271486 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.271397    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-secret-alertmanager-main-tls\") pod \"db61830b-ad33-46dd-be6a-9580e3603a56\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") "
Jul 09 18:48:06.271645 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.271483    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-cluster-tls-config\") pod \"db61830b-ad33-46dd-be6a-9580e3603a56\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") "
Jul 09 18:48:06.271645 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.271535    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/db61830b-ad33-46dd-be6a-9580e3603a56-alertmanager-main-db\") pod \"db61830b-ad33-46dd-be6a-9580e3603a56\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") "
Jul 09 18:48:06.271645 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.271599    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-secret-alertmanager-kube-rbac-proxy-metric\") pod \"db61830b-ad33-46dd-be6a-9580e3603a56\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") "
Jul 09 18:48:06.271975 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.271953    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-secret-alertmanager-kube-rbac-proxy-web\") pod \"db61830b-ad33-46dd-be6a-9580e3603a56\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") "
Jul 09 18:48:06.272067 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.271992    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-web-config\") pod \"db61830b-ad33-46dd-be6a-9580e3603a56\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") "
Jul 09 18:48:06.272067 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.272023    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db61830b-ad33-46dd-be6a-9580e3603a56-config-out\") pod \"db61830b-ad33-46dd-be6a-9580e3603a56\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") "
Jul 09 18:48:06.272067 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.272049    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db61830b-ad33-46dd-be6a-9580e3603a56-tls-assets\") pod \"db61830b-ad33-46dd-be6a-9580e3603a56\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") "
Jul 09 18:48:06.272236 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.272089    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-config-volume\") pod \"db61830b-ad33-46dd-be6a-9580e3603a56\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") "
Jul 09 18:48:06.272236 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.272118    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qb9h\" (UniqueName: \"kubernetes.io/projected/db61830b-ad33-46dd-be6a-9580e3603a56-kube-api-access-8qb9h\") pod \"db61830b-ad33-46dd-be6a-9580e3603a56\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") "
Jul 09 18:48:06.272236 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.272150    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db61830b-ad33-46dd-be6a-9580e3603a56-alertmanager-trusted-ca-bundle\") pod \"db61830b-ad33-46dd-be6a-9580e3603a56\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") "
Jul 09 18:48:06.272236 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.272222    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db61830b-ad33-46dd-be6a-9580e3603a56-metrics-client-ca\") pod \"db61830b-ad33-46dd-be6a-9580e3603a56\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") "
Jul 09 18:48:06.272443 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.272248    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-secret-alertmanager-kube-rbac-proxy\") pod \"db61830b-ad33-46dd-be6a-9580e3603a56\" (UID: \"db61830b-ad33-46dd-be6a-9580e3603a56\") "
Jul 09 18:48:06.272548 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.272014    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db61830b-ad33-46dd-be6a-9580e3603a56-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "db61830b-ad33-46dd-be6a-9580e3603a56" (UID: "db61830b-ad33-46dd-be6a-9580e3603a56"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:48:06.273494 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.273434    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db61830b-ad33-46dd-be6a-9580e3603a56-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "db61830b-ad33-46dd-be6a-9580e3603a56" (UID: "db61830b-ad33-46dd-be6a-9580e3603a56"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:48:06.273494 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.273477    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db61830b-ad33-46dd-be6a-9580e3603a56-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "db61830b-ad33-46dd-be6a-9580e3603a56" (UID: "db61830b-ad33-46dd-be6a-9580e3603a56"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:48:06.275456 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.275385    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db61830b-ad33-46dd-be6a-9580e3603a56-config-out" (OuterVolumeSpecName: "config-out") pod "db61830b-ad33-46dd-be6a-9580e3603a56" (UID: "db61830b-ad33-46dd-be6a-9580e3603a56"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:48:06.275590 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.275472    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "db61830b-ad33-46dd-be6a-9580e3603a56" (UID: "db61830b-ad33-46dd-be6a-9580e3603a56"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:48:06.276163 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.276112    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db61830b-ad33-46dd-be6a-9580e3603a56-kube-api-access-8qb9h" (OuterVolumeSpecName: "kube-api-access-8qb9h") pod "db61830b-ad33-46dd-be6a-9580e3603a56" (UID: "db61830b-ad33-46dd-be6a-9580e3603a56"). InnerVolumeSpecName "kube-api-access-8qb9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:48:06.276163 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.276130    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "db61830b-ad33-46dd-be6a-9580e3603a56" (UID: "db61830b-ad33-46dd-be6a-9580e3603a56"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:48:06.276421 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.276388    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "db61830b-ad33-46dd-be6a-9580e3603a56" (UID: "db61830b-ad33-46dd-be6a-9580e3603a56"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:48:06.276746 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.276712    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-config-volume" (OuterVolumeSpecName: "config-volume") pod "db61830b-ad33-46dd-be6a-9580e3603a56" (UID: "db61830b-ad33-46dd-be6a-9580e3603a56"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:48:06.277122 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.277074    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db61830b-ad33-46dd-be6a-9580e3603a56-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "db61830b-ad33-46dd-be6a-9580e3603a56" (UID: "db61830b-ad33-46dd-be6a-9580e3603a56"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:48:06.277787 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.277756    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "db61830b-ad33-46dd-be6a-9580e3603a56" (UID: "db61830b-ad33-46dd-be6a-9580e3603a56"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:48:06.281415 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.281390    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "db61830b-ad33-46dd-be6a-9580e3603a56" (UID: "db61830b-ad33-46dd-be6a-9580e3603a56"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:48:06.287376 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.287351    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-web-config" (OuterVolumeSpecName: "web-config") pod "db61830b-ad33-46dd-be6a-9580e3603a56" (UID: "db61830b-ad33-46dd-be6a-9580e3603a56"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:48:06.373586 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.373537    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:06.373586 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.373582    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-web-config\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:06.373586 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.373592    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db61830b-ad33-46dd-be6a-9580e3603a56-config-out\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:06.373806 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.373602    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db61830b-ad33-46dd-be6a-9580e3603a56-tls-assets\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:06.373806 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.373610    2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-config-volume\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:06.373806 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.373618    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qb9h\" (UniqueName: \"kubernetes.io/projected/db61830b-ad33-46dd-be6a-9580e3603a56-kube-api-access-8qb9h\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:06.373806 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.373627    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db61830b-ad33-46dd-be6a-9580e3603a56-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:06.373806 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.373635    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db61830b-ad33-46dd-be6a-9580e3603a56-metrics-client-ca\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:06.373806 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.373643    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:06.373806 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.373652    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-secret-alertmanager-main-tls\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:06.373806 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.373660    2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-cluster-tls-config\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:06.373806 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.373669    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/db61830b-ad33-46dd-be6a-9580e3603a56-alertmanager-main-db\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:06.373806 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.373677    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/db61830b-ad33-46dd-be6a-9580e3603a56-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:06.988339 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.988308    2580 generic.go:356] "Generic (PLEG): container finished" podID="db61830b-ad33-46dd-be6a-9580e3603a56" containerID="97548178e27eff5ff1eae777b33c61d5c846efc91fc3fd8e354a025df118169c" exitCode=0
Jul 09 18:48:06.988339 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.988334    2580 generic.go:356] "Generic (PLEG): container finished" podID="db61830b-ad33-46dd-be6a-9580e3603a56" containerID="09764f89077459a9906e5992da27d5d462a7175f41765b39c1a2362113ad34c5" exitCode=0
Jul 09 18:48:06.988859 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.988394    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:06.988859 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.988395    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db61830b-ad33-46dd-be6a-9580e3603a56","Type":"ContainerDied","Data":"97548178e27eff5ff1eae777b33c61d5c846efc91fc3fd8e354a025df118169c"}
Jul 09 18:48:06.988859 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.988502    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db61830b-ad33-46dd-be6a-9580e3603a56","Type":"ContainerDied","Data":"09764f89077459a9906e5992da27d5d462a7175f41765b39c1a2362113ad34c5"}
Jul 09 18:48:06.988859 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.988532    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db61830b-ad33-46dd-be6a-9580e3603a56","Type":"ContainerDied","Data":"46854957379d852b843421db438c120db43f2bb74a769b05124fce6f6b3ea94e"}
Jul 09 18:48:06.988859 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:06.988567    2580 scope.go:117] "RemoveContainer" containerID="f8c984ff67ab94f0e26f6194381a44f55e5260988bd3f906e220ca5fbbbca2c5"
Jul 09 18:48:07.003019 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.003003    2580 scope.go:117] "RemoveContainer" containerID="97548178e27eff5ff1eae777b33c61d5c846efc91fc3fd8e354a025df118169c"
Jul 09 18:48:07.009807 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.009790    2580 scope.go:117] "RemoveContainer" containerID="f65f1e109e7f84163a6e80e334622c4508b5b75296ac0a198f949c029d29f32a"
Jul 09 18:48:07.016307 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.016279    2580 scope.go:117] "RemoveContainer" containerID="09764f89077459a9906e5992da27d5d462a7175f41765b39c1a2362113ad34c5"
Jul 09 18:48:07.019308 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.019288    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 18:48:07.024598 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.024576    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 18:48:07.026661 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.026643    2580 scope.go:117] "RemoveContainer" containerID="ec02212b22f3941236a18b060c9a57394f340589c5ca530399291b8162934b11"
Jul 09 18:48:07.033601 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.033585    2580 scope.go:117] "RemoveContainer" containerID="0ccca9ae6cd8576bc9cdecaed237cc8a22ad7473be4a5be441ace3bf389f5bc0"
Jul 09 18:48:07.040394 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.040372    2580 scope.go:117] "RemoveContainer" containerID="9df87aaba8960ae80265d201c44f113f6769bd680af765b18fa8d2c180cc0f1c"
Jul 09 18:48:07.049957 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.049807    2580 scope.go:117] "RemoveContainer" containerID="f8c984ff67ab94f0e26f6194381a44f55e5260988bd3f906e220ca5fbbbca2c5"
Jul 09 18:48:07.050071 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:48:07.050053    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8c984ff67ab94f0e26f6194381a44f55e5260988bd3f906e220ca5fbbbca2c5\": container with ID starting with f8c984ff67ab94f0e26f6194381a44f55e5260988bd3f906e220ca5fbbbca2c5 not found: ID does not exist" containerID="f8c984ff67ab94f0e26f6194381a44f55e5260988bd3f906e220ca5fbbbca2c5"
Jul 09 18:48:07.050110 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.050079    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8c984ff67ab94f0e26f6194381a44f55e5260988bd3f906e220ca5fbbbca2c5"} err="failed to get container status \"f8c984ff67ab94f0e26f6194381a44f55e5260988bd3f906e220ca5fbbbca2c5\": rpc error: code = NotFound desc = could not find container \"f8c984ff67ab94f0e26f6194381a44f55e5260988bd3f906e220ca5fbbbca2c5\": container with ID starting with f8c984ff67ab94f0e26f6194381a44f55e5260988bd3f906e220ca5fbbbca2c5 not found: ID does not exist"
Jul 09 18:48:07.050153 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.050114    2580 scope.go:117] "RemoveContainer" containerID="97548178e27eff5ff1eae777b33c61d5c846efc91fc3fd8e354a025df118169c"
Jul 09 18:48:07.050354 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:48:07.050337    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97548178e27eff5ff1eae777b33c61d5c846efc91fc3fd8e354a025df118169c\": container with ID starting with 97548178e27eff5ff1eae777b33c61d5c846efc91fc3fd8e354a025df118169c not found: ID does not exist" containerID="97548178e27eff5ff1eae777b33c61d5c846efc91fc3fd8e354a025df118169c"
Jul 09 18:48:07.050393 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.050360    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97548178e27eff5ff1eae777b33c61d5c846efc91fc3fd8e354a025df118169c"} err="failed to get container status \"97548178e27eff5ff1eae777b33c61d5c846efc91fc3fd8e354a025df118169c\": rpc error: code = NotFound desc = could not find container \"97548178e27eff5ff1eae777b33c61d5c846efc91fc3fd8e354a025df118169c\": container with ID starting with 97548178e27eff5ff1eae777b33c61d5c846efc91fc3fd8e354a025df118169c not found: ID does not exist"
Jul 09 18:48:07.050393 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.050376    2580 scope.go:117] "RemoveContainer" containerID="f65f1e109e7f84163a6e80e334622c4508b5b75296ac0a198f949c029d29f32a"
Jul 09 18:48:07.050606 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:48:07.050591    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f65f1e109e7f84163a6e80e334622c4508b5b75296ac0a198f949c029d29f32a\": container with ID starting with f65f1e109e7f84163a6e80e334622c4508b5b75296ac0a198f949c029d29f32a not found: ID does not exist" containerID="f65f1e109e7f84163a6e80e334622c4508b5b75296ac0a198f949c029d29f32a"
Jul 09 18:48:07.050660 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.050610    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f65f1e109e7f84163a6e80e334622c4508b5b75296ac0a198f949c029d29f32a"} err="failed to get container status \"f65f1e109e7f84163a6e80e334622c4508b5b75296ac0a198f949c029d29f32a\": rpc error: code = NotFound desc = could not find container \"f65f1e109e7f84163a6e80e334622c4508b5b75296ac0a198f949c029d29f32a\": container with ID starting with f65f1e109e7f84163a6e80e334622c4508b5b75296ac0a198f949c029d29f32a not found: ID does not exist"
Jul 09 18:48:07.050660 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.050621    2580 scope.go:117] "RemoveContainer" containerID="09764f89077459a9906e5992da27d5d462a7175f41765b39c1a2362113ad34c5"
Jul 09 18:48:07.050809 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:48:07.050791    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09764f89077459a9906e5992da27d5d462a7175f41765b39c1a2362113ad34c5\": container with ID starting with 09764f89077459a9906e5992da27d5d462a7175f41765b39c1a2362113ad34c5 not found: ID does not exist" containerID="09764f89077459a9906e5992da27d5d462a7175f41765b39c1a2362113ad34c5"
Jul 09 18:48:07.050864 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.050814    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09764f89077459a9906e5992da27d5d462a7175f41765b39c1a2362113ad34c5"} err="failed to get container status \"09764f89077459a9906e5992da27d5d462a7175f41765b39c1a2362113ad34c5\": rpc error: code = NotFound desc = could not find container \"09764f89077459a9906e5992da27d5d462a7175f41765b39c1a2362113ad34c5\": container with ID starting with 09764f89077459a9906e5992da27d5d462a7175f41765b39c1a2362113ad34c5 not found: ID does not exist"
Jul 09 18:48:07.050864 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.050837    2580 scope.go:117] "RemoveContainer" containerID="ec02212b22f3941236a18b060c9a57394f340589c5ca530399291b8162934b11"
Jul 09 18:48:07.051030 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:48:07.051015    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec02212b22f3941236a18b060c9a57394f340589c5ca530399291b8162934b11\": container with ID starting with ec02212b22f3941236a18b060c9a57394f340589c5ca530399291b8162934b11 not found: ID does not exist" containerID="ec02212b22f3941236a18b060c9a57394f340589c5ca530399291b8162934b11"
Jul 09 18:48:07.051074 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.051034    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec02212b22f3941236a18b060c9a57394f340589c5ca530399291b8162934b11"} err="failed to get container status \"ec02212b22f3941236a18b060c9a57394f340589c5ca530399291b8162934b11\": rpc error: code = NotFound desc = could not find container \"ec02212b22f3941236a18b060c9a57394f340589c5ca530399291b8162934b11\": container with ID starting with ec02212b22f3941236a18b060c9a57394f340589c5ca530399291b8162934b11 not found: ID does not exist"
Jul 09 18:48:07.051074 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.051046    2580 scope.go:117] "RemoveContainer" containerID="0ccca9ae6cd8576bc9cdecaed237cc8a22ad7473be4a5be441ace3bf389f5bc0"
Jul 09 18:48:07.051241 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:48:07.051225    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ccca9ae6cd8576bc9cdecaed237cc8a22ad7473be4a5be441ace3bf389f5bc0\": container with ID starting with 0ccca9ae6cd8576bc9cdecaed237cc8a22ad7473be4a5be441ace3bf389f5bc0 not found: ID does not exist" containerID="0ccca9ae6cd8576bc9cdecaed237cc8a22ad7473be4a5be441ace3bf389f5bc0"
Jul 09 18:48:07.051283 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.051246    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ccca9ae6cd8576bc9cdecaed237cc8a22ad7473be4a5be441ace3bf389f5bc0"} err="failed to get container status \"0ccca9ae6cd8576bc9cdecaed237cc8a22ad7473be4a5be441ace3bf389f5bc0\": rpc error: code = NotFound desc = could not find container \"0ccca9ae6cd8576bc9cdecaed237cc8a22ad7473be4a5be441ace3bf389f5bc0\": container with ID starting with 0ccca9ae6cd8576bc9cdecaed237cc8a22ad7473be4a5be441ace3bf389f5bc0 not found: ID does not exist"
Jul 09 18:48:07.051283 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.051260    2580 scope.go:117] "RemoveContainer" containerID="9df87aaba8960ae80265d201c44f113f6769bd680af765b18fa8d2c180cc0f1c"
Jul 09 18:48:07.051488 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:48:07.051473    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9df87aaba8960ae80265d201c44f113f6769bd680af765b18fa8d2c180cc0f1c\": container with ID starting with 9df87aaba8960ae80265d201c44f113f6769bd680af765b18fa8d2c180cc0f1c not found: ID does not exist" containerID="9df87aaba8960ae80265d201c44f113f6769bd680af765b18fa8d2c180cc0f1c"
Jul 09 18:48:07.051537 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.051490    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9df87aaba8960ae80265d201c44f113f6769bd680af765b18fa8d2c180cc0f1c"} err="failed to get container status \"9df87aaba8960ae80265d201c44f113f6769bd680af765b18fa8d2c180cc0f1c\": rpc error: code = NotFound desc = could not find container \"9df87aaba8960ae80265d201c44f113f6769bd680af765b18fa8d2c180cc0f1c\": container with ID starting with 9df87aaba8960ae80265d201c44f113f6769bd680af765b18fa8d2c180cc0f1c not found: ID does not exist"
Jul 09 18:48:07.051537 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.051502    2580 scope.go:117] "RemoveContainer" containerID="f8c984ff67ab94f0e26f6194381a44f55e5260988bd3f906e220ca5fbbbca2c5"
Jul 09 18:48:07.051707 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.051690    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8c984ff67ab94f0e26f6194381a44f55e5260988bd3f906e220ca5fbbbca2c5"} err="failed to get container status \"f8c984ff67ab94f0e26f6194381a44f55e5260988bd3f906e220ca5fbbbca2c5\": rpc error: code = NotFound desc = could not find container \"f8c984ff67ab94f0e26f6194381a44f55e5260988bd3f906e220ca5fbbbca2c5\": container with ID starting with f8c984ff67ab94f0e26f6194381a44f55e5260988bd3f906e220ca5fbbbca2c5 not found: ID does not exist"
Jul 09 18:48:07.051749 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.051707    2580 scope.go:117] "RemoveContainer" containerID="97548178e27eff5ff1eae777b33c61d5c846efc91fc3fd8e354a025df118169c"
Jul 09 18:48:07.051924 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.051907    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97548178e27eff5ff1eae777b33c61d5c846efc91fc3fd8e354a025df118169c"} err="failed to get container status \"97548178e27eff5ff1eae777b33c61d5c846efc91fc3fd8e354a025df118169c\": rpc error: code = NotFound desc = could not find container \"97548178e27eff5ff1eae777b33c61d5c846efc91fc3fd8e354a025df118169c\": container with ID starting with 97548178e27eff5ff1eae777b33c61d5c846efc91fc3fd8e354a025df118169c not found: ID does not exist"
Jul 09 18:48:07.051973 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.051926    2580 scope.go:117] "RemoveContainer" containerID="f65f1e109e7f84163a6e80e334622c4508b5b75296ac0a198f949c029d29f32a"
Jul 09 18:48:07.052129 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.052111    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f65f1e109e7f84163a6e80e334622c4508b5b75296ac0a198f949c029d29f32a"} err="failed to get container status \"f65f1e109e7f84163a6e80e334622c4508b5b75296ac0a198f949c029d29f32a\": rpc error: code = NotFound desc = could not find container \"f65f1e109e7f84163a6e80e334622c4508b5b75296ac0a198f949c029d29f32a\": container with ID starting with f65f1e109e7f84163a6e80e334622c4508b5b75296ac0a198f949c029d29f32a not found: ID does not exist"
Jul 09 18:48:07.052129 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.052128    2580 scope.go:117] "RemoveContainer" containerID="09764f89077459a9906e5992da27d5d462a7175f41765b39c1a2362113ad34c5"
Jul 09 18:48:07.052336 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.052321    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09764f89077459a9906e5992da27d5d462a7175f41765b39c1a2362113ad34c5"} err="failed to get container status \"09764f89077459a9906e5992da27d5d462a7175f41765b39c1a2362113ad34c5\": rpc error: code = NotFound desc = could not find container \"09764f89077459a9906e5992da27d5d462a7175f41765b39c1a2362113ad34c5\": container with ID starting with 09764f89077459a9906e5992da27d5d462a7175f41765b39c1a2362113ad34c5 not found: ID does not exist"
Jul 09 18:48:07.052377 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.052338    2580 scope.go:117] "RemoveContainer" containerID="ec02212b22f3941236a18b060c9a57394f340589c5ca530399291b8162934b11"
Jul 09 18:48:07.052541 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.052522    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec02212b22f3941236a18b060c9a57394f340589c5ca530399291b8162934b11"} err="failed to get container status \"ec02212b22f3941236a18b060c9a57394f340589c5ca530399291b8162934b11\": rpc error: code = NotFound desc = could not find container \"ec02212b22f3941236a18b060c9a57394f340589c5ca530399291b8162934b11\": container with ID starting with ec02212b22f3941236a18b060c9a57394f340589c5ca530399291b8162934b11 not found: ID does not exist"
Jul 09 18:48:07.052575 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.052542    2580 scope.go:117] "RemoveContainer" containerID="0ccca9ae6cd8576bc9cdecaed237cc8a22ad7473be4a5be441ace3bf389f5bc0"
Jul 09 18:48:07.052714 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.052697    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ccca9ae6cd8576bc9cdecaed237cc8a22ad7473be4a5be441ace3bf389f5bc0"} err="failed to get container status \"0ccca9ae6cd8576bc9cdecaed237cc8a22ad7473be4a5be441ace3bf389f5bc0\": rpc error: code = NotFound desc = could not find container \"0ccca9ae6cd8576bc9cdecaed237cc8a22ad7473be4a5be441ace3bf389f5bc0\": container with ID starting with 0ccca9ae6cd8576bc9cdecaed237cc8a22ad7473be4a5be441ace3bf389f5bc0 not found: ID does not exist"
Jul 09 18:48:07.052756 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.052716    2580 scope.go:117] "RemoveContainer" containerID="9df87aaba8960ae80265d201c44f113f6769bd680af765b18fa8d2c180cc0f1c"
Jul 09 18:48:07.052916 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.052900    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9df87aaba8960ae80265d201c44f113f6769bd680af765b18fa8d2c180cc0f1c"} err="failed to get container status \"9df87aaba8960ae80265d201c44f113f6769bd680af765b18fa8d2c180cc0f1c\": rpc error: code = NotFound desc = could not find container \"9df87aaba8960ae80265d201c44f113f6769bd680af765b18fa8d2c180cc0f1c\": container with ID starting with 9df87aaba8960ae80265d201c44f113f6769bd680af765b18fa8d2c180cc0f1c not found: ID does not exist"
Jul 09 18:48:07.057558 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.057540    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 18:48:07.057843 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.057816    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="alertmanager"
Jul 09 18:48:07.057843 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.057841    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="alertmanager"
Jul 09 18:48:07.057920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.057849    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="kube-rbac-proxy-web"
Jul 09 18:48:07.057920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.057856    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="kube-rbac-proxy-web"
Jul 09 18:48:07.057920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.057862    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="kube-rbac-proxy"
Jul 09 18:48:07.057920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.057869    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="kube-rbac-proxy"
Jul 09 18:48:07.057920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.057884    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="prom-label-proxy"
Jul 09 18:48:07.057920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.057889    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="prom-label-proxy"
Jul 09 18:48:07.057920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.057899    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="config-reloader"
Jul 09 18:48:07.057920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.057904    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="config-reloader"
Jul 09 18:48:07.057920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.057911    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="kube-rbac-proxy-metric"
Jul 09 18:48:07.057920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.057916    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="kube-rbac-proxy-metric"
Jul 09 18:48:07.057920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.057922    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="init-config-reloader"
Jul 09 18:48:07.058234 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.057928    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="init-config-reloader"
Jul 09 18:48:07.058234 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.057973    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="prom-label-proxy"
Jul 09 18:48:07.058234 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.057983    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="config-reloader"
Jul 09 18:48:07.058234 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.057990    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="kube-rbac-proxy-web"
Jul 09 18:48:07.058234 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.057995    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="kube-rbac-proxy-metric"
Jul 09 18:48:07.058234 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.058002    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="kube-rbac-proxy"
Jul 09 18:48:07.058234 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.058007    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" containerName="alertmanager"
Jul 09 18:48:07.062378 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.062362    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.065483 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.065461    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 09 18:48:07.065575 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.065488    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 09 18:48:07.066228 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.066189    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 09 18:48:07.066358 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.066345    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nd9kn\""
Jul 09 18:48:07.066584 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.066572    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 09 18:48:07.066642 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.066604    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 09 18:48:07.066704 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.066691    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 09 18:48:07.067256 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.067243    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 09 18:48:07.067860 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.067844    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 09 18:48:07.078502 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.078480    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 09 18:48:07.083186 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.083164    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 18:48:07.182133 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.182091    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57588778-da98-4438-9740-16acd6e532f7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.182277 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.182139    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57588778-da98-4438-9740-16acd6e532f7-web-config\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.182277 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.182162    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/57588778-da98-4438-9740-16acd6e532f7-config-volume\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.182277 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.182180    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57588778-da98-4438-9740-16acd6e532f7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.182277 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.182199    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/57588778-da98-4438-9740-16acd6e532f7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.182408 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.182272    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/57588778-da98-4438-9740-16acd6e532f7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.182408 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.182306    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/57588778-da98-4438-9740-16acd6e532f7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.182408 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.182323    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57588778-da98-4438-9740-16acd6e532f7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.182408 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.182347    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/57588778-da98-4438-9740-16acd6e532f7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.182408 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.182377    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57588778-da98-4438-9740-16acd6e532f7-config-out\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.182408 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.182403    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57588778-da98-4438-9740-16acd6e532f7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.182583 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.182421    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c6rn\" (UniqueName: \"kubernetes.io/projected/57588778-da98-4438-9740-16acd6e532f7-kube-api-access-7c6rn\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.182583 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.182448    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57588778-da98-4438-9740-16acd6e532f7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.251608 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.251535    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db61830b-ad33-46dd-be6a-9580e3603a56" path="/var/lib/kubelet/pods/db61830b-ad33-46dd-be6a-9580e3603a56/volumes"
Jul 09 18:48:07.283090 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.283059    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/57588778-da98-4438-9740-16acd6e532f7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.283243 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.283102    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/57588778-da98-4438-9740-16acd6e532f7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.283243 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.283122    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57588778-da98-4438-9740-16acd6e532f7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.283243 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.283150    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/57588778-da98-4438-9740-16acd6e532f7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.283243 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.283177    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57588778-da98-4438-9740-16acd6e532f7-config-out\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.283243 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.283209    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57588778-da98-4438-9740-16acd6e532f7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.283243 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.283241    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c6rn\" (UniqueName: \"kubernetes.io/projected/57588778-da98-4438-9740-16acd6e532f7-kube-api-access-7c6rn\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.283562 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.283264    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57588778-da98-4438-9740-16acd6e532f7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.283562 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.283303    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57588778-da98-4438-9740-16acd6e532f7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.283562 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.283332    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57588778-da98-4438-9740-16acd6e532f7-web-config\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.283562 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.283367    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/57588778-da98-4438-9740-16acd6e532f7-config-volume\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.283562 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.283395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57588778-da98-4438-9740-16acd6e532f7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.283562 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.283417    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/57588778-da98-4438-9740-16acd6e532f7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.283562 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.283533    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/57588778-da98-4438-9740-16acd6e532f7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.284236 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.284215    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57588778-da98-4438-9740-16acd6e532f7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.284395 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.284257    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57588778-da98-4438-9740-16acd6e532f7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.286804 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.286298    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/57588778-da98-4438-9740-16acd6e532f7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.286804 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.286749    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57588778-da98-4438-9740-16acd6e532f7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.287331 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.287287    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57588778-da98-4438-9740-16acd6e532f7-config-out\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.287427 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.287388    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57588778-da98-4438-9740-16acd6e532f7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.287427 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.287404    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/57588778-da98-4438-9740-16acd6e532f7-config-volume\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.287561 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.287533    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/57588778-da98-4438-9740-16acd6e532f7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.287997 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.287975    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/57588778-da98-4438-9740-16acd6e532f7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.288197 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.288164    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57588778-da98-4438-9740-16acd6e532f7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.288342 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.288326    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57588778-da98-4438-9740-16acd6e532f7-web-config\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.293686 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.293656    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c6rn\" (UniqueName: \"kubernetes.io/projected/57588778-da98-4438-9740-16acd6e532f7-kube-api-access-7c6rn\") pod \"alertmanager-main-0\" (UID: \"57588778-da98-4438-9740-16acd6e532f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.371234 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.371190    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:48:07.507729 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.507705    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 18:48:07.509907 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:48:07.509875    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57588778_da98_4438_9740_16acd6e532f7.slice/crio-1330d32f2cf1ae7218f279a4f67c3a4a28bbcec1ceb79368a45f66d7a8a6d358 WatchSource:0}: Error finding container 1330d32f2cf1ae7218f279a4f67c3a4a28bbcec1ceb79368a45f66d7a8a6d358: Status 404 returned error can't find the container with id 1330d32f2cf1ae7218f279a4f67c3a4a28bbcec1ceb79368a45f66d7a8a6d358
Jul 09 18:48:07.993441 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.993408    2580 generic.go:356] "Generic (PLEG): container finished" podID="57588778-da98-4438-9740-16acd6e532f7" containerID="e15fdc3a74b6634967f0b6a900e4175c8f8dfaea3559cc94e1147fb63ca8f2e9" exitCode=0
Jul 09 18:48:07.993872 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.993501    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57588778-da98-4438-9740-16acd6e532f7","Type":"ContainerDied","Data":"e15fdc3a74b6634967f0b6a900e4175c8f8dfaea3559cc94e1147fb63ca8f2e9"}
Jul 09 18:48:07.993872 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:07.993580    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57588778-da98-4438-9740-16acd6e532f7","Type":"ContainerStarted","Data":"1330d32f2cf1ae7218f279a4f67c3a4a28bbcec1ceb79368a45f66d7a8a6d358"}
Jul 09 18:48:09.005160 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.005116    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57588778-da98-4438-9740-16acd6e532f7","Type":"ContainerStarted","Data":"476359c0a0575b3871dfe8ae344a5d6782f8b02e793a188daf74a97d544ecd8d"}
Jul 09 18:48:09.005613 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.005242    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57588778-da98-4438-9740-16acd6e532f7","Type":"ContainerStarted","Data":"1d2ab769a9cf3c7bff2a01409a8875c3e0b32352f4ea14d33d5c2c9ed274cd20"}
Jul 09 18:48:09.005613 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.005282    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57588778-da98-4438-9740-16acd6e532f7","Type":"ContainerStarted","Data":"3c00c18379c0efafbe13bf8e5dd206f17332196674d3da2ee4ea5961a00b8a12"}
Jul 09 18:48:09.005613 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.005318    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57588778-da98-4438-9740-16acd6e532f7","Type":"ContainerStarted","Data":"2137358c3a963679b0c2b1cd4dd1d314805d729ac59aecd9c9d3e7d8a82ac560"}
Jul 09 18:48:09.005613 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.005351    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57588778-da98-4438-9740-16acd6e532f7","Type":"ContainerStarted","Data":"35ac8a7033034069c5d9569ace7e8d52f585ef80e3af03756f1cc00f41211784"}
Jul 09 18:48:09.005613 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.005386    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"57588778-da98-4438-9740-16acd6e532f7","Type":"ContainerStarted","Data":"bf4eb410ffb9066ab449a2d3c34c1a315f47e2e81ad69b4814ea7d8f372a88a6"}
Jul 09 18:48:09.009551 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.009525    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"]
Jul 09 18:48:09.012965 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.012942    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.016082 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.016059    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 09 18:48:09.016206 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.016059    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 09 18:48:09.016303 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.016288    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-w42dk\""
Jul 09 18:48:09.016379 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.016365    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 09 18:48:09.016435 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.016390    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 09 18:48:09.016490 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.016464    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 09 18:48:09.022413 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.022393    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 09 18:48:09.031651 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.031628    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"]
Jul 09 18:48:09.042060 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.040730    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.024729787 podStartE2EDuration="2.040712237s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.98245ms" isStatefulPod=false podCreationTimestamp="2026-07-09 18:48:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:48:09.039300471 +0000 UTC m=+144.248889711" watchObservedRunningTime="2026-07-09 18:48:09.040712237 +0000 UTC m=+144.250301435"
Jul 09 18:48:09.102381 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.102350    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/82311880-326a-4676-9cc1-942a47b86e70-telemeter-client-tls\") pod \"telemeter-client-5968c46dc4-m9rdd\" (UID: \"82311880-326a-4676-9cc1-942a47b86e70\") " pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.102566 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.102402    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82311880-326a-4676-9cc1-942a47b86e70-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5968c46dc4-m9rdd\" (UID: \"82311880-326a-4676-9cc1-942a47b86e70\") " pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.102566 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.102554    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82311880-326a-4676-9cc1-942a47b86e70-metrics-client-ca\") pod \"telemeter-client-5968c46dc4-m9rdd\" (UID: \"82311880-326a-4676-9cc1-942a47b86e70\") " pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.102701 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.102620    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8822v\" (UniqueName: \"kubernetes.io/projected/82311880-326a-4676-9cc1-942a47b86e70-kube-api-access-8822v\") pod \"telemeter-client-5968c46dc4-m9rdd\" (UID: \"82311880-326a-4676-9cc1-942a47b86e70\") " pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.102755 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.102699    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82311880-326a-4676-9cc1-942a47b86e70-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5968c46dc4-m9rdd\" (UID: \"82311880-326a-4676-9cc1-942a47b86e70\") " pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.102978 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.102936    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/82311880-326a-4676-9cc1-942a47b86e70-secret-telemeter-client\") pod \"telemeter-client-5968c46dc4-m9rdd\" (UID: \"82311880-326a-4676-9cc1-942a47b86e70\") " pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.102978 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.102974    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82311880-326a-4676-9cc1-942a47b86e70-serving-certs-ca-bundle\") pod \"telemeter-client-5968c46dc4-m9rdd\" (UID: \"82311880-326a-4676-9cc1-942a47b86e70\") " pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.103122 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.103062    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/82311880-326a-4676-9cc1-942a47b86e70-federate-client-tls\") pod \"telemeter-client-5968c46dc4-m9rdd\" (UID: \"82311880-326a-4676-9cc1-942a47b86e70\") " pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.204070 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.204028    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82311880-326a-4676-9cc1-942a47b86e70-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5968c46dc4-m9rdd\" (UID: \"82311880-326a-4676-9cc1-942a47b86e70\") " pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.204253 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.204086    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82311880-326a-4676-9cc1-942a47b86e70-metrics-client-ca\") pod \"telemeter-client-5968c46dc4-m9rdd\" (UID: \"82311880-326a-4676-9cc1-942a47b86e70\") " pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.204253 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.204112    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8822v\" (UniqueName: \"kubernetes.io/projected/82311880-326a-4676-9cc1-942a47b86e70-kube-api-access-8822v\") pod \"telemeter-client-5968c46dc4-m9rdd\" (UID: \"82311880-326a-4676-9cc1-942a47b86e70\") " pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.204253 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.204136    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82311880-326a-4676-9cc1-942a47b86e70-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5968c46dc4-m9rdd\" (UID: \"82311880-326a-4676-9cc1-942a47b86e70\") " pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.204253 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.204155    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/82311880-326a-4676-9cc1-942a47b86e70-secret-telemeter-client\") pod \"telemeter-client-5968c46dc4-m9rdd\" (UID: \"82311880-326a-4676-9cc1-942a47b86e70\") " pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.204253 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.204172    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82311880-326a-4676-9cc1-942a47b86e70-serving-certs-ca-bundle\") pod \"telemeter-client-5968c46dc4-m9rdd\" (UID: \"82311880-326a-4676-9cc1-942a47b86e70\") " pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.204253 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.204208    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/82311880-326a-4676-9cc1-942a47b86e70-federate-client-tls\") pod \"telemeter-client-5968c46dc4-m9rdd\" (UID: \"82311880-326a-4676-9cc1-942a47b86e70\") " pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.204253 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.204244    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/82311880-326a-4676-9cc1-942a47b86e70-telemeter-client-tls\") pod \"telemeter-client-5968c46dc4-m9rdd\" (UID: \"82311880-326a-4676-9cc1-942a47b86e70\") " pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.205040 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.205011    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82311880-326a-4676-9cc1-942a47b86e70-metrics-client-ca\") pod \"telemeter-client-5968c46dc4-m9rdd\" (UID: \"82311880-326a-4676-9cc1-942a47b86e70\") " pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.205163 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.205084    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82311880-326a-4676-9cc1-942a47b86e70-serving-certs-ca-bundle\") pod \"telemeter-client-5968c46dc4-m9rdd\" (UID: \"82311880-326a-4676-9cc1-942a47b86e70\") " pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.205510 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.205484    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82311880-326a-4676-9cc1-942a47b86e70-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5968c46dc4-m9rdd\" (UID: \"82311880-326a-4676-9cc1-942a47b86e70\") " pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.206954 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.206929    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/82311880-326a-4676-9cc1-942a47b86e70-federate-client-tls\") pod \"telemeter-client-5968c46dc4-m9rdd\" (UID: \"82311880-326a-4676-9cc1-942a47b86e70\") " pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.206954 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.206940    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/82311880-326a-4676-9cc1-942a47b86e70-telemeter-client-tls\") pod \"telemeter-client-5968c46dc4-m9rdd\" (UID: \"82311880-326a-4676-9cc1-942a47b86e70\") " pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.207116 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.207066    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82311880-326a-4676-9cc1-942a47b86e70-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5968c46dc4-m9rdd\" (UID: \"82311880-326a-4676-9cc1-942a47b86e70\") " pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.207116 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.207070    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/82311880-326a-4676-9cc1-942a47b86e70-secret-telemeter-client\") pod \"telemeter-client-5968c46dc4-m9rdd\" (UID: \"82311880-326a-4676-9cc1-942a47b86e70\") " pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.213765 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.213744    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8822v\" (UniqueName: \"kubernetes.io/projected/82311880-326a-4676-9cc1-942a47b86e70-kube-api-access-8822v\") pod \"telemeter-client-5968c46dc4-m9rdd\" (UID: \"82311880-326a-4676-9cc1-942a47b86e70\") " pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.321337 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.321246    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 18:48:09.321686 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.321651    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="kube-rbac-proxy" containerID="cri-o://c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34" gracePeriod=600
Jul 09 18:48:09.321686 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.321649    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="prometheus" containerID="cri-o://4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4" gracePeriod=600
Jul 09 18:48:09.321865 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.321690    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="config-reloader" containerID="cri-o://1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f" gracePeriod=600
Jul 09 18:48:09.321865 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.321696    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="kube-rbac-proxy-web" containerID="cri-o://ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b" gracePeriod=600
Jul 09 18:48:09.321865 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.321696    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="thanos-sidecar" containerID="cri-o://7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8" gracePeriod=600
Jul 09 18:48:09.321865 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.321842    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4" gracePeriod=600
Jul 09 18:48:09.324975 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.324948    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"
Jul 09 18:48:09.493553 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:48:09.493517    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82311880_326a_4676_9cc1_942a47b86e70.slice/crio-107144f928a6018ccf69c8a2b1836c9f2ec369a9bbdba19279eeaf2b261b065b WatchSource:0}: Error finding container 107144f928a6018ccf69c8a2b1836c9f2ec369a9bbdba19279eeaf2b261b065b: Status 404 returned error can't find the container with id 107144f928a6018ccf69c8a2b1836c9f2ec369a9bbdba19279eeaf2b261b065b
Jul 09 18:48:09.494162 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.494094    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5968c46dc4-m9rdd"]
Jul 09 18:48:09.588176 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.588144    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:09.709205 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.709174    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c7398dc-4de4-4edd-8af8-c9539902ea0b-tls-assets\") pod \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") "
Jul 09 18:48:09.709205 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.709218    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c7398dc-4de4-4edd-8af8-c9539902ea0b-config-out\") pod \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") "
Jul 09 18:48:09.709450 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.709271    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-configmap-serving-certs-ca-bundle\") pod \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") "
Jul 09 18:48:09.709450 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.709298    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-grpc-tls\") pod \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") "
Jul 09 18:48:09.709450 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.709332    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-configmap-metrics-client-ca\") pod \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") "
Jul 09 18:48:09.709450 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.709358    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-thanos-prometheus-http-client-file\") pod \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") "
Jul 09 18:48:09.709450 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.709381    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-prometheus-k8s-tls\") pod \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") "
Jul 09 18:48:09.709450 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.709409    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-k8s-rulefiles-2\") pod \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") "
Jul 09 18:48:09.709450 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.709440    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-trusted-ca-bundle\") pod \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") "
Jul 09 18:48:09.709790 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.709473    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-k8s-rulefiles-0\") pod \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") "
Jul 09 18:48:09.709790 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.709516    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-config\") pod \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") "
Jul 09 18:48:09.709790 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.709541    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-k8s-db\") pod \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") "
Jul 09 18:48:09.709790 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.709601    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") "
Jul 09 18:48:09.709790 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.709635    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-configmap-kubelet-serving-ca-bundle\") pod \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") "
Jul 09 18:48:09.709790 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.709671    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-metrics-client-certs\") pod \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") "
Jul 09 18:48:09.709790 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.709682    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "7c7398dc-4de4-4edd-8af8-c9539902ea0b" (UID: "7c7398dc-4de4-4edd-8af8-c9539902ea0b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:48:09.709790 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.709703    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") "
Jul 09 18:48:09.709790 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.709719    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "7c7398dc-4de4-4edd-8af8-c9539902ea0b" (UID: "7c7398dc-4de4-4edd-8af8-c9539902ea0b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:48:09.709790 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.709738    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-kube-rbac-proxy\") pod \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") "
Jul 09 18:48:09.709790 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.709768    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-k8s-rulefiles-1\") pod \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") "
Jul 09 18:48:09.710364 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.709796    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktzl8\" (UniqueName: \"kubernetes.io/projected/7c7398dc-4de4-4edd-8af8-c9539902ea0b-kube-api-access-ktzl8\") pod \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") "
Jul 09 18:48:09.710364 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.709856    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-web-config\") pod \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\" (UID: \"7c7398dc-4de4-4edd-8af8-c9539902ea0b\") "
Jul 09 18:48:09.710364 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.710013    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "7c7398dc-4de4-4edd-8af8-c9539902ea0b" (UID: "7c7398dc-4de4-4edd-8af8-c9539902ea0b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:48:09.710364 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.710168    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:09.710364 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.710187    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:09.710364 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.710202    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-configmap-metrics-client-ca\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:09.710364 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.710223    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "7c7398dc-4de4-4edd-8af8-c9539902ea0b" (UID: "7c7398dc-4de4-4edd-8af8-c9539902ea0b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:48:09.711687 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.711227    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "7c7398dc-4de4-4edd-8af8-c9539902ea0b" (UID: "7c7398dc-4de4-4edd-8af8-c9539902ea0b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:48:09.711965 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.711748    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "7c7398dc-4de4-4edd-8af8-c9539902ea0b" (UID: "7c7398dc-4de4-4edd-8af8-c9539902ea0b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:48:09.712732 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.712281    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c7398dc-4de4-4edd-8af8-c9539902ea0b-config-out" (OuterVolumeSpecName: "config-out") pod "7c7398dc-4de4-4edd-8af8-c9539902ea0b" (UID: "7c7398dc-4de4-4edd-8af8-c9539902ea0b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:48:09.712732 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.712498    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c7398dc-4de4-4edd-8af8-c9539902ea0b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7c7398dc-4de4-4edd-8af8-c9539902ea0b" (UID: "7c7398dc-4de4-4edd-8af8-c9539902ea0b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:48:09.712732 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.712415    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "7c7398dc-4de4-4edd-8af8-c9539902ea0b" (UID: "7c7398dc-4de4-4edd-8af8-c9539902ea0b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:48:09.712972 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.712772    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-config" (OuterVolumeSpecName: "config") pod "7c7398dc-4de4-4edd-8af8-c9539902ea0b" (UID: "7c7398dc-4de4-4edd-8af8-c9539902ea0b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:48:09.712972 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.712865    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "7c7398dc-4de4-4edd-8af8-c9539902ea0b" (UID: "7c7398dc-4de4-4edd-8af8-c9539902ea0b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:48:09.712972 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.712873    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "7c7398dc-4de4-4edd-8af8-c9539902ea0b" (UID: "7c7398dc-4de4-4edd-8af8-c9539902ea0b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:48:09.712972 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.712939    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "7c7398dc-4de4-4edd-8af8-c9539902ea0b" (UID: "7c7398dc-4de4-4edd-8af8-c9539902ea0b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:48:09.713193 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.713167    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "7c7398dc-4de4-4edd-8af8-c9539902ea0b" (UID: "7c7398dc-4de4-4edd-8af8-c9539902ea0b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:48:09.714276 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.714245    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "7c7398dc-4de4-4edd-8af8-c9539902ea0b" (UID: "7c7398dc-4de4-4edd-8af8-c9539902ea0b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:48:09.714437 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.714412    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "7c7398dc-4de4-4edd-8af8-c9539902ea0b" (UID: "7c7398dc-4de4-4edd-8af8-c9539902ea0b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:48:09.714514 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.714489    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "7c7398dc-4de4-4edd-8af8-c9539902ea0b" (UID: "7c7398dc-4de4-4edd-8af8-c9539902ea0b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:48:09.714644 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.714627    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "7c7398dc-4de4-4edd-8af8-c9539902ea0b" (UID: "7c7398dc-4de4-4edd-8af8-c9539902ea0b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:48:09.715082 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.715060    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c7398dc-4de4-4edd-8af8-c9539902ea0b-kube-api-access-ktzl8" (OuterVolumeSpecName: "kube-api-access-ktzl8") pod "7c7398dc-4de4-4edd-8af8-c9539902ea0b" (UID: "7c7398dc-4de4-4edd-8af8-c9539902ea0b"). InnerVolumeSpecName "kube-api-access-ktzl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:48:09.724701 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.724677    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-web-config" (OuterVolumeSpecName: "web-config") pod "7c7398dc-4de4-4edd-8af8-c9539902ea0b" (UID: "7c7398dc-4de4-4edd-8af8-c9539902ea0b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:48:09.811225 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.811186    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c7398dc-4de4-4edd-8af8-c9539902ea0b-tls-assets\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:09.811225 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.811216    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c7398dc-4de4-4edd-8af8-c9539902ea0b-config-out\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:09.811225 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.811225    2580 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-grpc-tls\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:09.811225 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.811234    2580 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:09.811471 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.811244    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:09.811471 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.811253    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:09.811471 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.811261    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:09.811471 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.811272    2580 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-config\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:09.811471 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.811281    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-k8s-db\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:09.811471 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.811291    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:09.811471 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.811301    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:09.811471 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.811309    2580 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-metrics-client-certs\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:09.811471 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.811317    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:09.811471 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.811326    2580 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-secret-kube-rbac-proxy\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:09.811471 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.811334    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7c7398dc-4de4-4edd-8af8-c9539902ea0b-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:09.811471 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.811342    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktzl8\" (UniqueName: \"kubernetes.io/projected/7c7398dc-4de4-4edd-8af8-c9539902ea0b-kube-api-access-ktzl8\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:09.811471 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:09.811350    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c7398dc-4de4-4edd-8af8-c9539902ea0b-web-config\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:48:10.014659 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.014629    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd" event={"ID":"82311880-326a-4676-9cc1-942a47b86e70","Type":"ContainerStarted","Data":"107144f928a6018ccf69c8a2b1836c9f2ec369a9bbdba19279eeaf2b261b065b"}
Jul 09 18:48:10.017772 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.017749    2580 generic.go:356] "Generic (PLEG): container finished" podID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerID="8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4" exitCode=0
Jul 09 18:48:10.017772 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.017768    2580 generic.go:356] "Generic (PLEG): container finished" podID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerID="c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34" exitCode=0
Jul 09 18:48:10.017772 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.017773    2580 generic.go:356] "Generic (PLEG): container finished" podID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerID="ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b" exitCode=0
Jul 09 18:48:10.018057 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.017778    2580 generic.go:356] "Generic (PLEG): container finished" podID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerID="7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8" exitCode=0
Jul 09 18:48:10.018057 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.017784    2580 generic.go:356] "Generic (PLEG): container finished" podID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerID="1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f" exitCode=0
Jul 09 18:48:10.018057 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.017789    2580 generic.go:356] "Generic (PLEG): container finished" podID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerID="4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4" exitCode=0
Jul 09 18:48:10.018057 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.017853    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.018057 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.017845    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c7398dc-4de4-4edd-8af8-c9539902ea0b","Type":"ContainerDied","Data":"8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4"}
Jul 09 18:48:10.018057 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.018026    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c7398dc-4de4-4edd-8af8-c9539902ea0b","Type":"ContainerDied","Data":"c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34"}
Jul 09 18:48:10.018334 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.018080    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c7398dc-4de4-4edd-8af8-c9539902ea0b","Type":"ContainerDied","Data":"ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b"}
Jul 09 18:48:10.018334 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.018091    2580 scope.go:117] "RemoveContainer" containerID="8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4"
Jul 09 18:48:10.018334 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.018127    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c7398dc-4de4-4edd-8af8-c9539902ea0b","Type":"ContainerDied","Data":"7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8"}
Jul 09 18:48:10.018334 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.018170    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c7398dc-4de4-4edd-8af8-c9539902ea0b","Type":"ContainerDied","Data":"1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f"}
Jul 09 18:48:10.018334 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.018211    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c7398dc-4de4-4edd-8af8-c9539902ea0b","Type":"ContainerDied","Data":"4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4"}
Jul 09 18:48:10.018334 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.018264    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7c7398dc-4de4-4edd-8af8-c9539902ea0b","Type":"ContainerDied","Data":"79251d5ea06b827c8a286b48aaf7ffec514f2bc7fd4de30bb643fc241bedb6ee"}
Jul 09 18:48:10.026717 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.026676    2580 scope.go:117] "RemoveContainer" containerID="c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34"
Jul 09 18:48:10.034351 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.034329    2580 scope.go:117] "RemoveContainer" containerID="ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b"
Jul 09 18:48:10.041222 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.041204    2580 scope.go:117] "RemoveContainer" containerID="7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8"
Jul 09 18:48:10.049046 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.049024    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 18:48:10.050056 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.050030    2580 scope.go:117] "RemoveContainer" containerID="1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f"
Jul 09 18:48:10.054361 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.054334    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 18:48:10.058641 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.058622    2580 scope.go:117] "RemoveContainer" containerID="4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4"
Jul 09 18:48:10.066736 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.066716    2580 scope.go:117] "RemoveContainer" containerID="5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a"
Jul 09 18:48:10.075075 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.075054    2580 scope.go:117] "RemoveContainer" containerID="8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4"
Jul 09 18:48:10.075374 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:48:10.075353    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4\": container with ID starting with 8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4 not found: ID does not exist" containerID="8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4"
Jul 09 18:48:10.075460 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.075379    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4"} err="failed to get container status \"8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4\": rpc error: code = NotFound desc = could not find container \"8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4\": container with ID starting with 8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4 not found: ID does not exist"
Jul 09 18:48:10.075460 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.075397    2580 scope.go:117] "RemoveContainer" containerID="c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34"
Jul 09 18:48:10.075704 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:48:10.075688    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34\": container with ID starting with c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34 not found: ID does not exist" containerID="c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34"
Jul 09 18:48:10.075768 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.075710    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34"} err="failed to get container status \"c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34\": rpc error: code = NotFound desc = could not find container \"c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34\": container with ID starting with c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34 not found: ID does not exist"
Jul 09 18:48:10.075768 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.075725    2580 scope.go:117] "RemoveContainer" containerID="ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b"
Jul 09 18:48:10.076001 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:48:10.075975    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b\": container with ID starting with ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b not found: ID does not exist" containerID="ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b"
Jul 09 18:48:10.076118 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.076009    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b"} err="failed to get container status \"ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b\": rpc error: code = NotFound desc = could not find container \"ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b\": container with ID starting with ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b not found: ID does not exist"
Jul 09 18:48:10.076118 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.076031    2580 scope.go:117] "RemoveContainer" containerID="7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8"
Jul 09 18:48:10.076305 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:48:10.076282    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8\": container with ID starting with 7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8 not found: ID does not exist" containerID="7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8"
Jul 09 18:48:10.076377 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.076313    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8"} err="failed to get container status \"7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8\": rpc error: code = NotFound desc = could not find container \"7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8\": container with ID starting with 7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8 not found: ID does not exist"
Jul 09 18:48:10.076377 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.076335    2580 scope.go:117] "RemoveContainer" containerID="1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f"
Jul 09 18:48:10.076633 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:48:10.076613    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f\": container with ID starting with 1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f not found: ID does not exist" containerID="1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f"
Jul 09 18:48:10.076702 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.076640    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f"} err="failed to get container status \"1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f\": rpc error: code = NotFound desc = could not find container \"1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f\": container with ID starting with 1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f not found: ID does not exist"
Jul 09 18:48:10.076702 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.076660    2580 scope.go:117] "RemoveContainer" containerID="4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4"
Jul 09 18:48:10.076953 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:48:10.076931    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4\": container with ID starting with 4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4 not found: ID does not exist" containerID="4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4"
Jul 09 18:48:10.077028 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.076960    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4"} err="failed to get container status \"4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4\": rpc error: code = NotFound desc = could not find container \"4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4\": container with ID starting with 4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4 not found: ID does not exist"
Jul 09 18:48:10.077028 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.076974    2580 scope.go:117] "RemoveContainer" containerID="5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a"
Jul 09 18:48:10.077221 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:48:10.077202    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a\": container with ID starting with 5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a not found: ID does not exist" containerID="5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a"
Jul 09 18:48:10.077278 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.077226    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a"} err="failed to get container status \"5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a\": rpc error: code = NotFound desc = could not find container \"5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a\": container with ID starting with 5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a not found: ID does not exist"
Jul 09 18:48:10.077278 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.077243    2580 scope.go:117] "RemoveContainer" containerID="8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4"
Jul 09 18:48:10.077479 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.077455    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4"} err="failed to get container status \"8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4\": rpc error: code = NotFound desc = could not find container \"8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4\": container with ID starting with 8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4 not found: ID does not exist"
Jul 09 18:48:10.077479 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.077478    2580 scope.go:117] "RemoveContainer" containerID="c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34"
Jul 09 18:48:10.077674 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.077657    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34"} err="failed to get container status \"c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34\": rpc error: code = NotFound desc = could not find container \"c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34\": container with ID starting with c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34 not found: ID does not exist"
Jul 09 18:48:10.077674 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.077674    2580 scope.go:117] "RemoveContainer" containerID="ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b"
Jul 09 18:48:10.077984 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.077956    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b"} err="failed to get container status \"ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b\": rpc error: code = NotFound desc = could not find container \"ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b\": container with ID starting with ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b not found: ID does not exist"
Jul 09 18:48:10.077984 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.077980    2580 scope.go:117] "RemoveContainer" containerID="7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8"
Jul 09 18:48:10.078192 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.078171    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8"} err="failed to get container status \"7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8\": rpc error: code = NotFound desc = could not find container \"7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8\": container with ID starting with 7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8 not found: ID does not exist"
Jul 09 18:48:10.078257 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.078194    2580 scope.go:117] "RemoveContainer" containerID="1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f"
Jul 09 18:48:10.078428 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.078409    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f"} err="failed to get container status \"1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f\": rpc error: code = NotFound desc = could not find container \"1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f\": container with ID starting with 1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f not found: ID does not exist"
Jul 09 18:48:10.078466 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.078430    2580 scope.go:117] "RemoveContainer" containerID="4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4"
Jul 09 18:48:10.078741 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.078720    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4"} err="failed to get container status \"4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4\": rpc error: code = NotFound desc = could not find container \"4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4\": container with ID starting with 4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4 not found: ID does not exist"
Jul 09 18:48:10.078860 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.078748    2580 scope.go:117] "RemoveContainer" containerID="5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a"
Jul 09 18:48:10.079017 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.078996    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a"} err="failed to get container status \"5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a\": rpc error: code = NotFound desc = could not find container \"5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a\": container with ID starting with 5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a not found: ID does not exist"
Jul 09 18:48:10.079071 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.079019    2580 scope.go:117] "RemoveContainer" containerID="8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4"
Jul 09 18:48:10.079266 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.079244    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4"} err="failed to get container status \"8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4\": rpc error: code = NotFound desc = could not find container \"8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4\": container with ID starting with 8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4 not found: ID does not exist"
Jul 09 18:48:10.079327 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.079269    2580 scope.go:117] "RemoveContainer" containerID="c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34"
Jul 09 18:48:10.079524 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.079496    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34"} err="failed to get container status \"c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34\": rpc error: code = NotFound desc = could not find container \"c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34\": container with ID starting with c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34 not found: ID does not exist"
Jul 09 18:48:10.079524 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.079516    2580 scope.go:117] "RemoveContainer" containerID="ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b"
Jul 09 18:48:10.079772 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.079754    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b"} err="failed to get container status \"ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b\": rpc error: code = NotFound desc = could not find container \"ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b\": container with ID starting with ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b not found: ID does not exist"
Jul 09 18:48:10.079772 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.079771    2580 scope.go:117] "RemoveContainer" containerID="7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8"
Jul 09 18:48:10.080068 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.080044    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8"} err="failed to get container status \"7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8\": rpc error: code = NotFound desc = could not find container \"7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8\": container with ID starting with 7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8 not found: ID does not exist"
Jul 09 18:48:10.080156 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.080069    2580 scope.go:117] "RemoveContainer" containerID="1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f"
Jul 09 18:48:10.080329 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.080311    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f"} err="failed to get container status \"1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f\": rpc error: code = NotFound desc = could not find container \"1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f\": container with ID starting with 1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f not found: ID does not exist"
Jul 09 18:48:10.080413 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.080329    2580 scope.go:117] "RemoveContainer" containerID="4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4"
Jul 09 18:48:10.080565 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.080545    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4"} err="failed to get container status \"4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4\": rpc error: code = NotFound desc = could not find container \"4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4\": container with ID starting with 4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4 not found: ID does not exist"
Jul 09 18:48:10.080631 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.080566    2580 scope.go:117] "RemoveContainer" containerID="5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a"
Jul 09 18:48:10.080760 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.080742    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a"} err="failed to get container status \"5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a\": rpc error: code = NotFound desc = could not find container \"5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a\": container with ID starting with 5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a not found: ID does not exist"
Jul 09 18:48:10.080815 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.080762    2580 scope.go:117] "RemoveContainer" containerID="8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4"
Jul 09 18:48:10.081052 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.081030    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4"} err="failed to get container status \"8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4\": rpc error: code = NotFound desc = could not find container \"8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4\": container with ID starting with 8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4 not found: ID does not exist"
Jul 09 18:48:10.081052 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.081053    2580 scope.go:117] "RemoveContainer" containerID="c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34"
Jul 09 18:48:10.081290 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.081268    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34"} err="failed to get container status \"c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34\": rpc error: code = NotFound desc = could not find container \"c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34\": container with ID starting with c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34 not found: ID does not exist"
Jul 09 18:48:10.081348 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.081292    2580 scope.go:117] "RemoveContainer" containerID="ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b"
Jul 09 18:48:10.081575 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.081555    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b"} err="failed to get container status \"ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b\": rpc error: code = NotFound desc = could not find container \"ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b\": container with ID starting with ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b not found: ID does not exist"
Jul 09 18:48:10.081701 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.081577    2580 scope.go:117] "RemoveContainer" containerID="7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8"
Jul 09 18:48:10.081875 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.081856    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8"} err="failed to get container status \"7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8\": rpc error: code = NotFound desc = could not find container \"7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8\": container with ID starting with 7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8 not found: ID does not exist"
Jul 09 18:48:10.081944 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.081876    2580 scope.go:117] "RemoveContainer" containerID="1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f"
Jul 09 18:48:10.082137 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.082114    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f"} err="failed to get container status \"1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f\": rpc error: code = NotFound desc = could not find container \"1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f\": container with ID starting with 1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f not found: ID does not exist"
Jul 09 18:48:10.082137 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.082136    2580 scope.go:117] "RemoveContainer" containerID="4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4"
Jul 09 18:48:10.082418 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.082392    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4"} err="failed to get container status \"4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4\": rpc error: code = NotFound desc = could not find container \"4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4\": container with ID starting with 4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4 not found: ID does not exist"
Jul 09 18:48:10.082418 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.082418    2580 scope.go:117] "RemoveContainer" containerID="5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a"
Jul 09 18:48:10.082682 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.082658    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a"} err="failed to get container status \"5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a\": rpc error: code = NotFound desc = could not find container \"5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a\": container with ID starting with 5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a not found: ID does not exist"
Jul 09 18:48:10.082788 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.082684    2580 scope.go:117] "RemoveContainer" containerID="8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4"
Jul 09 18:48:10.083096 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.083042    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4"} err="failed to get container status \"8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4\": rpc error: code = NotFound desc = could not find container \"8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4\": container with ID starting with 8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4 not found: ID does not exist"
Jul 09 18:48:10.083096 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.083065    2580 scope.go:117] "RemoveContainer" containerID="c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34"
Jul 09 18:48:10.083722 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.083700    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34"} err="failed to get container status \"c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34\": rpc error: code = NotFound desc = could not find container \"c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34\": container with ID starting with c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34 not found: ID does not exist"
Jul 09 18:48:10.083722 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.083722    2580 scope.go:117] "RemoveContainer" containerID="ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b"
Jul 09 18:48:10.084093 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.084069    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b"} err="failed to get container status \"ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b\": rpc error: code = NotFound desc = could not find container \"ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b\": container with ID starting with ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b not found: ID does not exist"
Jul 09 18:48:10.084202 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.084095    2580 scope.go:117] "RemoveContainer" containerID="7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8"
Jul 09 18:48:10.084455 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.084434    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8"} err="failed to get container status \"7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8\": rpc error: code = NotFound desc = could not find container \"7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8\": container with ID starting with 7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8 not found: ID does not exist"
Jul 09 18:48:10.084551 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.084456    2580 scope.go:117] "RemoveContainer" containerID="1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f"
Jul 09 18:48:10.084766 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.084740    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f"} err="failed to get container status \"1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f\": rpc error: code = NotFound desc = could not find container \"1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f\": container with ID starting with 1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f not found: ID does not exist"
Jul 09 18:48:10.084898 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.084766    2580 scope.go:117] "RemoveContainer" containerID="4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4"
Jul 09 18:48:10.085065 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.085033    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4"} err="failed to get container status \"4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4\": rpc error: code = NotFound desc = could not find container \"4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4\": container with ID starting with 4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4 not found: ID does not exist"
Jul 09 18:48:10.085157 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.085065    2580 scope.go:117] "RemoveContainer" containerID="5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a"
Jul 09 18:48:10.085346 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.085309    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a"} err="failed to get container status \"5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a\": rpc error: code = NotFound desc = could not find container \"5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a\": container with ID starting with 5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a not found: ID does not exist"
Jul 09 18:48:10.085346 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.085346    2580 scope.go:117] "RemoveContainer" containerID="8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4"
Jul 09 18:48:10.085598 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.085576    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4"} err="failed to get container status \"8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4\": rpc error: code = NotFound desc = could not find container \"8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4\": container with ID starting with 8306bf851d62b57eca3e6029285f1e44965280c6ec8d476a5b745f641710f0b4 not found: ID does not exist"
Jul 09 18:48:10.085672 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.085601    2580 scope.go:117] "RemoveContainer" containerID="c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34"
Jul 09 18:48:10.085917 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.085899    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 18:48:10.086000 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.085930    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34"} err="failed to get container status \"c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34\": rpc error: code = NotFound desc = could not find container \"c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34\": container with ID starting with c6508a9aa5c3358a97509062a27dcfe536860d051a0eee6c82cc48f2bf32ab34 not found: ID does not exist"
Jul 09 18:48:10.086000 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.085955    2580 scope.go:117] "RemoveContainer" containerID="ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b"
Jul 09 18:48:10.086195 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086172    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b"} err="failed to get container status \"ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b\": rpc error: code = NotFound desc = could not find container \"ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b\": container with ID starting with ef85850103cb1a5c70731eb8eb221c47ddd764df29426b7d531155329efb580b not found: ID does not exist"
Jul 09 18:48:10.086247 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086196    2580 scope.go:117] "RemoveContainer" containerID="7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8"
Jul 09 18:48:10.086293 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086276    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="thanos-sidecar"
Jul 09 18:48:10.086293 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086292    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="thanos-sidecar"
Jul 09 18:48:10.086417 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086305    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="prometheus"
Jul 09 18:48:10.086417 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086311    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="prometheus"
Jul 09 18:48:10.086417 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086318    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="kube-rbac-proxy-web"
Jul 09 18:48:10.086417 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086323    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="kube-rbac-proxy-web"
Jul 09 18:48:10.086417 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086332    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="init-config-reloader"
Jul 09 18:48:10.086417 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086337    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="init-config-reloader"
Jul 09 18:48:10.086417 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086342    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="kube-rbac-proxy-thanos"
Jul 09 18:48:10.086417 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086348    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="kube-rbac-proxy-thanos"
Jul 09 18:48:10.086417 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086358    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="kube-rbac-proxy"
Jul 09 18:48:10.086417 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086365    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="kube-rbac-proxy"
Jul 09 18:48:10.086417 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086377    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="config-reloader"
Jul 09 18:48:10.086417 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086387    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="config-reloader"
Jul 09 18:48:10.086819 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086442    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8"} err="failed to get container status \"7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8\": rpc error: code = NotFound desc = could not find container \"7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8\": container with ID starting with 7f31fee0ec17a50e112b97ef4410e5de8e7920e5762f896db925f48a84665da8 not found: ID does not exist"
Jul 09 18:48:10.086819 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086464    2580 scope.go:117] "RemoveContainer" containerID="1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f"
Jul 09 18:48:10.086819 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086471    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="thanos-sidecar"
Jul 09 18:48:10.086819 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086484    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="prometheus"
Jul 09 18:48:10.086819 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086493    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="kube-rbac-proxy-thanos"
Jul 09 18:48:10.086819 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086503    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="kube-rbac-proxy"
Jul 09 18:48:10.086819 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086513    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="config-reloader"
Jul 09 18:48:10.086819 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086523    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" containerName="kube-rbac-proxy-web"
Jul 09 18:48:10.087098 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086896    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f"} err="failed to get container status \"1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f\": rpc error: code = NotFound desc = could not find container \"1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f\": container with ID starting with 1920bf01c40f16330ac0be148ac903a76d8fb23c5389cef63c3efedfda1f903f not found: ID does not exist"
Jul 09 18:48:10.087098 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.086917    2580 scope.go:117] "RemoveContainer" containerID="4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4"
Jul 09 18:48:10.087368 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.087347    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4"} err="failed to get container status \"4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4\": rpc error: code = NotFound desc = could not find container \"4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4\": container with ID starting with 4d808455100cee0dab5fdd07032e390aa06c53ce3a066034e8da67522be30aa4 not found: ID does not exist"
Jul 09 18:48:10.087476 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.087368    2580 scope.go:117] "RemoveContainer" containerID="5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a"
Jul 09 18:48:10.087620 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.087599    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a"} err="failed to get container status \"5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a\": rpc error: code = NotFound desc = could not find container \"5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a\": container with ID starting with 5b304e0e13532584fa7db254f8bc78e40a211378a0ea9692fdf387a16f075e6a not found: ID does not exist"
Jul 09 18:48:10.091990 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.091968    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.094776 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.094748    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 09 18:48:10.095140 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.095115    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 09 18:48:10.095225 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.095120    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 09 18:48:10.095439 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.095421    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9ag6ipukpunhb\""
Jul 09 18:48:10.095694 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.095606    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 09 18:48:10.095694 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.095657    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 09 18:48:10.095866 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.095749    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 09 18:48:10.096411 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.096359    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 09 18:48:10.096411 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.096368    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 09 18:48:10.096620 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.096601    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jxrdn\""
Jul 09 18:48:10.097207 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.097025    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 09 18:48:10.097207 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.097090    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 09 18:48:10.097207 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.097106    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 09 18:48:10.098039 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.097890    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 09 18:48:10.100260 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.100206    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 09 18:48:10.102980 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.102959    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 09 18:48:10.106960 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.106940    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 18:48:10.215894 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.215860    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-config\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.216126 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.215900    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.216126 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.215928    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.216126 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.215957    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.216126 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.215977    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a34232dd-2f96-4632-b4b3-d942f4f8ad95-config-out\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.216126 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.216018    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a34232dd-2f96-4632-b4b3-d942f4f8ad95-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.216126 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.216048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-web-config\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.216126 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.216072    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a34232dd-2f96-4632-b4b3-d942f4f8ad95-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.216126 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.216095    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a34232dd-2f96-4632-b4b3-d942f4f8ad95-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.216535 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.216138    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a34232dd-2f96-4632-b4b3-d942f4f8ad95-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.216535 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.216202    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.216535 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.216235    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.216535 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.216261    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a34232dd-2f96-4632-b4b3-d942f4f8ad95-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.216535 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.216288    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a34232dd-2f96-4632-b4b3-d942f4f8ad95-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.216535 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.216316    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.216535 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.216342    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a34232dd-2f96-4632-b4b3-d942f4f8ad95-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.216535 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.216365    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a34232dd-2f96-4632-b4b3-d942f4f8ad95-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.216535 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.216402    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.216535 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.216425    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxgl6\" (UniqueName: \"kubernetes.io/projected/a34232dd-2f96-4632-b4b3-d942f4f8ad95-kube-api-access-sxgl6\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.216535 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.216458    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a34232dd-2f96-4632-b4b3-d942f4f8ad95-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.317113 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.317034    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.317113 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.317068    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.317113 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.317090    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.317382 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.317210    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a34232dd-2f96-4632-b4b3-d942f4f8ad95-config-out\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.317382 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.317330    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a34232dd-2f96-4632-b4b3-d942f4f8ad95-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.317382 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.317374    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-web-config\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.317542 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.317405    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a34232dd-2f96-4632-b4b3-d942f4f8ad95-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.317708 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.317688    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a34232dd-2f96-4632-b4b3-d942f4f8ad95-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.317823 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.317730    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a34232dd-2f96-4632-b4b3-d942f4f8ad95-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.317823 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.317770    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.317823 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.317804    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.317993 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.317864    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a34232dd-2f96-4632-b4b3-d942f4f8ad95-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.317993 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.317891    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a34232dd-2f96-4632-b4b3-d942f4f8ad95-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.317993 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.317921    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.317993 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.317946    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a34232dd-2f96-4632-b4b3-d942f4f8ad95-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.317993 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.317970    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a34232dd-2f96-4632-b4b3-d942f4f8ad95-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.318220 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.318017    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.318220 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.318042    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxgl6\" (UniqueName: \"kubernetes.io/projected/a34232dd-2f96-4632-b4b3-d942f4f8ad95-kube-api-access-sxgl6\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.318220 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.318083    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a34232dd-2f96-4632-b4b3-d942f4f8ad95-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.318220 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.318124    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-config\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.318220 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.318141    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a34232dd-2f96-4632-b4b3-d942f4f8ad95-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.318457 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.318287    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a34232dd-2f96-4632-b4b3-d942f4f8ad95-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.318771 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.318744    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a34232dd-2f96-4632-b4b3-d942f4f8ad95-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.320383 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.320262    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.320383 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.320327    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-web-config\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.320383 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.320352    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a34232dd-2f96-4632-b4b3-d942f4f8ad95-config-out\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.320645 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.320618    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a34232dd-2f96-4632-b4b3-d942f4f8ad95-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.320781 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.320758    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.320869 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.320812    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a34232dd-2f96-4632-b4b3-d942f4f8ad95-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.321727 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.321050    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.321727 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.321435    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.321727 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.321435    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a34232dd-2f96-4632-b4b3-d942f4f8ad95-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.321727 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.321581    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a34232dd-2f96-4632-b4b3-d942f4f8ad95-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.321727 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.321707    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.322601 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.322572    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a34232dd-2f96-4632-b4b3-d942f4f8ad95-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.322686 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.322629    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.323513 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.323490    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.323769 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.323748    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a34232dd-2f96-4632-b4b3-d942f4f8ad95-config\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.323967 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.323950    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a34232dd-2f96-4632-b4b3-d942f4f8ad95-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.329208 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.329184    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxgl6\" (UniqueName: \"kubernetes.io/projected/a34232dd-2f96-4632-b4b3-d942f4f8ad95-kube-api-access-sxgl6\") pod \"prometheus-k8s-0\" (UID: \"a34232dd-2f96-4632-b4b3-d942f4f8ad95\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.403490 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.403458    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:48:10.560373 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:10.560217    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 18:48:10.562423 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:48:10.562393    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda34232dd_2f96_4632_b4b3_d942f4f8ad95.slice/crio-b91c3cce21203d58066aacf6384ea7749fc8710ca6e6e5ff3d2b46bf8eb5d644 WatchSource:0}: Error finding container b91c3cce21203d58066aacf6384ea7749fc8710ca6e6e5ff3d2b46bf8eb5d644: Status 404 returned error can't find the container with id b91c3cce21203d58066aacf6384ea7749fc8710ca6e6e5ff3d2b46bf8eb5d644
Jul 09 18:48:11.024875 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:11.024821    2580 generic.go:356] "Generic (PLEG): container finished" podID="a34232dd-2f96-4632-b4b3-d942f4f8ad95" containerID="397971dc6b39813ef497e6b65187af00c6f8117364777dcae240e7c0c2108ac2" exitCode=0
Jul 09 18:48:11.025275 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:11.024923    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a34232dd-2f96-4632-b4b3-d942f4f8ad95","Type":"ContainerDied","Data":"397971dc6b39813ef497e6b65187af00c6f8117364777dcae240e7c0c2108ac2"}
Jul 09 18:48:11.025275 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:11.025042    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a34232dd-2f96-4632-b4b3-d942f4f8ad95","Type":"ContainerStarted","Data":"b91c3cce21203d58066aacf6384ea7749fc8710ca6e6e5ff3d2b46bf8eb5d644"}
Jul 09 18:48:11.255310 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:11.255278    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c7398dc-4de4-4edd-8af8-c9539902ea0b" path="/var/lib/kubelet/pods/7c7398dc-4de4-4edd-8af8-c9539902ea0b/volumes"
Jul 09 18:48:12.032717 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:12.032682    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd" event={"ID":"82311880-326a-4676-9cc1-942a47b86e70","Type":"ContainerStarted","Data":"4a40706749c32ee2110756d94a35f3556cd87a80c098625fbdbbc265c37129ac"}
Jul 09 18:48:12.033178 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:12.032756    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd" event={"ID":"82311880-326a-4676-9cc1-942a47b86e70","Type":"ContainerStarted","Data":"481580a1e0a0cfae96010a5d9737a10751b33a156a29947f5e8fa0efa1b31b62"}
Jul 09 18:48:12.033178 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:12.032789    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd" event={"ID":"82311880-326a-4676-9cc1-942a47b86e70","Type":"ContainerStarted","Data":"599987ac1f381c7a75a83f367eef2189baa3655e3d08ca26b90dc2ebffa8ce0d"}
Jul 09 18:48:12.035997 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:12.035975    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a34232dd-2f96-4632-b4b3-d942f4f8ad95","Type":"ContainerStarted","Data":"5fe5f0f9ade00d81aa08e0f66c62ca7a85ccbf81342a8f801225ca69f4db3b2d"}
Jul 09 18:48:12.036106 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:12.036025    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a34232dd-2f96-4632-b4b3-d942f4f8ad95","Type":"ContainerStarted","Data":"4f3218e6bcebb36b43e52e9f1a987649db2d89ecc6dc4378cfc39a949c9ae2ca"}
Jul 09 18:48:12.036106 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:12.036054    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a34232dd-2f96-4632-b4b3-d942f4f8ad95","Type":"ContainerStarted","Data":"900502ee84a468981c00f5785e75173b078d2a943e05b0e2f2c501f5340e5d81"}
Jul 09 18:48:12.036106 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:12.036077    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a34232dd-2f96-4632-b4b3-d942f4f8ad95","Type":"ContainerStarted","Data":"9459b45710f47a7e32d54c54ccab18e8214cdf8ccb989719c8dae19133773e6c"}
Jul 09 18:48:12.036106 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:12.036099    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a34232dd-2f96-4632-b4b3-d942f4f8ad95","Type":"ContainerStarted","Data":"1a331868d7a64c6c63eeb4f1c60ae7f3d8c571a704da70855df69c599610b6b1"}
Jul 09 18:48:12.036241 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:12.036123    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a34232dd-2f96-4632-b4b3-d942f4f8ad95","Type":"ContainerStarted","Data":"f3824561466aab33e231de764602da436657e0c8327fbac74922eda0a7cae89d"}
Jul 09 18:48:12.063991 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:12.063940    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5968c46dc4-m9rdd" podStartSLOduration=2.140383654 podStartE2EDuration="4.063922328s" totalImagesPullingTime="1.923538674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:48:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:48:12.061623985 +0000 UTC m=+147.271213227" watchObservedRunningTime="2026-07-09 18:48:12.063922328 +0000 UTC m=+147.273511546"
Jul 09 18:48:12.101021 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:12.100967    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.07938274 podStartE2EDuration="2.100949599s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.566859ms" isStatefulPod=false podCreationTimestamp="2026-07-09 18:48:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:48:12.098697623 +0000 UTC m=+147.308286842" watchObservedRunningTime="2026-07-09 18:48:12.100949599 +0000 UTC m=+147.310538820"
Jul 09 18:48:15.404169 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:48:15.404116    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:49:10.403897 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:49:10.403859    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:49:10.419456 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:49:10.419429    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:49:11.292350 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:49:11.292324    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 18:50:45.132588 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:50:45.132554    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hps7x_30222ae0-b5d2-440e-a799-e808706d4b84/ovn-acl-logging/0.log"
Jul 09 18:50:45.136271 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:50:45.136253    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hps7x_30222ae0-b5d2-440e-a799-e808706d4b84/ovn-acl-logging/0.log"
Jul 09 18:50:45.139737 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:50:45.139722    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 18:51:00.100675 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:00.100639    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2q97s"]
Jul 09 18:51:00.103800 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:00.103784    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2q97s"
Jul 09 18:51:00.106496 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:00.106477    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 18:51:00.106602 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:00.106518    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 18:51:00.107539 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:00.107525    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4w8tf\""
Jul 09 18:51:00.115098 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:00.115076    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2q97s"]
Jul 09 18:51:00.204413 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:00.204371    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hblf4\" (UniqueName: \"kubernetes.io/projected/db8e5b01-6b27-4d5f-954b-0b85070a5d1d-kube-api-access-hblf4\") pod \"cert-manager-cainjector-559cdd8c87-2q97s\" (UID: \"db8e5b01-6b27-4d5f-954b-0b85070a5d1d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2q97s"
Jul 09 18:51:00.204593 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:00.204434    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db8e5b01-6b27-4d5f-954b-0b85070a5d1d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2q97s\" (UID: \"db8e5b01-6b27-4d5f-954b-0b85070a5d1d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2q97s"
Jul 09 18:51:00.305467 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:00.305431    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hblf4\" (UniqueName: \"kubernetes.io/projected/db8e5b01-6b27-4d5f-954b-0b85070a5d1d-kube-api-access-hblf4\") pod \"cert-manager-cainjector-559cdd8c87-2q97s\" (UID: \"db8e5b01-6b27-4d5f-954b-0b85070a5d1d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2q97s"
Jul 09 18:51:00.305666 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:00.305605    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db8e5b01-6b27-4d5f-954b-0b85070a5d1d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2q97s\" (UID: \"db8e5b01-6b27-4d5f-954b-0b85070a5d1d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2q97s"
Jul 09 18:51:00.315180 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:00.315151    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hblf4\" (UniqueName: \"kubernetes.io/projected/db8e5b01-6b27-4d5f-954b-0b85070a5d1d-kube-api-access-hblf4\") pod \"cert-manager-cainjector-559cdd8c87-2q97s\" (UID: \"db8e5b01-6b27-4d5f-954b-0b85070a5d1d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2q97s"
Jul 09 18:51:00.315180 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:00.315157    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db8e5b01-6b27-4d5f-954b-0b85070a5d1d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2q97s\" (UID: \"db8e5b01-6b27-4d5f-954b-0b85070a5d1d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2q97s"
Jul 09 18:51:00.425492 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:00.425417    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2q97s"
Jul 09 18:51:00.555209 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:00.555189    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2q97s"]
Jul 09 18:51:00.557869 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:51:00.557841    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb8e5b01_6b27_4d5f_954b_0b85070a5d1d.slice/crio-5ec90417b2b7d6ac03144a5db8529019d350c2211866bdd82891200ef6bf5df6 WatchSource:0}: Error finding container 5ec90417b2b7d6ac03144a5db8529019d350c2211866bdd82891200ef6bf5df6: Status 404 returned error can't find the container with id 5ec90417b2b7d6ac03144a5db8529019d350c2211866bdd82891200ef6bf5df6
Jul 09 18:51:00.559805 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:00.559788    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 18:51:00.709668 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:00.709639    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2q97s" event={"ID":"db8e5b01-6b27-4d5f-954b-0b85070a5d1d","Type":"ContainerStarted","Data":"5ec90417b2b7d6ac03144a5db8529019d350c2211866bdd82891200ef6bf5df6"}
Jul 09 18:51:03.725510 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:03.725474    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2q97s" event={"ID":"db8e5b01-6b27-4d5f-954b-0b85070a5d1d","Type":"ContainerStarted","Data":"4c2d63226136be6977a391c637fe6f1581e76906e86566ca90440e02e2ab03f3"}
Jul 09 18:51:03.745119 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:03.745071    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2q97s" podStartSLOduration=0.664360328 podStartE2EDuration="3.745051221s" totalImagesPullingTime="3.080690893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:51:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:51:03.743437456 +0000 UTC m=+318.953026700" watchObservedRunningTime="2026-07-09 18:51:03.745051221 +0000 UTC m=+318.954640439"
Jul 09 18:51:07.205812 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:07.205784    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xqshh"]
Jul 09 18:51:07.209035 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:07.209020    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-xqshh"
Jul 09 18:51:07.212766 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:07.212750    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-vl5bh\""
Jul 09 18:51:07.220965 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:07.220944    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xqshh"]
Jul 09 18:51:07.269551 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:07.269522    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjc66\" (UniqueName: \"kubernetes.io/projected/a5841da9-125e-4768-a854-402847073e8c-kube-api-access-jjc66\") pod \"cert-manager-55b4d954d5-xqshh\" (UID: \"a5841da9-125e-4768-a854-402847073e8c\") " pod="cert-manager/cert-manager-55b4d954d5-xqshh"
Jul 09 18:51:07.269788 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:07.269582    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5841da9-125e-4768-a854-402847073e8c-bound-sa-token\") pod \"cert-manager-55b4d954d5-xqshh\" (UID: \"a5841da9-125e-4768-a854-402847073e8c\") " pod="cert-manager/cert-manager-55b4d954d5-xqshh"
Jul 09 18:51:07.370677 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:07.370639    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjc66\" (UniqueName: \"kubernetes.io/projected/a5841da9-125e-4768-a854-402847073e8c-kube-api-access-jjc66\") pod \"cert-manager-55b4d954d5-xqshh\" (UID: \"a5841da9-125e-4768-a854-402847073e8c\") " pod="cert-manager/cert-manager-55b4d954d5-xqshh"
Jul 09 18:51:07.370879 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:07.370691    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5841da9-125e-4768-a854-402847073e8c-bound-sa-token\") pod \"cert-manager-55b4d954d5-xqshh\" (UID: \"a5841da9-125e-4768-a854-402847073e8c\") " pod="cert-manager/cert-manager-55b4d954d5-xqshh"
Jul 09 18:51:07.381308 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:07.381281    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5841da9-125e-4768-a854-402847073e8c-bound-sa-token\") pod \"cert-manager-55b4d954d5-xqshh\" (UID: \"a5841da9-125e-4768-a854-402847073e8c\") " pod="cert-manager/cert-manager-55b4d954d5-xqshh"
Jul 09 18:51:07.381890 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:07.381873    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjc66\" (UniqueName: \"kubernetes.io/projected/a5841da9-125e-4768-a854-402847073e8c-kube-api-access-jjc66\") pod \"cert-manager-55b4d954d5-xqshh\" (UID: \"a5841da9-125e-4768-a854-402847073e8c\") " pod="cert-manager/cert-manager-55b4d954d5-xqshh"
Jul 09 18:51:07.517985 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:07.517955    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-xqshh"
Jul 09 18:51:07.649855 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:07.649816    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xqshh"]
Jul 09 18:51:07.651406 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:51:07.651379    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5841da9_125e_4768_a854_402847073e8c.slice/crio-41ee86c36adc3ae97c12d6d8e09004c2a7b42700f7b4ca09ae3a81989db575af WatchSource:0}: Error finding container 41ee86c36adc3ae97c12d6d8e09004c2a7b42700f7b4ca09ae3a81989db575af: Status 404 returned error can't find the container with id 41ee86c36adc3ae97c12d6d8e09004c2a7b42700f7b4ca09ae3a81989db575af
Jul 09 18:51:07.743490 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:07.743452    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-xqshh" event={"ID":"a5841da9-125e-4768-a854-402847073e8c","Type":"ContainerStarted","Data":"e4a968da74fec3dfa91209eb7bdcddd5deac11d87ccd92a1a172df07fa82df9c"}
Jul 09 18:51:07.743490 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:07.743496    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-xqshh" event={"ID":"a5841da9-125e-4768-a854-402847073e8c","Type":"ContainerStarted","Data":"41ee86c36adc3ae97c12d6d8e09004c2a7b42700f7b4ca09ae3a81989db575af"}
Jul 09 18:51:07.766573 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:07.766523    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-xqshh" podStartSLOduration=0.766501882 podStartE2EDuration="766.501882ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:51:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:51:07.765792452 +0000 UTC m=+322.975381673" watchObservedRunningTime="2026-07-09 18:51:07.766501882 +0000 UTC m=+322.976091100"
Jul 09 18:51:32.840438 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:32.840407    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw"]
Jul 09 18:51:32.846561 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:32.846539    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw"
Jul 09 18:51:32.849104 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:32.849079    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 18:51:32.849672 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:32.849651    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 18:51:32.849960 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:32.849942    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 18:51:32.850083 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:32.849949    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9cq6g\""
Jul 09 18:51:32.850777 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:32.850759    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 18:51:32.860083 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:32.860061    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw"]
Jul 09 18:51:33.000058 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:33.000013    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31374bb4-4673-4bd5-b031-69446db921c5-tmp\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-65ldw\" (UID: \"31374bb4-4673-4bd5-b031-69446db921c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw"
Jul 09 18:51:33.000058 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:33.000059    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31374bb4-4673-4bd5-b031-69446db921c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-65ldw\" (UID: \"31374bb4-4673-4bd5-b031-69446db921c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw"
Jul 09 18:51:33.000346 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:33.000175    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8mx2\" (UniqueName: \"kubernetes.io/projected/31374bb4-4673-4bd5-b031-69446db921c5-kube-api-access-p8mx2\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-65ldw\" (UID: \"31374bb4-4673-4bd5-b031-69446db921c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw"
Jul 09 18:51:33.000346 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:33.000251    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/31374bb4-4673-4bd5-b031-69446db921c5-manifests\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-65ldw\" (UID: \"31374bb4-4673-4bd5-b031-69446db921c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw"
Jul 09 18:51:33.000346 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:33.000298    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/31374bb4-4673-4bd5-b031-69446db921c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-65ldw\" (UID: \"31374bb4-4673-4bd5-b031-69446db921c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw"
Jul 09 18:51:33.101230 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:33.101139    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/31374bb4-4673-4bd5-b031-69446db921c5-manifests\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-65ldw\" (UID: \"31374bb4-4673-4bd5-b031-69446db921c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw"
Jul 09 18:51:33.101230 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:33.101185    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/31374bb4-4673-4bd5-b031-69446db921c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-65ldw\" (UID: \"31374bb4-4673-4bd5-b031-69446db921c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw"
Jul 09 18:51:33.101230 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:33.101220    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31374bb4-4673-4bd5-b031-69446db921c5-tmp\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-65ldw\" (UID: \"31374bb4-4673-4bd5-b031-69446db921c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw"
Jul 09 18:51:33.101529 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:33.101240    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31374bb4-4673-4bd5-b031-69446db921c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-65ldw\" (UID: \"31374bb4-4673-4bd5-b031-69446db921c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw"
Jul 09 18:51:33.101529 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:33.101277    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8mx2\" (UniqueName: \"kubernetes.io/projected/31374bb4-4673-4bd5-b031-69446db921c5-kube-api-access-p8mx2\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-65ldw\" (UID: \"31374bb4-4673-4bd5-b031-69446db921c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw"
Jul 09 18:51:33.101635 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:33.101541    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/31374bb4-4673-4bd5-b031-69446db921c5-manifests\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-65ldw\" (UID: \"31374bb4-4673-4bd5-b031-69446db921c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw"
Jul 09 18:51:33.103611 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:33.103580    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31374bb4-4673-4bd5-b031-69446db921c5-tmp\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-65ldw\" (UID: \"31374bb4-4673-4bd5-b031-69446db921c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw"
Jul 09 18:51:33.103949 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:33.103927    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31374bb4-4673-4bd5-b031-69446db921c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-65ldw\" (UID: \"31374bb4-4673-4bd5-b031-69446db921c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw"
Jul 09 18:51:33.103996 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:33.103927    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/31374bb4-4673-4bd5-b031-69446db921c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-65ldw\" (UID: \"31374bb4-4673-4bd5-b031-69446db921c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw"
Jul 09 18:51:33.111230 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:33.111198    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8mx2\" (UniqueName: \"kubernetes.io/projected/31374bb4-4673-4bd5-b031-69446db921c5-kube-api-access-p8mx2\") pod \"opendatahub-operator-controller-manager-5c9d9c8f47-65ldw\" (UID: \"31374bb4-4673-4bd5-b031-69446db921c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw"
Jul 09 18:51:33.160069 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:33.160030    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw"
Jul 09 18:51:33.339937 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:33.339914    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw"]
Jul 09 18:51:33.342129 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:51:33.342102    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31374bb4_4673_4bd5_b031_69446db921c5.slice/crio-e4b33943cbf000fe6bbac70edcf0805fc8b76249667c2302a48750e14237da56 WatchSource:0}: Error finding container e4b33943cbf000fe6bbac70edcf0805fc8b76249667c2302a48750e14237da56: Status 404 returned error can't find the container with id e4b33943cbf000fe6bbac70edcf0805fc8b76249667c2302a48750e14237da56
Jul 09 18:51:33.851889 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:33.851853    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw" event={"ID":"31374bb4-4673-4bd5-b031-69446db921c5","Type":"ContainerStarted","Data":"e4b33943cbf000fe6bbac70edcf0805fc8b76249667c2302a48750e14237da56"}
Jul 09 18:51:36.868768 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:36.868735    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw" event={"ID":"31374bb4-4673-4bd5-b031-69446db921c5","Type":"ContainerStarted","Data":"43f7629bc9127ac9ba675422361f0d1d84fb5ccf1430626ee7864d0c13a1b551"}
Jul 09 18:51:37.875380 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:37.875342    2580 generic.go:356] "Generic (PLEG): container finished" podID="31374bb4-4673-4bd5-b031-69446db921c5" containerID="43f7629bc9127ac9ba675422361f0d1d84fb5ccf1430626ee7864d0c13a1b551" exitCode=0
Jul 09 18:51:37.875869 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:37.875409    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw" event={"ID":"31374bb4-4673-4bd5-b031-69446db921c5","Type":"ContainerDied","Data":"43f7629bc9127ac9ba675422361f0d1d84fb5ccf1430626ee7864d0c13a1b551"}
Jul 09 18:51:38.883378 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:38.883342    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw" event={"ID":"31374bb4-4673-4bd5-b031-69446db921c5","Type":"ContainerStarted","Data":"43bb7a71158c748c591dc9686bf34377d8d3202f41320606118ad90bccd21aa6"}
Jul 09 18:51:38.883763 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:38.883484    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw"
Jul 09 18:51:38.908137 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:38.908083    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw" podStartSLOduration=2.4099137600000002 podStartE2EDuration="6.908062277s" totalImagesPullingTime="3.43777921s" totalInitContainerRuntime="1.060369307s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:51:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:51:38.906960962 +0000 UTC m=+354.116550181" watchObservedRunningTime="2026-07-09 18:51:38.908062277 +0000 UTC m=+354.117651496"
Jul 09 18:51:49.889445 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:49.889415    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c9d9c8f47-65ldw"
Jul 09 18:51:52.814661 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.814627    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-9qzph"]
Jul 09 18:51:52.828003 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.827970    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-9qzph"
Jul 09 18:51:52.831095 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.831063    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 09 18:51:52.832783 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.832350    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 09 18:51:52.832783 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.832370    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 09 18:51:52.832783 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.832379    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-p2hnx\""
Jul 09 18:51:52.832783 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.832610    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:51:52.832783 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.832672    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 18:51:52.833517 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.833495    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-9qzph"]
Jul 09 18:51:52.843573 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.843549    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-86888fb94c-5tcgr"]
Jul 09 18:51:52.846954 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.846934    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86888fb94c-5tcgr"
Jul 09 18:51:52.850083 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.850059    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 09 18:51:52.850199 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.850144    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mv78f\""
Jul 09 18:51:52.850300 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.850283    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 09 18:51:52.850607 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.850592    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 18:51:52.850684 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.850661    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 18:51:52.871343 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.871310    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86888fb94c-5tcgr"]
Jul 09 18:51:52.877111 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.877071    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecf91263-9e9b-4bc9-b372-57c5d7889f03-tls-certs\") pod \"kube-auth-proxy-86888fb94c-5tcgr\" (UID: \"ecf91263-9e9b-4bc9-b372-57c5d7889f03\") " pod="openshift-ingress/kube-auth-proxy-86888fb94c-5tcgr"
Jul 09 18:51:52.877269 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.877205    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4dbf2bb5-0fc1-4b67-b23b-58d36014cc53-metrics-cert\") pod \"lws-controller-manager-5f9b9fdbf7-9qzph\" (UID: \"4dbf2bb5-0fc1-4b67-b23b-58d36014cc53\") " pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-9qzph"
Jul 09 18:51:52.877269 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.877254    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9ljf\" (UniqueName: \"kubernetes.io/projected/ecf91263-9e9b-4bc9-b372-57c5d7889f03-kube-api-access-n9ljf\") pod \"kube-auth-proxy-86888fb94c-5tcgr\" (UID: \"ecf91263-9e9b-4bc9-b372-57c5d7889f03\") " pod="openshift-ingress/kube-auth-proxy-86888fb94c-5tcgr"
Jul 09 18:51:52.877398 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.877300    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4dbf2bb5-0fc1-4b67-b23b-58d36014cc53-manager-config\") pod \"lws-controller-manager-5f9b9fdbf7-9qzph\" (UID: \"4dbf2bb5-0fc1-4b67-b23b-58d36014cc53\") " pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-9qzph"
Jul 09 18:51:52.877398 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.877332    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecf91263-9e9b-4bc9-b372-57c5d7889f03-tmp\") pod \"kube-auth-proxy-86888fb94c-5tcgr\" (UID: \"ecf91263-9e9b-4bc9-b372-57c5d7889f03\") " pod="openshift-ingress/kube-auth-proxy-86888fb94c-5tcgr"
Jul 09 18:51:52.877398 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.877366    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm5ct\" (UniqueName: \"kubernetes.io/projected/4dbf2bb5-0fc1-4b67-b23b-58d36014cc53-kube-api-access-rm5ct\") pod \"lws-controller-manager-5f9b9fdbf7-9qzph\" (UID: \"4dbf2bb5-0fc1-4b67-b23b-58d36014cc53\") " pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-9qzph"
Jul 09 18:51:52.877577 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.877438    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4dbf2bb5-0fc1-4b67-b23b-58d36014cc53-cert\") pod \"lws-controller-manager-5f9b9fdbf7-9qzph\" (UID: \"4dbf2bb5-0fc1-4b67-b23b-58d36014cc53\") " pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-9qzph"
Jul 09 18:51:52.979238 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.979193    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4dbf2bb5-0fc1-4b67-b23b-58d36014cc53-cert\") pod \"lws-controller-manager-5f9b9fdbf7-9qzph\" (UID: \"4dbf2bb5-0fc1-4b67-b23b-58d36014cc53\") " pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-9qzph"
Jul 09 18:51:52.979438 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.979312    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecf91263-9e9b-4bc9-b372-57c5d7889f03-tls-certs\") pod \"kube-auth-proxy-86888fb94c-5tcgr\" (UID: \"ecf91263-9e9b-4bc9-b372-57c5d7889f03\") " pod="openshift-ingress/kube-auth-proxy-86888fb94c-5tcgr"
Jul 09 18:51:52.979438 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.979355    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4dbf2bb5-0fc1-4b67-b23b-58d36014cc53-metrics-cert\") pod \"lws-controller-manager-5f9b9fdbf7-9qzph\" (UID: \"4dbf2bb5-0fc1-4b67-b23b-58d36014cc53\") " pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-9qzph"
Jul 09 18:51:52.979594 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.979468    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9ljf\" (UniqueName: \"kubernetes.io/projected/ecf91263-9e9b-4bc9-b372-57c5d7889f03-kube-api-access-n9ljf\") pod \"kube-auth-proxy-86888fb94c-5tcgr\" (UID: \"ecf91263-9e9b-4bc9-b372-57c5d7889f03\") " pod="openshift-ingress/kube-auth-proxy-86888fb94c-5tcgr"
Jul 09 18:51:52.979594 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:51:52.979492    2580 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 09 18:51:52.979594 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.979521    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4dbf2bb5-0fc1-4b67-b23b-58d36014cc53-manager-config\") pod \"lws-controller-manager-5f9b9fdbf7-9qzph\" (UID: \"4dbf2bb5-0fc1-4b67-b23b-58d36014cc53\") " pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-9qzph"
Jul 09 18:51:52.979747 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:51:52.979600    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecf91263-9e9b-4bc9-b372-57c5d7889f03-tls-certs podName:ecf91263-9e9b-4bc9-b372-57c5d7889f03 nodeName:}" failed. No retries permitted until 2026-07-09 18:51:53.479576925 +0000 UTC m=+368.689166139 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/ecf91263-9e9b-4bc9-b372-57c5d7889f03-tls-certs") pod "kube-auth-proxy-86888fb94c-5tcgr" (UID: "ecf91263-9e9b-4bc9-b372-57c5d7889f03") : secret "kube-auth-proxy-tls" not found
Jul 09 18:51:52.979747 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.979626    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecf91263-9e9b-4bc9-b372-57c5d7889f03-tmp\") pod \"kube-auth-proxy-86888fb94c-5tcgr\" (UID: \"ecf91263-9e9b-4bc9-b372-57c5d7889f03\") " pod="openshift-ingress/kube-auth-proxy-86888fb94c-5tcgr"
Jul 09 18:51:52.979747 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.979667    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm5ct\" (UniqueName: \"kubernetes.io/projected/4dbf2bb5-0fc1-4b67-b23b-58d36014cc53-kube-api-access-rm5ct\") pod \"lws-controller-manager-5f9b9fdbf7-9qzph\" (UID: \"4dbf2bb5-0fc1-4b67-b23b-58d36014cc53\") " pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-9qzph"
Jul 09 18:51:52.980733 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.980704    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4dbf2bb5-0fc1-4b67-b23b-58d36014cc53-manager-config\") pod \"lws-controller-manager-5f9b9fdbf7-9qzph\" (UID: \"4dbf2bb5-0fc1-4b67-b23b-58d36014cc53\") " pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-9qzph"
Jul 09 18:51:52.982634 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.982555    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecf91263-9e9b-4bc9-b372-57c5d7889f03-tmp\") pod \"kube-auth-proxy-86888fb94c-5tcgr\" (UID: \"ecf91263-9e9b-4bc9-b372-57c5d7889f03\") " pod="openshift-ingress/kube-auth-proxy-86888fb94c-5tcgr"
Jul 09 18:51:52.982755 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.982695    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4dbf2bb5-0fc1-4b67-b23b-58d36014cc53-metrics-cert\") pod \"lws-controller-manager-5f9b9fdbf7-9qzph\" (UID: \"4dbf2bb5-0fc1-4b67-b23b-58d36014cc53\") " pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-9qzph"
Jul 09 18:51:52.982821 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.982753    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4dbf2bb5-0fc1-4b67-b23b-58d36014cc53-cert\") pod \"lws-controller-manager-5f9b9fdbf7-9qzph\" (UID: \"4dbf2bb5-0fc1-4b67-b23b-58d36014cc53\") " pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-9qzph"
Jul 09 18:51:52.991749 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.991723    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9ljf\" (UniqueName: \"kubernetes.io/projected/ecf91263-9e9b-4bc9-b372-57c5d7889f03-kube-api-access-n9ljf\") pod \"kube-auth-proxy-86888fb94c-5tcgr\" (UID: \"ecf91263-9e9b-4bc9-b372-57c5d7889f03\") " pod="openshift-ingress/kube-auth-proxy-86888fb94c-5tcgr"
Jul 09 18:51:52.995924 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:52.995893    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm5ct\" (UniqueName: \"kubernetes.io/projected/4dbf2bb5-0fc1-4b67-b23b-58d36014cc53-kube-api-access-rm5ct\") pod \"lws-controller-manager-5f9b9fdbf7-9qzph\" (UID: \"4dbf2bb5-0fc1-4b67-b23b-58d36014cc53\") " pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-9qzph"
Jul 09 18:51:53.141589 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:53.141497    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-9qzph"
Jul 09 18:51:53.284893 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:53.284858    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-9qzph"]
Jul 09 18:51:53.287824 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:51:53.287798    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dbf2bb5_0fc1_4b67_b23b_58d36014cc53.slice/crio-7f7892f99efd6d53ec2ae67946fe65bc472f676d1fefb9a4aa4306b0a425f447 WatchSource:0}: Error finding container 7f7892f99efd6d53ec2ae67946fe65bc472f676d1fefb9a4aa4306b0a425f447: Status 404 returned error can't find the container with id 7f7892f99efd6d53ec2ae67946fe65bc472f676d1fefb9a4aa4306b0a425f447
Jul 09 18:51:53.484066 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:53.484030    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecf91263-9e9b-4bc9-b372-57c5d7889f03-tls-certs\") pod \"kube-auth-proxy-86888fb94c-5tcgr\" (UID: \"ecf91263-9e9b-4bc9-b372-57c5d7889f03\") " pod="openshift-ingress/kube-auth-proxy-86888fb94c-5tcgr"
Jul 09 18:51:53.486617 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:53.486584    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecf91263-9e9b-4bc9-b372-57c5d7889f03-tls-certs\") pod \"kube-auth-proxy-86888fb94c-5tcgr\" (UID: \"ecf91263-9e9b-4bc9-b372-57c5d7889f03\") " pod="openshift-ingress/kube-auth-proxy-86888fb94c-5tcgr"
Jul 09 18:51:53.757874 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:53.757769    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86888fb94c-5tcgr"
Jul 09 18:51:53.930820 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:53.930730    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86888fb94c-5tcgr"]
Jul 09 18:51:53.938800 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:51:53.938335    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecf91263_9e9b_4bc9_b372_57c5d7889f03.slice/crio-c3a2f7e5970ea6aef43649aa37242c05517c0adcc498b83591d34cbba382bed7 WatchSource:0}: Error finding container c3a2f7e5970ea6aef43649aa37242c05517c0adcc498b83591d34cbba382bed7: Status 404 returned error can't find the container with id c3a2f7e5970ea6aef43649aa37242c05517c0adcc498b83591d34cbba382bed7
Jul 09 18:51:53.966160 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:53.966124    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86888fb94c-5tcgr" event={"ID":"ecf91263-9e9b-4bc9-b372-57c5d7889f03","Type":"ContainerStarted","Data":"c3a2f7e5970ea6aef43649aa37242c05517c0adcc498b83591d34cbba382bed7"}
Jul 09 18:51:53.967398 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:53.967375    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-9qzph" event={"ID":"4dbf2bb5-0fc1-4b67-b23b-58d36014cc53","Type":"ContainerStarted","Data":"7f7892f99efd6d53ec2ae67946fe65bc472f676d1fefb9a4aa4306b0a425f447"}
Jul 09 18:51:56.986821 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:56.986773    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-9qzph" event={"ID":"4dbf2bb5-0fc1-4b67-b23b-58d36014cc53","Type":"ContainerStarted","Data":"c187618f16cbc20bb84cc7fb15c8a9e4ec0489221600700475faebbb951a9e1c"}
Jul 09 18:51:56.987293 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:56.986904    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-9qzph"
Jul 09 18:51:57.008762 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:57.008698    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-9qzph" podStartSLOduration=2.179794895 podStartE2EDuration="5.008672212s" totalImagesPullingTime="2.828877317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:51:57.007716104 +0000 UTC m=+372.217305329" watchObservedRunningTime="2026-07-09 18:51:57.008672212 +0000 UTC m=+372.218261434"
Jul 09 18:51:57.993692 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:57.993597    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86888fb94c-5tcgr" event={"ID":"ecf91263-9e9b-4bc9-b372-57c5d7889f03","Type":"ContainerStarted","Data":"f1f6f3ab7c4b0145c7f9fe881e65baeac4d7b98de742c95570aa62670656800d"}
Jul 09 18:51:58.015749 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:51:58.015696    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-86888fb94c-5tcgr" podStartSLOduration=2.218092767 podStartE2EDuration="6.015678832s" totalImagesPullingTime="3.797586065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:51:58.014021926 +0000 UTC m=+373.223611166" watchObservedRunningTime="2026-07-09 18:51:58.015678832 +0000 UTC m=+373.225268050"
Jul 09 18:52:07.996342 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:52:07.996309    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5f9b9fdbf7-9qzph"
Jul 09 18:53:40.547479 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:40.547406    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sq852"]
Jul 09 18:53:40.550797 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:40.550777    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sq852"
Jul 09 18:53:40.555414 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:40.555387    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 18:53:40.555534 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:40.555482    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 18:53:40.555534 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:40.555504    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 09 18:53:40.555534 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:40.555518    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 09 18:53:40.556435 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:40.556417    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4qkh2\""
Jul 09 18:53:40.566754 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:40.566731    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sq852"]
Jul 09 18:53:40.630035 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:40.630010    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdmnh\" (UniqueName: \"kubernetes.io/projected/b2f7000c-1dd8-4988-9239-dbb6a865872e-kube-api-access-cdmnh\") pod \"kuadrant-console-plugin-66b5774985-sq852\" (UID: \"b2f7000c-1dd8-4988-9239-dbb6a865872e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sq852"
Jul 09 18:53:40.630169 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:40.630059    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b2f7000c-1dd8-4988-9239-dbb6a865872e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sq852\" (UID: \"b2f7000c-1dd8-4988-9239-dbb6a865872e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sq852"
Jul 09 18:53:40.630169 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:40.630083    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2f7000c-1dd8-4988-9239-dbb6a865872e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sq852\" (UID: \"b2f7000c-1dd8-4988-9239-dbb6a865872e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sq852"
Jul 09 18:53:40.730705 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:40.730674    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdmnh\" (UniqueName: \"kubernetes.io/projected/b2f7000c-1dd8-4988-9239-dbb6a865872e-kube-api-access-cdmnh\") pod \"kuadrant-console-plugin-66b5774985-sq852\" (UID: \"b2f7000c-1dd8-4988-9239-dbb6a865872e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sq852"
Jul 09 18:53:40.730871 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:40.730730    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b2f7000c-1dd8-4988-9239-dbb6a865872e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sq852\" (UID: \"b2f7000c-1dd8-4988-9239-dbb6a865872e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sq852"
Jul 09 18:53:40.730871 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:40.730762    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2f7000c-1dd8-4988-9239-dbb6a865872e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sq852\" (UID: \"b2f7000c-1dd8-4988-9239-dbb6a865872e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sq852"
Jul 09 18:53:40.731515 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:40.731494    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b2f7000c-1dd8-4988-9239-dbb6a865872e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sq852\" (UID: \"b2f7000c-1dd8-4988-9239-dbb6a865872e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sq852"
Jul 09 18:53:40.733214 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:40.733194    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2f7000c-1dd8-4988-9239-dbb6a865872e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sq852\" (UID: \"b2f7000c-1dd8-4988-9239-dbb6a865872e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sq852"
Jul 09 18:53:40.740405 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:40.740379    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdmnh\" (UniqueName: \"kubernetes.io/projected/b2f7000c-1dd8-4988-9239-dbb6a865872e-kube-api-access-cdmnh\") pod \"kuadrant-console-plugin-66b5774985-sq852\" (UID: \"b2f7000c-1dd8-4988-9239-dbb6a865872e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sq852"
Jul 09 18:53:40.859966 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:40.859887    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sq852"
Jul 09 18:53:40.993726 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:40.993697    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sq852"]
Jul 09 18:53:40.996085 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:53:40.996053    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2f7000c_1dd8_4988_9239_dbb6a865872e.slice/crio-02e9e41e898969f9708edc8f3977c2ef618aeb9bd4b8fb17b0003d5b1d2d9093 WatchSource:0}: Error finding container 02e9e41e898969f9708edc8f3977c2ef618aeb9bd4b8fb17b0003d5b1d2d9093: Status 404 returned error can't find the container with id 02e9e41e898969f9708edc8f3977c2ef618aeb9bd4b8fb17b0003d5b1d2d9093
Jul 09 18:53:41.481276 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:41.481244    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sq852" event={"ID":"b2f7000c-1dd8-4988-9239-dbb6a865872e","Type":"ContainerStarted","Data":"02e9e41e898969f9708edc8f3977c2ef618aeb9bd4b8fb17b0003d5b1d2d9093"}
Jul 09 18:53:51.643473 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:51.643426    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h5psj"]
Jul 09 18:53:51.651175 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:51.651148    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h5psj"
Jul 09 18:53:51.654190 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:51.654161    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-t7cpt\""
Jul 09 18:53:51.661978 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:51.661384    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h5psj"]
Jul 09 18:53:51.736341 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:51.736293    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddr8f\" (UniqueName: \"kubernetes.io/projected/67632df0-1ade-4fde-9302-2351b7af767e-kube-api-access-ddr8f\") pod \"limitador-operator-controller-manager-859d7b78bd-h5psj\" (UID: \"67632df0-1ade-4fde-9302-2351b7af767e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h5psj"
Jul 09 18:53:51.837838 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:51.837794    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddr8f\" (UniqueName: \"kubernetes.io/projected/67632df0-1ade-4fde-9302-2351b7af767e-kube-api-access-ddr8f\") pod \"limitador-operator-controller-manager-859d7b78bd-h5psj\" (UID: \"67632df0-1ade-4fde-9302-2351b7af767e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h5psj"
Jul 09 18:53:51.856098 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:51.856072    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddr8f\" (UniqueName: \"kubernetes.io/projected/67632df0-1ade-4fde-9302-2351b7af767e-kube-api-access-ddr8f\") pod \"limitador-operator-controller-manager-859d7b78bd-h5psj\" (UID: \"67632df0-1ade-4fde-9302-2351b7af767e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h5psj"
Jul 09 18:53:51.966457 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:53:51.966430    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h5psj"
Jul 09 18:54:05.128796 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:54:05.128768    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h5psj"]
Jul 09 18:54:05.132018 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:54:05.131993    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67632df0_1ade_4fde_9302_2351b7af767e.slice/crio-ae76f24d1a28df91eca67fd284bf280d9c2d284c38d7ee88fc503dbb4d7e1837 WatchSource:0}: Error finding container ae76f24d1a28df91eca67fd284bf280d9c2d284c38d7ee88fc503dbb4d7e1837: Status 404 returned error can't find the container with id ae76f24d1a28df91eca67fd284bf280d9c2d284c38d7ee88fc503dbb4d7e1837
Jul 09 18:54:05.623248 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:54:05.623212    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h5psj" event={"ID":"67632df0-1ade-4fde-9302-2351b7af767e","Type":"ContainerStarted","Data":"ae76f24d1a28df91eca67fd284bf280d9c2d284c38d7ee88fc503dbb4d7e1837"}
Jul 09 18:54:05.624768 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:54:05.624739    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sq852" event={"ID":"b2f7000c-1dd8-4988-9239-dbb6a865872e","Type":"ContainerStarted","Data":"f4a23690386ca6932eb7fa416d7d3c804b1ee21b5c1e4a0a32f5b8058c03e38a"}
Jul 09 18:54:05.649769 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:54:05.649728    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sq852" podStartSLOduration=1.575164598 podStartE2EDuration="25.649714184s" totalImagesPullingTime="24.074549586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:53:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:54:05.647998799 +0000 UTC m=+500.857588018" watchObservedRunningTime="2026-07-09 18:54:05.649714184 +0000 UTC m=+500.859303403"
Jul 09 18:54:07.636673 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:54:07.636639    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h5psj" event={"ID":"67632df0-1ade-4fde-9302-2351b7af767e","Type":"ContainerStarted","Data":"5db8f1141107a16d07bc23564525dd1ebcd41fb8022b8875cf8516e35560636e"}
Jul 09 18:54:07.637133 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:54:07.636737    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h5psj"
Jul 09 18:54:07.694207 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:54:07.694156    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h5psj" podStartSLOduration=14.791076341 podStartE2EDuration="16.69414039s" totalImagesPullingTime="1.903064049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:53:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:54:07.674720381 +0000 UTC m=+502.884309599" watchObservedRunningTime="2026-07-09 18:54:07.69414039 +0000 UTC m=+502.903729608"
Jul 09 18:54:18.644562 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:54:18.644532    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h5psj"
Jul 09 18:54:35.140772 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:54:35.140739    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-g2rzs"]
Jul 09 18:54:35.154909 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:54:35.154887    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-g2rzs"
Jul 09 18:54:35.157892 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:54:35.157870    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-g5xxh\""
Jul 09 18:54:35.158273 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:54:35.158252    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g2rzs"]
Jul 09 18:54:35.232871 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:54:35.232822    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dmfh\" (UniqueName: \"kubernetes.io/projected/859a5bd9-48f6-4bf6-b183-2b1dcae06713-kube-api-access-8dmfh\") pod \"authorino-75d556bd77-g2rzs\" (UID: \"859a5bd9-48f6-4bf6-b183-2b1dcae06713\") " pod="kuadrant-system/authorino-75d556bd77-g2rzs"
Jul 09 18:54:35.333365 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:54:35.333331    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dmfh\" (UniqueName: \"kubernetes.io/projected/859a5bd9-48f6-4bf6-b183-2b1dcae06713-kube-api-access-8dmfh\") pod \"authorino-75d556bd77-g2rzs\" (UID: \"859a5bd9-48f6-4bf6-b183-2b1dcae06713\") " pod="kuadrant-system/authorino-75d556bd77-g2rzs"
Jul 09 18:54:35.344682 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:54:35.344659    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dmfh\" (UniqueName: \"kubernetes.io/projected/859a5bd9-48f6-4bf6-b183-2b1dcae06713-kube-api-access-8dmfh\") pod \"authorino-75d556bd77-g2rzs\" (UID: \"859a5bd9-48f6-4bf6-b183-2b1dcae06713\") " pod="kuadrant-system/authorino-75d556bd77-g2rzs"
Jul 09 18:54:35.464928 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:54:35.464905    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-g2rzs"
Jul 09 18:54:35.599251 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:54:35.599223    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g2rzs"]
Jul 09 18:54:35.600984 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:54:35.600960    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod859a5bd9_48f6_4bf6_b183_2b1dcae06713.slice/crio-01f2a2a5008b8bb08a818a942c5ba444db764ec23497161164cf334af7141ae3 WatchSource:0}: Error finding container 01f2a2a5008b8bb08a818a942c5ba444db764ec23497161164cf334af7141ae3: Status 404 returned error can't find the container with id 01f2a2a5008b8bb08a818a942c5ba444db764ec23497161164cf334af7141ae3
Jul 09 18:54:35.775529 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:54:35.775443    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-g2rzs" event={"ID":"859a5bd9-48f6-4bf6-b183-2b1dcae06713","Type":"ContainerStarted","Data":"01f2a2a5008b8bb08a818a942c5ba444db764ec23497161164cf334af7141ae3"}
Jul 09 18:54:39.796398 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:54:39.796359    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-g2rzs" event={"ID":"859a5bd9-48f6-4bf6-b183-2b1dcae06713","Type":"ContainerStarted","Data":"0ba9983c96d6e8113fce651a318b48ce642ee938bbdfa617eb78d1b052e8d5fa"}
Jul 09 18:54:39.815744 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:54:39.815695    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-g2rzs" podStartSLOduration=1.666286511 podStartE2EDuration="4.815680116s" totalImagesPullingTime="3.149393605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:54:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:54:39.814251428 +0000 UTC m=+535.023840665" watchObservedRunningTime="2026-07-09 18:54:39.815680116 +0000 UTC m=+535.025269334"
Jul 09 18:55:07.145048 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:07.145007    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g2rzs"]
Jul 09 18:55:07.145660 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:07.145196    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-g2rzs" podUID="859a5bd9-48f6-4bf6-b183-2b1dcae06713" containerName="authorino" containerID="cri-o://0ba9983c96d6e8113fce651a318b48ce642ee938bbdfa617eb78d1b052e8d5fa" gracePeriod=30
Jul 09 18:55:07.388439 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:07.388415    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-g2rzs"
Jul 09 18:55:07.520935 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:07.520904    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dmfh\" (UniqueName: \"kubernetes.io/projected/859a5bd9-48f6-4bf6-b183-2b1dcae06713-kube-api-access-8dmfh\") pod \"859a5bd9-48f6-4bf6-b183-2b1dcae06713\" (UID: \"859a5bd9-48f6-4bf6-b183-2b1dcae06713\") "
Jul 09 18:55:07.523015 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:07.522986    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/859a5bd9-48f6-4bf6-b183-2b1dcae06713-kube-api-access-8dmfh" (OuterVolumeSpecName: "kube-api-access-8dmfh") pod "859a5bd9-48f6-4bf6-b183-2b1dcae06713" (UID: "859a5bd9-48f6-4bf6-b183-2b1dcae06713"). InnerVolumeSpecName "kube-api-access-8dmfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:55:07.621500 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:07.621462    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dmfh\" (UniqueName: \"kubernetes.io/projected/859a5bd9-48f6-4bf6-b183-2b1dcae06713-kube-api-access-8dmfh\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 18:55:07.928079 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:07.927989    2580 generic.go:356] "Generic (PLEG): container finished" podID="859a5bd9-48f6-4bf6-b183-2b1dcae06713" containerID="0ba9983c96d6e8113fce651a318b48ce642ee938bbdfa617eb78d1b052e8d5fa" exitCode=0
Jul 09 18:55:07.928079 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:07.928036    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-g2rzs"
Jul 09 18:55:07.928320 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:07.928075    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-g2rzs" event={"ID":"859a5bd9-48f6-4bf6-b183-2b1dcae06713","Type":"ContainerDied","Data":"0ba9983c96d6e8113fce651a318b48ce642ee938bbdfa617eb78d1b052e8d5fa"}
Jul 09 18:55:07.928320 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:07.928127    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-g2rzs" event={"ID":"859a5bd9-48f6-4bf6-b183-2b1dcae06713","Type":"ContainerDied","Data":"01f2a2a5008b8bb08a818a942c5ba444db764ec23497161164cf334af7141ae3"}
Jul 09 18:55:07.928320 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:07.928153    2580 scope.go:117] "RemoveContainer" containerID="0ba9983c96d6e8113fce651a318b48ce642ee938bbdfa617eb78d1b052e8d5fa"
Jul 09 18:55:07.938185 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:07.938021    2580 scope.go:117] "RemoveContainer" containerID="0ba9983c96d6e8113fce651a318b48ce642ee938bbdfa617eb78d1b052e8d5fa"
Jul 09 18:55:07.938381 ip-10-0-137-236 kubenswrapper[2580]: E0709 18:55:07.938354    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ba9983c96d6e8113fce651a318b48ce642ee938bbdfa617eb78d1b052e8d5fa\": container with ID starting with 0ba9983c96d6e8113fce651a318b48ce642ee938bbdfa617eb78d1b052e8d5fa not found: ID does not exist" containerID="0ba9983c96d6e8113fce651a318b48ce642ee938bbdfa617eb78d1b052e8d5fa"
Jul 09 18:55:07.938475 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:07.938392    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ba9983c96d6e8113fce651a318b48ce642ee938bbdfa617eb78d1b052e8d5fa"} err="failed to get container status \"0ba9983c96d6e8113fce651a318b48ce642ee938bbdfa617eb78d1b052e8d5fa\": rpc error: code = NotFound desc = could not find container \"0ba9983c96d6e8113fce651a318b48ce642ee938bbdfa617eb78d1b052e8d5fa\": container with ID starting with 0ba9983c96d6e8113fce651a318b48ce642ee938bbdfa617eb78d1b052e8d5fa not found: ID does not exist"
Jul 09 18:55:07.954410 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:07.954390    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g2rzs"]
Jul 09 18:55:07.960643 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:07.960621    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g2rzs"]
Jul 09 18:55:09.252869 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:09.252819    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="859a5bd9-48f6-4bf6-b183-2b1dcae06713" path="/var/lib/kubelet/pods/859a5bd9-48f6-4bf6-b183-2b1dcae06713/volumes"
Jul 09 18:55:45.166992 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:45.166965    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hps7x_30222ae0-b5d2-440e-a799-e808706d4b84/ovn-acl-logging/0.log"
Jul 09 18:55:45.167522 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:45.167107    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hps7x_30222ae0-b5d2-440e-a799-e808706d4b84/ovn-acl-logging/0.log"
Jul 09 18:55:47.589020 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:47.588985    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-65485f9c6f-gnsdz"]
Jul 09 18:55:47.589400 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:47.589388    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="859a5bd9-48f6-4bf6-b183-2b1dcae06713" containerName="authorino"
Jul 09 18:55:47.589400 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:47.589401    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="859a5bd9-48f6-4bf6-b183-2b1dcae06713" containerName="authorino"
Jul 09 18:55:47.589475 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:47.589464    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="859a5bd9-48f6-4bf6-b183-2b1dcae06713" containerName="authorino"
Jul 09 18:55:47.593655 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:47.593637    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65485f9c6f-gnsdz"
Jul 09 18:55:47.596599 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:47.596573    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 18:55:47.596741 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:47.596616    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 18:55:47.597126 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:47.597110    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 09 18:55:47.606809 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:47.606780    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-65485f9c6f-gnsdz"]
Jul 09 18:55:47.688670 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:47.688635    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl64v\" (UniqueName: \"kubernetes.io/projected/fd625fef-02d3-473c-bc52-476a24cb898a-kube-api-access-jl64v\") pod \"maas-api-65485f9c6f-gnsdz\" (UID: \"fd625fef-02d3-473c-bc52-476a24cb898a\") " pod="odh-ai-gateway-infra/maas-api-65485f9c6f-gnsdz"
Jul 09 18:55:47.688892 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:47.688745    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd625fef-02d3-473c-bc52-476a24cb898a-openshift-service-ca\") pod \"maas-api-65485f9c6f-gnsdz\" (UID: \"fd625fef-02d3-473c-bc52-476a24cb898a\") " pod="odh-ai-gateway-infra/maas-api-65485f9c6f-gnsdz"
Jul 09 18:55:47.688892 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:47.688781    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd625fef-02d3-473c-bc52-476a24cb898a-maas-api-tls\") pod \"maas-api-65485f9c6f-gnsdz\" (UID: \"fd625fef-02d3-473c-bc52-476a24cb898a\") " pod="odh-ai-gateway-infra/maas-api-65485f9c6f-gnsdz"
Jul 09 18:55:47.789456 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:47.789408    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd625fef-02d3-473c-bc52-476a24cb898a-openshift-service-ca\") pod \"maas-api-65485f9c6f-gnsdz\" (UID: \"fd625fef-02d3-473c-bc52-476a24cb898a\") " pod="odh-ai-gateway-infra/maas-api-65485f9c6f-gnsdz"
Jul 09 18:55:47.789658 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:47.789473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd625fef-02d3-473c-bc52-476a24cb898a-maas-api-tls\") pod \"maas-api-65485f9c6f-gnsdz\" (UID: \"fd625fef-02d3-473c-bc52-476a24cb898a\") " pod="odh-ai-gateway-infra/maas-api-65485f9c6f-gnsdz"
Jul 09 18:55:47.789658 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:47.789517    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl64v\" (UniqueName: \"kubernetes.io/projected/fd625fef-02d3-473c-bc52-476a24cb898a-kube-api-access-jl64v\") pod \"maas-api-65485f9c6f-gnsdz\" (UID: \"fd625fef-02d3-473c-bc52-476a24cb898a\") " pod="odh-ai-gateway-infra/maas-api-65485f9c6f-gnsdz"
Jul 09 18:55:47.790093 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:47.790072    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd625fef-02d3-473c-bc52-476a24cb898a-openshift-service-ca\") pod \"maas-api-65485f9c6f-gnsdz\" (UID: \"fd625fef-02d3-473c-bc52-476a24cb898a\") " pod="odh-ai-gateway-infra/maas-api-65485f9c6f-gnsdz"
Jul 09 18:55:47.791913 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:47.791895    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd625fef-02d3-473c-bc52-476a24cb898a-maas-api-tls\") pod \"maas-api-65485f9c6f-gnsdz\" (UID: \"fd625fef-02d3-473c-bc52-476a24cb898a\") " pod="odh-ai-gateway-infra/maas-api-65485f9c6f-gnsdz"
Jul 09 18:55:47.802652 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:47.802632    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl64v\" (UniqueName: \"kubernetes.io/projected/fd625fef-02d3-473c-bc52-476a24cb898a-kube-api-access-jl64v\") pod \"maas-api-65485f9c6f-gnsdz\" (UID: \"fd625fef-02d3-473c-bc52-476a24cb898a\") " pod="odh-ai-gateway-infra/maas-api-65485f9c6f-gnsdz"
Jul 09 18:55:47.905134 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:47.905042    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65485f9c6f-gnsdz"
Jul 09 18:55:48.052340 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:48.052317    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-65485f9c6f-gnsdz"]
Jul 09 18:55:48.055076 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:55:48.055046    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd625fef_02d3_473c_bc52_476a24cb898a.slice/crio-d5b5bc0f1ac8427dd220710cf77ab56c3577f4912af265742d8113708e1225fe WatchSource:0}: Error finding container d5b5bc0f1ac8427dd220710cf77ab56c3577f4912af265742d8113708e1225fe: Status 404 returned error can't find the container with id d5b5bc0f1ac8427dd220710cf77ab56c3577f4912af265742d8113708e1225fe
Jul 09 18:55:48.123961 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:48.123927    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65485f9c6f-gnsdz" event={"ID":"fd625fef-02d3-473c-bc52-476a24cb898a","Type":"ContainerStarted","Data":"d5b5bc0f1ac8427dd220710cf77ab56c3577f4912af265742d8113708e1225fe"}
Jul 09 18:55:51.142046 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:51.142009    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65485f9c6f-gnsdz" event={"ID":"fd625fef-02d3-473c-bc52-476a24cb898a","Type":"ContainerStarted","Data":"64bf9c62414f75c0bf32819b7b7708f35907ebec307303157b68c8c43b008472"}
Jul 09 18:55:51.142435 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:51.142126    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-65485f9c6f-gnsdz"
Jul 09 18:55:51.165888 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:51.165824    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-65485f9c6f-gnsdz" podStartSLOduration=2.108614071 podStartE2EDuration="4.16580868s" totalImagesPullingTime="2.057194609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:55:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:55:51.163460877 +0000 UTC m=+606.373050097" watchObservedRunningTime="2026-07-09 18:55:51.16580868 +0000 UTC m=+606.375397897"
Jul 09 18:55:57.152308 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:55:57.152272    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-65485f9c6f-gnsdz"
Jul 09 18:56:47.799708 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:47.799672    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"]
Jul 09 18:56:47.803255 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:47.803235    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"
Jul 09 18:56:47.807036 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:47.807015    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 18:56:47.808184 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:47.808160    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 18:56:47.808295 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:47.808190    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-z4n5g\""
Jul 09 18:56:47.808295 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:47.808191    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 09 18:56:47.814962 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:47.814943    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"]
Jul 09 18:56:47.922493 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:47.922462    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47d0fc68-96dc-4c7f-9ecb-86dae721117d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rpv4g\" (UID: \"47d0fc68-96dc-4c7f-9ecb-86dae721117d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"
Jul 09 18:56:47.922493 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:47.922490    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsw94\" (UniqueName: \"kubernetes.io/projected/47d0fc68-96dc-4c7f-9ecb-86dae721117d-kube-api-access-nsw94\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rpv4g\" (UID: \"47d0fc68-96dc-4c7f-9ecb-86dae721117d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"
Jul 09 18:56:47.922677 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:47.922568    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47d0fc68-96dc-4c7f-9ecb-86dae721117d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rpv4g\" (UID: \"47d0fc68-96dc-4c7f-9ecb-86dae721117d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"
Jul 09 18:56:47.922677 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:47.922586    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47d0fc68-96dc-4c7f-9ecb-86dae721117d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rpv4g\" (UID: \"47d0fc68-96dc-4c7f-9ecb-86dae721117d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"
Jul 09 18:56:47.922677 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:47.922637    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47d0fc68-96dc-4c7f-9ecb-86dae721117d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rpv4g\" (UID: \"47d0fc68-96dc-4c7f-9ecb-86dae721117d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"
Jul 09 18:56:47.922677 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:47.922660    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47d0fc68-96dc-4c7f-9ecb-86dae721117d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rpv4g\" (UID: \"47d0fc68-96dc-4c7f-9ecb-86dae721117d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"
Jul 09 18:56:48.023108 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:48.023080    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47d0fc68-96dc-4c7f-9ecb-86dae721117d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rpv4g\" (UID: \"47d0fc68-96dc-4c7f-9ecb-86dae721117d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"
Jul 09 18:56:48.023261 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:48.023112    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsw94\" (UniqueName: \"kubernetes.io/projected/47d0fc68-96dc-4c7f-9ecb-86dae721117d-kube-api-access-nsw94\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rpv4g\" (UID: \"47d0fc68-96dc-4c7f-9ecb-86dae721117d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"
Jul 09 18:56:48.023261 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:48.023188    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47d0fc68-96dc-4c7f-9ecb-86dae721117d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rpv4g\" (UID: \"47d0fc68-96dc-4c7f-9ecb-86dae721117d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"
Jul 09 18:56:48.023261 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:48.023218    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47d0fc68-96dc-4c7f-9ecb-86dae721117d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rpv4g\" (UID: \"47d0fc68-96dc-4c7f-9ecb-86dae721117d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"
Jul 09 18:56:48.023454 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:48.023265    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47d0fc68-96dc-4c7f-9ecb-86dae721117d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rpv4g\" (UID: \"47d0fc68-96dc-4c7f-9ecb-86dae721117d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"
Jul 09 18:56:48.023454 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:48.023305    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47d0fc68-96dc-4c7f-9ecb-86dae721117d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rpv4g\" (UID: \"47d0fc68-96dc-4c7f-9ecb-86dae721117d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"
Jul 09 18:56:48.023561 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:48.023507    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47d0fc68-96dc-4c7f-9ecb-86dae721117d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rpv4g\" (UID: \"47d0fc68-96dc-4c7f-9ecb-86dae721117d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"
Jul 09 18:56:48.023662 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:48.023645    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47d0fc68-96dc-4c7f-9ecb-86dae721117d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rpv4g\" (UID: \"47d0fc68-96dc-4c7f-9ecb-86dae721117d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"
Jul 09 18:56:48.023715 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:48.023646    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47d0fc68-96dc-4c7f-9ecb-86dae721117d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rpv4g\" (UID: \"47d0fc68-96dc-4c7f-9ecb-86dae721117d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"
Jul 09 18:56:48.025484 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:48.025452    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47d0fc68-96dc-4c7f-9ecb-86dae721117d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rpv4g\" (UID: \"47d0fc68-96dc-4c7f-9ecb-86dae721117d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"
Jul 09 18:56:48.025713 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:48.025695    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47d0fc68-96dc-4c7f-9ecb-86dae721117d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rpv4g\" (UID: \"47d0fc68-96dc-4c7f-9ecb-86dae721117d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"
Jul 09 18:56:48.034908 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:48.034883    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsw94\" (UniqueName: \"kubernetes.io/projected/47d0fc68-96dc-4c7f-9ecb-86dae721117d-kube-api-access-nsw94\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rpv4g\" (UID: \"47d0fc68-96dc-4c7f-9ecb-86dae721117d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"
Jul 09 18:56:48.113947 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:48.113867    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"
Jul 09 18:56:48.248413 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:48.248385    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"]
Jul 09 18:56:48.250062 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:56:48.250037    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47d0fc68_96dc_4c7f_9ecb_86dae721117d.slice/crio-ead7fa62d2da8ab23221d0c1544d21236d7684e70b7f286616a16b6c744fb4d8 WatchSource:0}: Error finding container ead7fa62d2da8ab23221d0c1544d21236d7684e70b7f286616a16b6c744fb4d8: Status 404 returned error can't find the container with id ead7fa62d2da8ab23221d0c1544d21236d7684e70b7f286616a16b6c744fb4d8
Jul 09 18:56:48.251398 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:48.251383    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 18:56:48.414301 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:48.414219    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g" event={"ID":"47d0fc68-96dc-4c7f-9ecb-86dae721117d","Type":"ContainerStarted","Data":"ead7fa62d2da8ab23221d0c1544d21236d7684e70b7f286616a16b6c744fb4d8"}
Jul 09 18:56:49.421718 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:49.421685    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g" event={"ID":"47d0fc68-96dc-4c7f-9ecb-86dae721117d","Type":"ContainerStarted","Data":"f9602473bfa4ffdc940e647b456e459089257f14aa2473967a2b6b39f3944284"}
Jul 09 18:56:49.444371 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:49.444318    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g" podStartSLOduration=1.376350901 podStartE2EDuration="2.44430189s" totalImagesPullingTime="1.067950989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:56:49.442052154 +0000 UTC m=+664.651641373" watchObservedRunningTime="2026-07-09 18:56:49.44430189 +0000 UTC m=+664.653891105"
Jul 09 18:56:56.390347 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:56.390308    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"]
Jul 09 18:56:56.394489 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:56.394470    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"
Jul 09 18:56:56.397343 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:56.397324    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 09 18:56:56.401701 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:56.401673    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds\" (UID: \"4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"
Jul 09 18:56:56.401813 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:56.401767    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds\" (UID: \"4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"
Jul 09 18:56:56.401813 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:56.401794    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds\" (UID: \"4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"
Jul 09 18:56:56.401969 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:56.401841    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds\" (UID: \"4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"
Jul 09 18:56:56.401969 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:56.401867    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds\" (UID: \"4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"
Jul 09 18:56:56.402065 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:56.401962    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dvnl\" (UniqueName: \"kubernetes.io/projected/4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb-kube-api-access-9dvnl\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds\" (UID: \"4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"
Jul 09 18:56:56.404642 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:56.404621    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"]
Jul 09 18:56:56.502954 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:56.502914    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dvnl\" (UniqueName: \"kubernetes.io/projected/4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb-kube-api-access-9dvnl\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds\" (UID: \"4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"
Jul 09 18:56:56.503134 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:56.503014    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds\" (UID: \"4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"
Jul 09 18:56:56.503134 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:56.503063    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds\" (UID: \"4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"
Jul 09 18:56:56.503238 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:56.503191    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds\" (UID: \"4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"
Jul 09 18:56:56.503238 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:56.503228    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds\" (UID: \"4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"
Jul 09 18:56:56.503340 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:56.503253    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds\" (UID: \"4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"
Jul 09 18:56:56.503451 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:56.503430    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds\" (UID: \"4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"
Jul 09 18:56:56.503599 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:56.503577    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds\" (UID: \"4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"
Jul 09 18:56:56.503661 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:56.503598    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds\" (UID: \"4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"
Jul 09 18:56:56.505285 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:56.505261    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds\" (UID: \"4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"
Jul 09 18:56:56.505546 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:56.505528    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds\" (UID: \"4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"
Jul 09 18:56:56.512579 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:56.512557    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dvnl\" (UniqueName: \"kubernetes.io/projected/4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb-kube-api-access-9dvnl\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds\" (UID: \"4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"
Jul 09 18:56:56.704874 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:56.704767    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"
Jul 09 18:56:56.839439 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:56.839417    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"]
Jul 09 18:56:56.842216 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:56:56.842192    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f2246ce_a132_4e96_b6c7_1fd3b8ddbfeb.slice/crio-d7124244513feb9d0031fef1f73639af5cf577e5b44f0bf46317be81dd719ec6 WatchSource:0}: Error finding container d7124244513feb9d0031fef1f73639af5cf577e5b44f0bf46317be81dd719ec6: Status 404 returned error can't find the container with id d7124244513feb9d0031fef1f73639af5cf577e5b44f0bf46317be81dd719ec6
Jul 09 18:56:57.462805 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:57.462769    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds" event={"ID":"4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb","Type":"ContainerStarted","Data":"e9b6dc50e3ce6e07fb156ee7b75e193c18f55d594b9f55f3af8cc8684903d3a5"}
Jul 09 18:56:57.463266 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:57.462815    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds" event={"ID":"4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb","Type":"ContainerStarted","Data":"d7124244513feb9d0031fef1f73639af5cf577e5b44f0bf46317be81dd719ec6"}
Jul 09 18:56:57.483558 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:57.483511    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds" podStartSLOduration=1.295679587 podStartE2EDuration="1.483495421s" totalImagesPullingTime="187.815834ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:56:57.482909953 +0000 UTC m=+672.692499183" watchObservedRunningTime="2026-07-09 18:56:57.483495421 +0000 UTC m=+672.693084639"
Jul 09 18:56:58.114219 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:58.114193    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"
Jul 09 18:56:58.114407 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:58.114242    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"
Jul 09 18:56:58.126845 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:58.126815    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"
Jul 09 18:56:58.478872 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:56:58.478847    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rpv4g"
Jul 09 18:57:06.705285 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:57:06.705243    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"
Jul 09 18:57:06.705717 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:57:06.705302    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"
Jul 09 18:57:06.717920 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:57:06.717899    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"
Jul 09 18:57:07.518745 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:57:07.518714    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds"
Jul 09 18:58:02.203285 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:58:02.203201    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7447f46df5-zksck"]
Jul 09 18:58:02.207192 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:58:02.207170    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7447f46df5-zksck"
Jul 09 18:58:02.210003 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:58:02.209983    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-g5xxh\""
Jul 09 18:58:02.211160 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:58:02.211142    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 09 18:58:02.221659 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:58:02.221626    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7447f46df5-zksck"]
Jul 09 18:58:02.325884 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:58:02.325824    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwmg2\" (UniqueName: \"kubernetes.io/projected/587b4978-b1ca-4e8f-a75b-810c5048d0ca-kube-api-access-wwmg2\") pod \"authorino-7447f46df5-zksck\" (UID: \"587b4978-b1ca-4e8f-a75b-810c5048d0ca\") " pod="kuadrant-system/authorino-7447f46df5-zksck"
Jul 09 18:58:02.326046 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:58:02.325967    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/587b4978-b1ca-4e8f-a75b-810c5048d0ca-tls-cert\") pod \"authorino-7447f46df5-zksck\" (UID: \"587b4978-b1ca-4e8f-a75b-810c5048d0ca\") " pod="kuadrant-system/authorino-7447f46df5-zksck"
Jul 09 18:58:02.426595 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:58:02.426562    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/587b4978-b1ca-4e8f-a75b-810c5048d0ca-tls-cert\") pod \"authorino-7447f46df5-zksck\" (UID: \"587b4978-b1ca-4e8f-a75b-810c5048d0ca\") " pod="kuadrant-system/authorino-7447f46df5-zksck"
Jul 09 18:58:02.426749 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:58:02.426628    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwmg2\" (UniqueName: \"kubernetes.io/projected/587b4978-b1ca-4e8f-a75b-810c5048d0ca-kube-api-access-wwmg2\") pod \"authorino-7447f46df5-zksck\" (UID: \"587b4978-b1ca-4e8f-a75b-810c5048d0ca\") " pod="kuadrant-system/authorino-7447f46df5-zksck"
Jul 09 18:58:02.429065 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:58:02.429041    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/587b4978-b1ca-4e8f-a75b-810c5048d0ca-tls-cert\") pod \"authorino-7447f46df5-zksck\" (UID: \"587b4978-b1ca-4e8f-a75b-810c5048d0ca\") " pod="kuadrant-system/authorino-7447f46df5-zksck"
Jul 09 18:58:02.440245 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:58:02.440208    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwmg2\" (UniqueName: \"kubernetes.io/projected/587b4978-b1ca-4e8f-a75b-810c5048d0ca-kube-api-access-wwmg2\") pod \"authorino-7447f46df5-zksck\" (UID: \"587b4978-b1ca-4e8f-a75b-810c5048d0ca\") " pod="kuadrant-system/authorino-7447f46df5-zksck"
Jul 09 18:58:02.516815 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:58:02.516780    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7447f46df5-zksck"
Jul 09 18:58:02.660176 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:58:02.660068    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7447f46df5-zksck"]
Jul 09 18:58:02.664041 ip-10-0-137-236 kubenswrapper[2580]: W0709 18:58:02.664014    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod587b4978_b1ca_4e8f_a75b_810c5048d0ca.slice/crio-b87b126e5323236cc7ff4e92a9f61fe1a63af385e7b558538b920afaa681c9da WatchSource:0}: Error finding container b87b126e5323236cc7ff4e92a9f61fe1a63af385e7b558538b920afaa681c9da: Status 404 returned error can't find the container with id b87b126e5323236cc7ff4e92a9f61fe1a63af385e7b558538b920afaa681c9da
Jul 09 18:58:02.771626 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:58:02.771549    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7447f46df5-zksck" event={"ID":"587b4978-b1ca-4e8f-a75b-810c5048d0ca","Type":"ContainerStarted","Data":"b87b126e5323236cc7ff4e92a9f61fe1a63af385e7b558538b920afaa681c9da"}
Jul 09 18:58:03.779263 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:58:03.779226    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7447f46df5-zksck" event={"ID":"587b4978-b1ca-4e8f-a75b-810c5048d0ca","Type":"ContainerStarted","Data":"c74b8652cd7e6a3125485b75619377c24db1123fa3f5199895e1a57c10ecf509"}
Jul 09 18:58:03.799667 ip-10-0-137-236 kubenswrapper[2580]: I0709 18:58:03.799620    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7447f46df5-zksck" podStartSLOduration=1.473882895 podStartE2EDuration="1.799604127s" totalImagesPullingTime="325.721232ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:58:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:58:03.796963552 +0000 UTC m=+739.006552772" watchObservedRunningTime="2026-07-09 18:58:03.799604127 +0000 UTC m=+739.009193345"
Jul 09 19:00:45.199905 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:00:45.199812    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hps7x_30222ae0-b5d2-440e-a799-e808706d4b84/ovn-acl-logging/0.log"
Jul 09 19:00:45.200465 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:00:45.200400    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hps7x_30222ae0-b5d2-440e-a799-e808706d4b84/ovn-acl-logging/0.log"
Jul 09 19:05:45.234640 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:05:45.234613    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hps7x_30222ae0-b5d2-440e-a799-e808706d4b84/ovn-acl-logging/0.log"
Jul 09 19:05:45.235138 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:05:45.235095    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hps7x_30222ae0-b5d2-440e-a799-e808706d4b84/ovn-acl-logging/0.log"
Jul 09 19:10:45.266293 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:10:45.266265    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hps7x_30222ae0-b5d2-440e-a799-e808706d4b84/ovn-acl-logging/0.log"
Jul 09 19:10:45.268625 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:10:45.268602    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hps7x_30222ae0-b5d2-440e-a799-e808706d4b84/ovn-acl-logging/0.log"
Jul 09 19:11:24.628839 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:24.628798    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn"]
Jul 09 19:11:24.632466 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:24.632445    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn"
Jul 09 19:11:24.635256 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:24.635235    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-751b3f0c-serving-cert\""
Jul 09 19:11:24.635405 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:24.635391    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rxfcr\""
Jul 09 19:11:24.642939 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:24.642917    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn"]
Jul 09 19:11:24.737218 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:24.737182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zwjp\" (UniqueName: \"kubernetes.io/projected/3fcd259f-4d1a-4f21-bcf0-15968bdc2550-kube-api-access-9zwjp\") pod \"maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn\" (UID: \"3fcd259f-4d1a-4f21-bcf0-15968bdc2550\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn"
Jul 09 19:11:24.737408 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:24.737241    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fcd259f-4d1a-4f21-bcf0-15968bdc2550-openshift-service-ca\") pod \"maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn\" (UID: \"3fcd259f-4d1a-4f21-bcf0-15968bdc2550\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn"
Jul 09 19:11:24.737408 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:24.737386    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fcd259f-4d1a-4f21-bcf0-15968bdc2550-maas-api-tls\") pod \"maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn\" (UID: \"3fcd259f-4d1a-4f21-bcf0-15968bdc2550\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn"
Jul 09 19:11:24.838715 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:24.838673    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fcd259f-4d1a-4f21-bcf0-15968bdc2550-maas-api-tls\") pod \"maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn\" (UID: \"3fcd259f-4d1a-4f21-bcf0-15968bdc2550\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn"
Jul 09 19:11:24.838715 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:24.838718    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zwjp\" (UniqueName: \"kubernetes.io/projected/3fcd259f-4d1a-4f21-bcf0-15968bdc2550-kube-api-access-9zwjp\") pod \"maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn\" (UID: \"3fcd259f-4d1a-4f21-bcf0-15968bdc2550\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn"
Jul 09 19:11:24.838958 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:24.838757    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fcd259f-4d1a-4f21-bcf0-15968bdc2550-openshift-service-ca\") pod \"maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn\" (UID: \"3fcd259f-4d1a-4f21-bcf0-15968bdc2550\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn"
Jul 09 19:11:24.839429 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:24.839405    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fcd259f-4d1a-4f21-bcf0-15968bdc2550-openshift-service-ca\") pod \"maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn\" (UID: \"3fcd259f-4d1a-4f21-bcf0-15968bdc2550\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn"
Jul 09 19:11:24.841291 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:24.841269    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fcd259f-4d1a-4f21-bcf0-15968bdc2550-maas-api-tls\") pod \"maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn\" (UID: \"3fcd259f-4d1a-4f21-bcf0-15968bdc2550\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn"
Jul 09 19:11:24.848196 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:24.848160    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zwjp\" (UniqueName: \"kubernetes.io/projected/3fcd259f-4d1a-4f21-bcf0-15968bdc2550-kube-api-access-9zwjp\") pod \"maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn\" (UID: \"3fcd259f-4d1a-4f21-bcf0-15968bdc2550\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn"
Jul 09 19:11:24.944224 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:24.944133    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn"
Jul 09 19:11:25.085305 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:25.085282    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn"]
Jul 09 19:11:25.086556 ip-10-0-137-236 kubenswrapper[2580]: W0709 19:11:25.086527    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fcd259f_4d1a_4f21_bcf0_15968bdc2550.slice/crio-9aa183ed9b8b921c79a9aaaa77283bb03558b8a9d856c37cc78437c51c24f0a5 WatchSource:0}: Error finding container 9aa183ed9b8b921c79a9aaaa77283bb03558b8a9d856c37cc78437c51c24f0a5: Status 404 returned error can't find the container with id 9aa183ed9b8b921c79a9aaaa77283bb03558b8a9d856c37cc78437c51c24f0a5
Jul 09 19:11:25.088244 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:25.088225    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 19:11:25.740201 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:25.740149    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn" event={"ID":"3fcd259f-4d1a-4f21-bcf0-15968bdc2550","Type":"ContainerStarted","Data":"36eb2e1cd9afc71cb5e966a382fce9cb5baf18d7a7373ccad71e5c0e5e49a885"}
Jul 09 19:11:25.740577 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:25.740224    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn" event={"ID":"3fcd259f-4d1a-4f21-bcf0-15968bdc2550","Type":"ContainerStarted","Data":"9aa183ed9b8b921c79a9aaaa77283bb03558b8a9d856c37cc78437c51c24f0a5"}
Jul 09 19:11:25.740577 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:25.740251    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn"
Jul 09 19:11:25.759824 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:25.759777    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn" podStartSLOduration=1.236791459 podStartE2EDuration="1.75976134s" totalImagesPullingTime="522.969881ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:11:25.758425107 +0000 UTC m=+1540.968014317" watchObservedRunningTime="2026-07-09 19:11:25.75976134 +0000 UTC m=+1540.969350591"
Jul 09 19:11:30.104144 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:30.104115    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn"]
Jul 09 19:11:30.104592 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:30.104289    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn" podUID="3fcd259f-4d1a-4f21-bcf0-15968bdc2550" containerName="maas-api" containerID="cri-o://36eb2e1cd9afc71cb5e966a382fce9cb5baf18d7a7373ccad71e5c0e5e49a885" gracePeriod=30
Jul 09 19:11:30.109557 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:30.109535    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn"
Jul 09 19:11:30.345992 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:30.345968    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn"
Jul 09 19:11:30.389886 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:30.389807    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fcd259f-4d1a-4f21-bcf0-15968bdc2550-openshift-service-ca\") pod \"3fcd259f-4d1a-4f21-bcf0-15968bdc2550\" (UID: \"3fcd259f-4d1a-4f21-bcf0-15968bdc2550\") "
Jul 09 19:11:30.389886 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:30.389852    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fcd259f-4d1a-4f21-bcf0-15968bdc2550-maas-api-tls\") pod \"3fcd259f-4d1a-4f21-bcf0-15968bdc2550\" (UID: \"3fcd259f-4d1a-4f21-bcf0-15968bdc2550\") "
Jul 09 19:11:30.390111 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:30.390006    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zwjp\" (UniqueName: \"kubernetes.io/projected/3fcd259f-4d1a-4f21-bcf0-15968bdc2550-kube-api-access-9zwjp\") pod \"3fcd259f-4d1a-4f21-bcf0-15968bdc2550\" (UID: \"3fcd259f-4d1a-4f21-bcf0-15968bdc2550\") "
Jul 09 19:11:30.390175 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:30.390137    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fcd259f-4d1a-4f21-bcf0-15968bdc2550-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3fcd259f-4d1a-4f21-bcf0-15968bdc2550" (UID: "3fcd259f-4d1a-4f21-bcf0-15968bdc2550"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:11:30.390255 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:30.390238    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fcd259f-4d1a-4f21-bcf0-15968bdc2550-openshift-service-ca\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:11:30.392073 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:30.392049    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fcd259f-4d1a-4f21-bcf0-15968bdc2550-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3fcd259f-4d1a-4f21-bcf0-15968bdc2550" (UID: "3fcd259f-4d1a-4f21-bcf0-15968bdc2550"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:11:30.392238 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:30.392218    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fcd259f-4d1a-4f21-bcf0-15968bdc2550-kube-api-access-9zwjp" (OuterVolumeSpecName: "kube-api-access-9zwjp") pod "3fcd259f-4d1a-4f21-bcf0-15968bdc2550" (UID: "3fcd259f-4d1a-4f21-bcf0-15968bdc2550"). InnerVolumeSpecName "kube-api-access-9zwjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:11:30.490839 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:30.490808    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zwjp\" (UniqueName: \"kubernetes.io/projected/3fcd259f-4d1a-4f21-bcf0-15968bdc2550-kube-api-access-9zwjp\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:11:30.490997 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:30.490857    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fcd259f-4d1a-4f21-bcf0-15968bdc2550-maas-api-tls\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:11:30.768763 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:30.768729    2580 generic.go:356] "Generic (PLEG): container finished" podID="3fcd259f-4d1a-4f21-bcf0-15968bdc2550" containerID="36eb2e1cd9afc71cb5e966a382fce9cb5baf18d7a7373ccad71e5c0e5e49a885" exitCode=0
Jul 09 19:11:30.768917 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:30.768776    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn"
Jul 09 19:11:30.768917 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:30.768811    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn" event={"ID":"3fcd259f-4d1a-4f21-bcf0-15968bdc2550","Type":"ContainerDied","Data":"36eb2e1cd9afc71cb5e966a382fce9cb5baf18d7a7373ccad71e5c0e5e49a885"}
Jul 09 19:11:30.768917 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:30.768907    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn" event={"ID":"3fcd259f-4d1a-4f21-bcf0-15968bdc2550","Type":"ContainerDied","Data":"9aa183ed9b8b921c79a9aaaa77283bb03558b8a9d856c37cc78437c51c24f0a5"}
Jul 09 19:11:30.769037 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:30.768931    2580 scope.go:117] "RemoveContainer" containerID="36eb2e1cd9afc71cb5e966a382fce9cb5baf18d7a7373ccad71e5c0e5e49a885"
Jul 09 19:11:30.778267 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:30.778251    2580 scope.go:117] "RemoveContainer" containerID="36eb2e1cd9afc71cb5e966a382fce9cb5baf18d7a7373ccad71e5c0e5e49a885"
Jul 09 19:11:30.778496 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:11:30.778481    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36eb2e1cd9afc71cb5e966a382fce9cb5baf18d7a7373ccad71e5c0e5e49a885\": container with ID starting with 36eb2e1cd9afc71cb5e966a382fce9cb5baf18d7a7373ccad71e5c0e5e49a885 not found: ID does not exist" containerID="36eb2e1cd9afc71cb5e966a382fce9cb5baf18d7a7373ccad71e5c0e5e49a885"
Jul 09 19:11:30.778543 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:30.778504    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36eb2e1cd9afc71cb5e966a382fce9cb5baf18d7a7373ccad71e5c0e5e49a885"} err="failed to get container status \"36eb2e1cd9afc71cb5e966a382fce9cb5baf18d7a7373ccad71e5c0e5e49a885\": rpc error: code = NotFound desc = could not find container \"36eb2e1cd9afc71cb5e966a382fce9cb5baf18d7a7373ccad71e5c0e5e49a885\": container with ID starting with 36eb2e1cd9afc71cb5e966a382fce9cb5baf18d7a7373ccad71e5c0e5e49a885 not found: ID does not exist"
Jul 09 19:11:30.793784 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:30.793761    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn"]
Jul 09 19:11:30.798500 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:30.798482    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-751b3f0c-5659f95df-lwrnn"]
Jul 09 19:11:31.252897 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:31.252867    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fcd259f-4d1a-4f21-bcf0-15968bdc2550" path="/var/lib/kubelet/pods/3fcd259f-4d1a-4f21-bcf0-15968bdc2550/volumes"
Jul 09 19:11:37.709607 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:37.709573    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6"]
Jul 09 19:11:37.710191 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:37.710170    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fcd259f-4d1a-4f21-bcf0-15968bdc2550" containerName="maas-api"
Jul 09 19:11:37.710285 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:37.710192    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fcd259f-4d1a-4f21-bcf0-15968bdc2550" containerName="maas-api"
Jul 09 19:11:37.710343 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:37.710310    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fcd259f-4d1a-4f21-bcf0-15968bdc2550" containerName="maas-api"
Jul 09 19:11:37.714979 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:37.714957    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6"
Jul 09 19:11:37.717599 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:37.717583    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-6a618683-serving-cert\""
Jul 09 19:11:37.717599 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:37.717590    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rxfcr\""
Jul 09 19:11:37.726390 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:37.726364    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6"]
Jul 09 19:11:37.862898 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:37.862857    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3ff490e-10bf-4b26-b7c7-c73d244e6d23-openshift-service-ca\") pod \"maas-api-e2e-ait-6a618683-5865fb9965-4d8t6\" (UID: \"e3ff490e-10bf-4b26-b7c7-c73d244e6d23\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6"
Jul 09 19:11:37.863091 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:37.862901    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8hb9\" (UniqueName: \"kubernetes.io/projected/e3ff490e-10bf-4b26-b7c7-c73d244e6d23-kube-api-access-n8hb9\") pod \"maas-api-e2e-ait-6a618683-5865fb9965-4d8t6\" (UID: \"e3ff490e-10bf-4b26-b7c7-c73d244e6d23\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6"
Jul 09 19:11:37.863139 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:37.863086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3ff490e-10bf-4b26-b7c7-c73d244e6d23-maas-api-tls\") pod \"maas-api-e2e-ait-6a618683-5865fb9965-4d8t6\" (UID: \"e3ff490e-10bf-4b26-b7c7-c73d244e6d23\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6"
Jul 09 19:11:37.964067 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:37.963991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3ff490e-10bf-4b26-b7c7-c73d244e6d23-openshift-service-ca\") pod \"maas-api-e2e-ait-6a618683-5865fb9965-4d8t6\" (UID: \"e3ff490e-10bf-4b26-b7c7-c73d244e6d23\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6"
Jul 09 19:11:37.964067 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:37.964027    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8hb9\" (UniqueName: \"kubernetes.io/projected/e3ff490e-10bf-4b26-b7c7-c73d244e6d23-kube-api-access-n8hb9\") pod \"maas-api-e2e-ait-6a618683-5865fb9965-4d8t6\" (UID: \"e3ff490e-10bf-4b26-b7c7-c73d244e6d23\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6"
Jul 09 19:11:37.964266 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:37.964115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3ff490e-10bf-4b26-b7c7-c73d244e6d23-maas-api-tls\") pod \"maas-api-e2e-ait-6a618683-5865fb9965-4d8t6\" (UID: \"e3ff490e-10bf-4b26-b7c7-c73d244e6d23\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6"
Jul 09 19:11:37.964302 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:11:37.964262    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-serving-cert: secret "maas-api-e2e-ait-6a618683-serving-cert" not found
Jul 09 19:11:37.964343 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:11:37.964333    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3ff490e-10bf-4b26-b7c7-c73d244e6d23-maas-api-tls podName:e3ff490e-10bf-4b26-b7c7-c73d244e6d23 nodeName:}" failed. No retries permitted until 2026-07-09 19:11:38.464310968 +0000 UTC m=+1553.673900183 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e3ff490e-10bf-4b26-b7c7-c73d244e6d23-maas-api-tls") pod "maas-api-e2e-ait-6a618683-5865fb9965-4d8t6" (UID: "e3ff490e-10bf-4b26-b7c7-c73d244e6d23") : secret "maas-api-e2e-ait-6a618683-serving-cert" not found
Jul 09 19:11:37.964781 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:37.964763    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3ff490e-10bf-4b26-b7c7-c73d244e6d23-openshift-service-ca\") pod \"maas-api-e2e-ait-6a618683-5865fb9965-4d8t6\" (UID: \"e3ff490e-10bf-4b26-b7c7-c73d244e6d23\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6"
Jul 09 19:11:37.973498 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:37.973468    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8hb9\" (UniqueName: \"kubernetes.io/projected/e3ff490e-10bf-4b26-b7c7-c73d244e6d23-kube-api-access-n8hb9\") pod \"maas-api-e2e-ait-6a618683-5865fb9965-4d8t6\" (UID: \"e3ff490e-10bf-4b26-b7c7-c73d244e6d23\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6"
Jul 09 19:11:38.468656 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:38.468616    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3ff490e-10bf-4b26-b7c7-c73d244e6d23-maas-api-tls\") pod \"maas-api-e2e-ait-6a618683-5865fb9965-4d8t6\" (UID: \"e3ff490e-10bf-4b26-b7c7-c73d244e6d23\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6"
Jul 09 19:11:38.471233 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:38.471192    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3ff490e-10bf-4b26-b7c7-c73d244e6d23-maas-api-tls\") pod \"maas-api-e2e-ait-6a618683-5865fb9965-4d8t6\" (UID: \"e3ff490e-10bf-4b26-b7c7-c73d244e6d23\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6"
Jul 09 19:11:38.627225 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:38.627196    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6"
Jul 09 19:11:38.762003 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:38.761979    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6"]
Jul 09 19:11:38.764149 ip-10-0-137-236 kubenswrapper[2580]: W0709 19:11:38.764121    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3ff490e_10bf_4b26_b7c7_c73d244e6d23.slice/crio-f0bfd7e3108f69914c7c2b0919fa9eab1e7e999dbbfc49d6bf92953497cc1ccc WatchSource:0}: Error finding container f0bfd7e3108f69914c7c2b0919fa9eab1e7e999dbbfc49d6bf92953497cc1ccc: Status 404 returned error can't find the container with id f0bfd7e3108f69914c7c2b0919fa9eab1e7e999dbbfc49d6bf92953497cc1ccc
Jul 09 19:11:38.811733 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:38.811701    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6" event={"ID":"e3ff490e-10bf-4b26-b7c7-c73d244e6d23","Type":"ContainerStarted","Data":"f0bfd7e3108f69914c7c2b0919fa9eab1e7e999dbbfc49d6bf92953497cc1ccc"}
Jul 09 19:11:39.818912 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:39.818869    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6" event={"ID":"e3ff490e-10bf-4b26-b7c7-c73d244e6d23","Type":"ContainerStarted","Data":"2c42d1ec84b2dcdaba75615b97cd7749ed3f62c93406a8b6735503eebfbd66ce"}
Jul 09 19:11:39.819307 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:39.818966    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6"
Jul 09 19:11:39.846741 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:39.846626    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6" podStartSLOduration=2.481800613 podStartE2EDuration="2.846602113s" totalImagesPullingTime="364.8015ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:11:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:11:39.846088315 +0000 UTC m=+1555.055677543" watchObservedRunningTime="2026-07-09 19:11:39.846602113 +0000 UTC m=+1555.056191331"
Jul 09 19:11:43.075861 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:43.075810    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6"]
Jul 09 19:11:43.076298 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:43.076053    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6" podUID="e3ff490e-10bf-4b26-b7c7-c73d244e6d23" containerName="maas-api" containerID="cri-o://2c42d1ec84b2dcdaba75615b97cd7749ed3f62c93406a8b6735503eebfbd66ce" gracePeriod=30
Jul 09 19:11:43.318133 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:43.318108    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6"
Jul 09 19:11:43.416352 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:43.416277    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3ff490e-10bf-4b26-b7c7-c73d244e6d23-maas-api-tls\") pod \"e3ff490e-10bf-4b26-b7c7-c73d244e6d23\" (UID: \"e3ff490e-10bf-4b26-b7c7-c73d244e6d23\") "
Jul 09 19:11:43.416352 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:43.416340    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8hb9\" (UniqueName: \"kubernetes.io/projected/e3ff490e-10bf-4b26-b7c7-c73d244e6d23-kube-api-access-n8hb9\") pod \"e3ff490e-10bf-4b26-b7c7-c73d244e6d23\" (UID: \"e3ff490e-10bf-4b26-b7c7-c73d244e6d23\") "
Jul 09 19:11:43.416533 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:43.416402    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3ff490e-10bf-4b26-b7c7-c73d244e6d23-openshift-service-ca\") pod \"e3ff490e-10bf-4b26-b7c7-c73d244e6d23\" (UID: \"e3ff490e-10bf-4b26-b7c7-c73d244e6d23\") "
Jul 09 19:11:43.416789 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:43.416763    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3ff490e-10bf-4b26-b7c7-c73d244e6d23-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e3ff490e-10bf-4b26-b7c7-c73d244e6d23" (UID: "e3ff490e-10bf-4b26-b7c7-c73d244e6d23"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:11:43.418432 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:43.418400    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3ff490e-10bf-4b26-b7c7-c73d244e6d23-kube-api-access-n8hb9" (OuterVolumeSpecName: "kube-api-access-n8hb9") pod "e3ff490e-10bf-4b26-b7c7-c73d244e6d23" (UID: "e3ff490e-10bf-4b26-b7c7-c73d244e6d23"). InnerVolumeSpecName "kube-api-access-n8hb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:11:43.418520 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:43.418429    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3ff490e-10bf-4b26-b7c7-c73d244e6d23-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e3ff490e-10bf-4b26-b7c7-c73d244e6d23" (UID: "e3ff490e-10bf-4b26-b7c7-c73d244e6d23"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:11:43.517985 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:43.517954    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3ff490e-10bf-4b26-b7c7-c73d244e6d23-maas-api-tls\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:11:43.517985 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:43.517979    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8hb9\" (UniqueName: \"kubernetes.io/projected/e3ff490e-10bf-4b26-b7c7-c73d244e6d23-kube-api-access-n8hb9\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:11:43.517985 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:43.517990    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3ff490e-10bf-4b26-b7c7-c73d244e6d23-openshift-service-ca\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:11:43.840090 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:43.840057    2580 generic.go:356] "Generic (PLEG): container finished" podID="e3ff490e-10bf-4b26-b7c7-c73d244e6d23" containerID="2c42d1ec84b2dcdaba75615b97cd7749ed3f62c93406a8b6735503eebfbd66ce" exitCode=0
Jul 09 19:11:43.840261 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:43.840100    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6"
Jul 09 19:11:43.840261 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:43.840099    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6" event={"ID":"e3ff490e-10bf-4b26-b7c7-c73d244e6d23","Type":"ContainerDied","Data":"2c42d1ec84b2dcdaba75615b97cd7749ed3f62c93406a8b6735503eebfbd66ce"}
Jul 09 19:11:43.840261 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:43.840156    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6" event={"ID":"e3ff490e-10bf-4b26-b7c7-c73d244e6d23","Type":"ContainerDied","Data":"f0bfd7e3108f69914c7c2b0919fa9eab1e7e999dbbfc49d6bf92953497cc1ccc"}
Jul 09 19:11:43.840261 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:43.840179    2580 scope.go:117] "RemoveContainer" containerID="2c42d1ec84b2dcdaba75615b97cd7749ed3f62c93406a8b6735503eebfbd66ce"
Jul 09 19:11:43.849545 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:43.849531    2580 scope.go:117] "RemoveContainer" containerID="2c42d1ec84b2dcdaba75615b97cd7749ed3f62c93406a8b6735503eebfbd66ce"
Jul 09 19:11:43.849779 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:11:43.849762    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c42d1ec84b2dcdaba75615b97cd7749ed3f62c93406a8b6735503eebfbd66ce\": container with ID starting with 2c42d1ec84b2dcdaba75615b97cd7749ed3f62c93406a8b6735503eebfbd66ce not found: ID does not exist" containerID="2c42d1ec84b2dcdaba75615b97cd7749ed3f62c93406a8b6735503eebfbd66ce"
Jul 09 19:11:43.849819 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:43.849789    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c42d1ec84b2dcdaba75615b97cd7749ed3f62c93406a8b6735503eebfbd66ce"} err="failed to get container status \"2c42d1ec84b2dcdaba75615b97cd7749ed3f62c93406a8b6735503eebfbd66ce\": rpc error: code = NotFound desc = could not find container \"2c42d1ec84b2dcdaba75615b97cd7749ed3f62c93406a8b6735503eebfbd66ce\": container with ID starting with 2c42d1ec84b2dcdaba75615b97cd7749ed3f62c93406a8b6735503eebfbd66ce not found: ID does not exist"
Jul 09 19:11:43.865172 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:43.865148    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6"]
Jul 09 19:11:43.872150 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:43.872126    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a618683-5865fb9965-4d8t6"]
Jul 09 19:11:45.253345 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:45.253309    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3ff490e-10bf-4b26-b7c7-c73d244e6d23" path="/var/lib/kubelet/pods/e3ff490e-10bf-4b26-b7c7-c73d244e6d23/volumes"
Jul 09 19:11:57.197769 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:57.197738    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx"]
Jul 09 19:11:57.198383 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:57.198360    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3ff490e-10bf-4b26-b7c7-c73d244e6d23" containerName="maas-api"
Jul 09 19:11:57.198468 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:57.198385    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3ff490e-10bf-4b26-b7c7-c73d244e6d23" containerName="maas-api"
Jul 09 19:11:57.198553 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:57.198540    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3ff490e-10bf-4b26-b7c7-c73d244e6d23" containerName="maas-api"
Jul 09 19:11:57.209925 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:57.209898    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx"
Jul 09 19:11:57.212497 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:57.212469    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-861591de-serving-cert\""
Jul 09 19:11:57.212629 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:57.212471    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rxfcr\""
Jul 09 19:11:57.212629 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:57.212471    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx"]
Jul 09 19:11:57.344722 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:57.344695    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ec34b1d-3a01-463a-9cab-8fabdcfe00f7-openshift-service-ca\") pod \"maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx\" (UID: \"0ec34b1d-3a01-463a-9cab-8fabdcfe00f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx"
Jul 09 19:11:57.344912 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:57.344739    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ec34b1d-3a01-463a-9cab-8fabdcfe00f7-maas-api-tls\") pod \"maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx\" (UID: \"0ec34b1d-3a01-463a-9cab-8fabdcfe00f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx"
Jul 09 19:11:57.344912 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:57.344757    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg4ds\" (UniqueName: \"kubernetes.io/projected/0ec34b1d-3a01-463a-9cab-8fabdcfe00f7-kube-api-access-wg4ds\") pod \"maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx\" (UID: \"0ec34b1d-3a01-463a-9cab-8fabdcfe00f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx"
Jul 09 19:11:57.446334 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:57.446294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ec34b1d-3a01-463a-9cab-8fabdcfe00f7-openshift-service-ca\") pod \"maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx\" (UID: \"0ec34b1d-3a01-463a-9cab-8fabdcfe00f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx"
Jul 09 19:11:57.446544 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:57.446347    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ec34b1d-3a01-463a-9cab-8fabdcfe00f7-maas-api-tls\") pod \"maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx\" (UID: \"0ec34b1d-3a01-463a-9cab-8fabdcfe00f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx"
Jul 09 19:11:57.446544 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:57.446366    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg4ds\" (UniqueName: \"kubernetes.io/projected/0ec34b1d-3a01-463a-9cab-8fabdcfe00f7-kube-api-access-wg4ds\") pod \"maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx\" (UID: \"0ec34b1d-3a01-463a-9cab-8fabdcfe00f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx"
Jul 09 19:11:57.446544 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:11:57.446455    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-861591de-serving-cert: secret "maas-api-e2e-derive-861591de-serving-cert" not found
Jul 09 19:11:57.446544 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:11:57.446516    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ec34b1d-3a01-463a-9cab-8fabdcfe00f7-maas-api-tls podName:0ec34b1d-3a01-463a-9cab-8fabdcfe00f7 nodeName:}" failed. No retries permitted until 2026-07-09 19:11:57.946497309 +0000 UTC m=+1573.156086523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0ec34b1d-3a01-463a-9cab-8fabdcfe00f7-maas-api-tls") pod "maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx" (UID: "0ec34b1d-3a01-463a-9cab-8fabdcfe00f7") : secret "maas-api-e2e-derive-861591de-serving-cert" not found
Jul 09 19:11:57.447032 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:57.447012    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ec34b1d-3a01-463a-9cab-8fabdcfe00f7-openshift-service-ca\") pod \"maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx\" (UID: \"0ec34b1d-3a01-463a-9cab-8fabdcfe00f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx"
Jul 09 19:11:57.457812 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:57.457753    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg4ds\" (UniqueName: \"kubernetes.io/projected/0ec34b1d-3a01-463a-9cab-8fabdcfe00f7-kube-api-access-wg4ds\") pod \"maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx\" (UID: \"0ec34b1d-3a01-463a-9cab-8fabdcfe00f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx"
Jul 09 19:11:57.950939 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:57.950904    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ec34b1d-3a01-463a-9cab-8fabdcfe00f7-maas-api-tls\") pod \"maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx\" (UID: \"0ec34b1d-3a01-463a-9cab-8fabdcfe00f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx"
Jul 09 19:11:57.953275 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:57.953246    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ec34b1d-3a01-463a-9cab-8fabdcfe00f7-maas-api-tls\") pod \"maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx\" (UID: \"0ec34b1d-3a01-463a-9cab-8fabdcfe00f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx"
Jul 09 19:11:58.121342 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:58.121309    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx"
Jul 09 19:11:58.266752 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:58.266728    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx"]
Jul 09 19:11:58.269652 ip-10-0-137-236 kubenswrapper[2580]: W0709 19:11:58.269626    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec34b1d_3a01_463a_9cab_8fabdcfe00f7.slice/crio-148b7a27e170999d6d827c1aa10abb44ae86f34fc97e4ad676f79aa882071ae7 WatchSource:0}: Error finding container 148b7a27e170999d6d827c1aa10abb44ae86f34fc97e4ad676f79aa882071ae7: Status 404 returned error can't find the container with id 148b7a27e170999d6d827c1aa10abb44ae86f34fc97e4ad676f79aa882071ae7
Jul 09 19:11:58.917176 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:58.917098    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx" event={"ID":"0ec34b1d-3a01-463a-9cab-8fabdcfe00f7","Type":"ContainerStarted","Data":"43bb7bcaa9415dc0253f0340cccfb5e88b1117473ec2f7683e84a5db093965bf"}
Jul 09 19:11:58.917176 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:58.917150    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx" event={"ID":"0ec34b1d-3a01-463a-9cab-8fabdcfe00f7","Type":"ContainerStarted","Data":"148b7a27e170999d6d827c1aa10abb44ae86f34fc97e4ad676f79aa882071ae7"}
Jul 09 19:11:58.917351 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:58.917236    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx"
Jul 09 19:11:58.938014 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:11:58.937960    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx" podStartSLOduration=1.5927913299999998 podStartE2EDuration="1.937945167s" totalImagesPullingTime="345.153837ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:11:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:11:58.935888756 +0000 UTC m=+1574.145477972" watchObservedRunningTime="2026-07-09 19:11:58.937945167 +0000 UTC m=+1574.147534385"
Jul 09 19:12:01.739283 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:12:01.739247    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx"]
Jul 09 19:12:01.739670 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:12:01.739513    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx" podUID="0ec34b1d-3a01-463a-9cab-8fabdcfe00f7" containerName="maas-api" containerID="cri-o://43bb7bcaa9415dc0253f0340cccfb5e88b1117473ec2f7683e84a5db093965bf" gracePeriod=30
Jul 09 19:12:01.934171 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:12:01.934136    2580 generic.go:356] "Generic (PLEG): container finished" podID="0ec34b1d-3a01-463a-9cab-8fabdcfe00f7" containerID="43bb7bcaa9415dc0253f0340cccfb5e88b1117473ec2f7683e84a5db093965bf" exitCode=0
Jul 09 19:12:01.934427 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:12:01.934215    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx" event={"ID":"0ec34b1d-3a01-463a-9cab-8fabdcfe00f7","Type":"ContainerDied","Data":"43bb7bcaa9415dc0253f0340cccfb5e88b1117473ec2f7683e84a5db093965bf"}
Jul 09 19:12:01.986939 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:12:01.986918    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx"
Jul 09 19:12:02.084708 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:12:02.084631    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ec34b1d-3a01-463a-9cab-8fabdcfe00f7-openshift-service-ca\") pod \"0ec34b1d-3a01-463a-9cab-8fabdcfe00f7\" (UID: \"0ec34b1d-3a01-463a-9cab-8fabdcfe00f7\") "
Jul 09 19:12:02.084901 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:12:02.084723    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ec34b1d-3a01-463a-9cab-8fabdcfe00f7-maas-api-tls\") pod \"0ec34b1d-3a01-463a-9cab-8fabdcfe00f7\" (UID: \"0ec34b1d-3a01-463a-9cab-8fabdcfe00f7\") "
Jul 09 19:12:02.084901 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:12:02.084799    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wg4ds\" (UniqueName: \"kubernetes.io/projected/0ec34b1d-3a01-463a-9cab-8fabdcfe00f7-kube-api-access-wg4ds\") pod \"0ec34b1d-3a01-463a-9cab-8fabdcfe00f7\" (UID: \"0ec34b1d-3a01-463a-9cab-8fabdcfe00f7\") "
Jul 09 19:12:02.085086 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:12:02.085061    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ec34b1d-3a01-463a-9cab-8fabdcfe00f7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0ec34b1d-3a01-463a-9cab-8fabdcfe00f7" (UID: "0ec34b1d-3a01-463a-9cab-8fabdcfe00f7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:12:02.085152 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:12:02.085137    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ec34b1d-3a01-463a-9cab-8fabdcfe00f7-openshift-service-ca\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:12:02.086800 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:12:02.086775    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ec34b1d-3a01-463a-9cab-8fabdcfe00f7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0ec34b1d-3a01-463a-9cab-8fabdcfe00f7" (UID: "0ec34b1d-3a01-463a-9cab-8fabdcfe00f7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:12:02.086893 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:12:02.086814    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ec34b1d-3a01-463a-9cab-8fabdcfe00f7-kube-api-access-wg4ds" (OuterVolumeSpecName: "kube-api-access-wg4ds") pod "0ec34b1d-3a01-463a-9cab-8fabdcfe00f7" (UID: "0ec34b1d-3a01-463a-9cab-8fabdcfe00f7"). InnerVolumeSpecName "kube-api-access-wg4ds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:12:02.186102 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:12:02.186067    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ec34b1d-3a01-463a-9cab-8fabdcfe00f7-maas-api-tls\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:12:02.186102 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:12:02.186095    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wg4ds\" (UniqueName: \"kubernetes.io/projected/0ec34b1d-3a01-463a-9cab-8fabdcfe00f7-kube-api-access-wg4ds\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:12:02.940688 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:12:02.940646    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx"
Jul 09 19:12:02.940688 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:12:02.940663    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx" event={"ID":"0ec34b1d-3a01-463a-9cab-8fabdcfe00f7","Type":"ContainerDied","Data":"148b7a27e170999d6d827c1aa10abb44ae86f34fc97e4ad676f79aa882071ae7"}
Jul 09 19:12:02.941184 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:12:02.940728    2580 scope.go:117] "RemoveContainer" containerID="43bb7bcaa9415dc0253f0340cccfb5e88b1117473ec2f7683e84a5db093965bf"
Jul 09 19:12:02.965203 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:12:02.965175    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx"]
Jul 09 19:12:02.968910 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:12:02.968879    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-861591de-6b65fbdb88-4tzhx"]
Jul 09 19:12:03.253274 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:12:03.253244    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ec34b1d-3a01-463a-9cab-8fabdcfe00f7" path="/var/lib/kubelet/pods/0ec34b1d-3a01-463a-9cab-8fabdcfe00f7/volumes"
Jul 09 19:13:52.107707 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:13:52.107674    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm"]
Jul 09 19:13:52.108279 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:13:52.108208    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ec34b1d-3a01-463a-9cab-8fabdcfe00f7" containerName="maas-api"
Jul 09 19:13:52.108279 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:13:52.108225    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ec34b1d-3a01-463a-9cab-8fabdcfe00f7" containerName="maas-api"
Jul 09 19:13:52.108396 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:13:52.108331    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ec34b1d-3a01-463a-9cab-8fabdcfe00f7" containerName="maas-api"
Jul 09 19:13:52.111447 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:13:52.111430    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm"
Jul 09 19:13:52.114354 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:13:52.114337    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5b2f785e-serving-cert\""
Jul 09 19:13:52.114485 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:13:52.114470    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rxfcr\""
Jul 09 19:13:52.121005 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:13:52.120984    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm"]
Jul 09 19:13:52.179155 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:13:52.179121    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b4d9e53-d523-4dd7-8755-18a9318302ae-maas-api-tls\") pod \"maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm\" (UID: \"1b4d9e53-d523-4dd7-8755-18a9318302ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm"
Jul 09 19:13:52.179155 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:13:52.179150    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b4d9e53-d523-4dd7-8755-18a9318302ae-openshift-service-ca\") pod \"maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm\" (UID: \"1b4d9e53-d523-4dd7-8755-18a9318302ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm"
Jul 09 19:13:52.179374 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:13:52.179305    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s8c9\" (UniqueName: \"kubernetes.io/projected/1b4d9e53-d523-4dd7-8755-18a9318302ae-kube-api-access-4s8c9\") pod \"maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm\" (UID: \"1b4d9e53-d523-4dd7-8755-18a9318302ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm"
Jul 09 19:13:52.280315 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:13:52.280273    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s8c9\" (UniqueName: \"kubernetes.io/projected/1b4d9e53-d523-4dd7-8755-18a9318302ae-kube-api-access-4s8c9\") pod \"maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm\" (UID: \"1b4d9e53-d523-4dd7-8755-18a9318302ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm"
Jul 09 19:13:52.280505 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:13:52.280343    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b4d9e53-d523-4dd7-8755-18a9318302ae-maas-api-tls\") pod \"maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm\" (UID: \"1b4d9e53-d523-4dd7-8755-18a9318302ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm"
Jul 09 19:13:52.280505 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:13:52.280369    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b4d9e53-d523-4dd7-8755-18a9318302ae-openshift-service-ca\") pod \"maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm\" (UID: \"1b4d9e53-d523-4dd7-8755-18a9318302ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm"
Jul 09 19:13:52.280505 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:13:52.280477    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-serving-cert: secret "maas-api-e2e-mt-5b2f785e-serving-cert" not found
Jul 09 19:13:52.280672 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:13:52.280568    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b4d9e53-d523-4dd7-8755-18a9318302ae-maas-api-tls podName:1b4d9e53-d523-4dd7-8755-18a9318302ae nodeName:}" failed. No retries permitted until 2026-07-09 19:13:52.780553741 +0000 UTC m=+1687.990142941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1b4d9e53-d523-4dd7-8755-18a9318302ae-maas-api-tls") pod "maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm" (UID: "1b4d9e53-d523-4dd7-8755-18a9318302ae") : secret "maas-api-e2e-mt-5b2f785e-serving-cert" not found
Jul 09 19:13:52.281091 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:13:52.281069    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b4d9e53-d523-4dd7-8755-18a9318302ae-openshift-service-ca\") pod \"maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm\" (UID: \"1b4d9e53-d523-4dd7-8755-18a9318302ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm"
Jul 09 19:13:52.289888 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:13:52.289872    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s8c9\" (UniqueName: \"kubernetes.io/projected/1b4d9e53-d523-4dd7-8755-18a9318302ae-kube-api-access-4s8c9\") pod \"maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm\" (UID: \"1b4d9e53-d523-4dd7-8755-18a9318302ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm"
Jul 09 19:13:52.785273 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:13:52.785235    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b4d9e53-d523-4dd7-8755-18a9318302ae-maas-api-tls\") pod \"maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm\" (UID: \"1b4d9e53-d523-4dd7-8755-18a9318302ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm"
Jul 09 19:13:52.785448 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:13:52.785387    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-serving-cert: secret "maas-api-e2e-mt-5b2f785e-serving-cert" not found
Jul 09 19:13:52.785502 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:13:52.785463    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b4d9e53-d523-4dd7-8755-18a9318302ae-maas-api-tls podName:1b4d9e53-d523-4dd7-8755-18a9318302ae nodeName:}" failed. No retries permitted until 2026-07-09 19:13:53.785447231 +0000 UTC m=+1688.995036432 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1b4d9e53-d523-4dd7-8755-18a9318302ae-maas-api-tls") pod "maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm" (UID: "1b4d9e53-d523-4dd7-8755-18a9318302ae") : secret "maas-api-e2e-mt-5b2f785e-serving-cert" not found
Jul 09 19:13:53.794912 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:13:53.794873    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b4d9e53-d523-4dd7-8755-18a9318302ae-maas-api-tls\") pod \"maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm\" (UID: \"1b4d9e53-d523-4dd7-8755-18a9318302ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm"
Jul 09 19:13:53.797378 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:13:53.797355    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b4d9e53-d523-4dd7-8755-18a9318302ae-maas-api-tls\") pod \"maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm\" (UID: \"1b4d9e53-d523-4dd7-8755-18a9318302ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm"
Jul 09 19:13:53.921815 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:13:53.921780    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm"
Jul 09 19:13:54.055032 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:13:54.055010    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm"]
Jul 09 19:13:54.056556 ip-10-0-137-236 kubenswrapper[2580]: W0709 19:13:54.056526    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b4d9e53_d523_4dd7_8755_18a9318302ae.slice/crio-f233e4fc5ec24bdef7099e00cbf4d9d8ebd2a24e01c9ca25ac9c2782cc86cb93 WatchSource:0}: Error finding container f233e4fc5ec24bdef7099e00cbf4d9d8ebd2a24e01c9ca25ac9c2782cc86cb93: Status 404 returned error can't find the container with id f233e4fc5ec24bdef7099e00cbf4d9d8ebd2a24e01c9ca25ac9c2782cc86cb93
Jul 09 19:13:54.487884 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:13:54.487816    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm" event={"ID":"1b4d9e53-d523-4dd7-8755-18a9318302ae","Type":"ContainerStarted","Data":"f233e4fc5ec24bdef7099e00cbf4d9d8ebd2a24e01c9ca25ac9c2782cc86cb93"}
Jul 09 19:13:55.494898 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:13:55.494863    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm" event={"ID":"1b4d9e53-d523-4dd7-8755-18a9318302ae","Type":"ContainerStarted","Data":"0838adf81d7f07da070b76c5b807c558fd3974b5c8d6a7d059fcda4ffe869a20"}
Jul 09 19:13:55.495281 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:13:55.494961    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm"
Jul 09 19:13:55.515715 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:13:55.515663    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm" podStartSLOduration=3.070234281 podStartE2EDuration="3.515647691s" totalImagesPullingTime="445.41341ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:13:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:13:55.514469574 +0000 UTC m=+1690.724058793" watchObservedRunningTime="2026-07-09 19:13:55.515647691 +0000 UTC m=+1690.725236909"
Jul 09 19:14:01.505784 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:01.505752    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm"
Jul 09 19:14:05.269166 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:05.269126    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm"]
Jul 09 19:14:05.269643 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:05.269371    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm" podUID="1b4d9e53-d523-4dd7-8755-18a9318302ae" containerName="maas-api" containerID="cri-o://0838adf81d7f07da070b76c5b807c558fd3974b5c8d6a7d059fcda4ffe869a20" gracePeriod=30
Jul 09 19:14:05.525093 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:05.525020    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm"
Jul 09 19:14:05.542550 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:05.542514    2580 generic.go:356] "Generic (PLEG): container finished" podID="1b4d9e53-d523-4dd7-8755-18a9318302ae" containerID="0838adf81d7f07da070b76c5b807c558fd3974b5c8d6a7d059fcda4ffe869a20" exitCode=0
Jul 09 19:14:05.542736 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:05.542562    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm"
Jul 09 19:14:05.542736 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:05.542570    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm" event={"ID":"1b4d9e53-d523-4dd7-8755-18a9318302ae","Type":"ContainerDied","Data":"0838adf81d7f07da070b76c5b807c558fd3974b5c8d6a7d059fcda4ffe869a20"}
Jul 09 19:14:05.542736 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:05.542616    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm" event={"ID":"1b4d9e53-d523-4dd7-8755-18a9318302ae","Type":"ContainerDied","Data":"f233e4fc5ec24bdef7099e00cbf4d9d8ebd2a24e01c9ca25ac9c2782cc86cb93"}
Jul 09 19:14:05.542736 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:05.542639    2580 scope.go:117] "RemoveContainer" containerID="0838adf81d7f07da070b76c5b807c558fd3974b5c8d6a7d059fcda4ffe869a20"
Jul 09 19:14:05.553272 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:05.553251    2580 scope.go:117] "RemoveContainer" containerID="0838adf81d7f07da070b76c5b807c558fd3974b5c8d6a7d059fcda4ffe869a20"
Jul 09 19:14:05.553603 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:14:05.553584    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0838adf81d7f07da070b76c5b807c558fd3974b5c8d6a7d059fcda4ffe869a20\": container with ID starting with 0838adf81d7f07da070b76c5b807c558fd3974b5c8d6a7d059fcda4ffe869a20 not found: ID does not exist" containerID="0838adf81d7f07da070b76c5b807c558fd3974b5c8d6a7d059fcda4ffe869a20"
Jul 09 19:14:05.553661 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:05.553613    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0838adf81d7f07da070b76c5b807c558fd3974b5c8d6a7d059fcda4ffe869a20"} err="failed to get container status \"0838adf81d7f07da070b76c5b807c558fd3974b5c8d6a7d059fcda4ffe869a20\": rpc error: code = NotFound desc = could not find container \"0838adf81d7f07da070b76c5b807c558fd3974b5c8d6a7d059fcda4ffe869a20\": container with ID starting with 0838adf81d7f07da070b76c5b807c558fd3974b5c8d6a7d059fcda4ffe869a20 not found: ID does not exist"
Jul 09 19:14:05.616653 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:05.616618    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4s8c9\" (UniqueName: \"kubernetes.io/projected/1b4d9e53-d523-4dd7-8755-18a9318302ae-kube-api-access-4s8c9\") pod \"1b4d9e53-d523-4dd7-8755-18a9318302ae\" (UID: \"1b4d9e53-d523-4dd7-8755-18a9318302ae\") "
Jul 09 19:14:05.616824 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:05.616687    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b4d9e53-d523-4dd7-8755-18a9318302ae-maas-api-tls\") pod \"1b4d9e53-d523-4dd7-8755-18a9318302ae\" (UID: \"1b4d9e53-d523-4dd7-8755-18a9318302ae\") "
Jul 09 19:14:05.616824 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:05.616715    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b4d9e53-d523-4dd7-8755-18a9318302ae-openshift-service-ca\") pod \"1b4d9e53-d523-4dd7-8755-18a9318302ae\" (UID: \"1b4d9e53-d523-4dd7-8755-18a9318302ae\") "
Jul 09 19:14:05.617170 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:05.617140    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b4d9e53-d523-4dd7-8755-18a9318302ae-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1b4d9e53-d523-4dd7-8755-18a9318302ae" (UID: "1b4d9e53-d523-4dd7-8755-18a9318302ae"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:14:05.618796 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:05.618771    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b4d9e53-d523-4dd7-8755-18a9318302ae-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1b4d9e53-d523-4dd7-8755-18a9318302ae" (UID: "1b4d9e53-d523-4dd7-8755-18a9318302ae"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:14:05.618919 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:05.618867    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b4d9e53-d523-4dd7-8755-18a9318302ae-kube-api-access-4s8c9" (OuterVolumeSpecName: "kube-api-access-4s8c9") pod "1b4d9e53-d523-4dd7-8755-18a9318302ae" (UID: "1b4d9e53-d523-4dd7-8755-18a9318302ae"). InnerVolumeSpecName "kube-api-access-4s8c9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:14:05.717516 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:05.717463    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4s8c9\" (UniqueName: \"kubernetes.io/projected/1b4d9e53-d523-4dd7-8755-18a9318302ae-kube-api-access-4s8c9\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:14:05.717516 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:05.717511    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b4d9e53-d523-4dd7-8755-18a9318302ae-maas-api-tls\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:14:05.717516 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:05.717521    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b4d9e53-d523-4dd7-8755-18a9318302ae-openshift-service-ca\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:14:05.866844 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:05.866803    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm"]
Jul 09 19:14:05.871559 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:05.871532    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5b2f785e-7c669b7647-4kdlm"]
Jul 09 19:14:07.252250 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:07.252178    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b4d9e53-d523-4dd7-8755-18a9318302ae" path="/var/lib/kubelet/pods/1b4d9e53-d523-4dd7-8755-18a9318302ae/volumes"
Jul 09 19:14:39.309953 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:39.309917    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz"]
Jul 09 19:14:39.310531 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:39.310499    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b4d9e53-d523-4dd7-8755-18a9318302ae" containerName="maas-api"
Jul 09 19:14:39.310531 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:39.310520    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b4d9e53-d523-4dd7-8755-18a9318302ae" containerName="maas-api"
Jul 09 19:14:39.310664 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:39.310648    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b4d9e53-d523-4dd7-8755-18a9318302ae" containerName="maas-api"
Jul 09 19:14:39.313968 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:39.313949    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz"
Jul 09 19:14:39.316856 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:39.316815    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rxfcr\""
Jul 09 19:14:39.316967 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:39.316854    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-4cb532e2-serving-cert\""
Jul 09 19:14:39.334100 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:39.334077    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz"]
Jul 09 19:14:39.427739 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:39.427702    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bafae65-bb89-408d-a3e5-9ab19ed86d46-maas-api-tls\") pod \"maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz\" (UID: \"2bafae65-bb89-408d-a3e5-9ab19ed86d46\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz"
Jul 09 19:14:39.427915 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:39.427816    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bafae65-bb89-408d-a3e5-9ab19ed86d46-openshift-service-ca\") pod \"maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz\" (UID: \"2bafae65-bb89-408d-a3e5-9ab19ed86d46\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz"
Jul 09 19:14:39.427915 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:39.427874    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-856xd\" (UniqueName: \"kubernetes.io/projected/2bafae65-bb89-408d-a3e5-9ab19ed86d46-kube-api-access-856xd\") pod \"maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz\" (UID: \"2bafae65-bb89-408d-a3e5-9ab19ed86d46\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz"
Jul 09 19:14:39.529183 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:39.529144    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bafae65-bb89-408d-a3e5-9ab19ed86d46-openshift-service-ca\") pod \"maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz\" (UID: \"2bafae65-bb89-408d-a3e5-9ab19ed86d46\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz"
Jul 09 19:14:39.529458 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:39.529189    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-856xd\" (UniqueName: \"kubernetes.io/projected/2bafae65-bb89-408d-a3e5-9ab19ed86d46-kube-api-access-856xd\") pod \"maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz\" (UID: \"2bafae65-bb89-408d-a3e5-9ab19ed86d46\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz"
Jul 09 19:14:39.529458 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:39.529259    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bafae65-bb89-408d-a3e5-9ab19ed86d46-maas-api-tls\") pod \"maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz\" (UID: \"2bafae65-bb89-408d-a3e5-9ab19ed86d46\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz"
Jul 09 19:14:39.529458 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:14:39.529406    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-serving-cert: secret "maas-api-e2e-mt-4cb532e2-serving-cert" not found
Jul 09 19:14:39.529587 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:14:39.529473    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bafae65-bb89-408d-a3e5-9ab19ed86d46-maas-api-tls podName:2bafae65-bb89-408d-a3e5-9ab19ed86d46 nodeName:}" failed. No retries permitted until 2026-07-09 19:14:40.029453361 +0000 UTC m=+1735.239042570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2bafae65-bb89-408d-a3e5-9ab19ed86d46-maas-api-tls") pod "maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz" (UID: "2bafae65-bb89-408d-a3e5-9ab19ed86d46") : secret "maas-api-e2e-mt-4cb532e2-serving-cert" not found
Jul 09 19:14:39.529759 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:39.529741    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bafae65-bb89-408d-a3e5-9ab19ed86d46-openshift-service-ca\") pod \"maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz\" (UID: \"2bafae65-bb89-408d-a3e5-9ab19ed86d46\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz"
Jul 09 19:14:39.539209 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:39.539185    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-856xd\" (UniqueName: \"kubernetes.io/projected/2bafae65-bb89-408d-a3e5-9ab19ed86d46-kube-api-access-856xd\") pod \"maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz\" (UID: \"2bafae65-bb89-408d-a3e5-9ab19ed86d46\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz"
Jul 09 19:14:40.034284 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:40.034255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bafae65-bb89-408d-a3e5-9ab19ed86d46-maas-api-tls\") pod \"maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz\" (UID: \"2bafae65-bb89-408d-a3e5-9ab19ed86d46\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz"
Jul 09 19:14:40.036476 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:40.036456    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bafae65-bb89-408d-a3e5-9ab19ed86d46-maas-api-tls\") pod \"maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz\" (UID: \"2bafae65-bb89-408d-a3e5-9ab19ed86d46\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz"
Jul 09 19:14:40.224310 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:40.224268    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz"
Jul 09 19:14:40.361363 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:40.361334    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz"]
Jul 09 19:14:40.362814 ip-10-0-137-236 kubenswrapper[2580]: W0709 19:14:40.362792    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bafae65_bb89_408d_a3e5_9ab19ed86d46.slice/crio-a013d91f360b6abca5411ef09c1d8ccdbf640c147a417674b7cc68572878952c WatchSource:0}: Error finding container a013d91f360b6abca5411ef09c1d8ccdbf640c147a417674b7cc68572878952c: Status 404 returned error can't find the container with id a013d91f360b6abca5411ef09c1d8ccdbf640c147a417674b7cc68572878952c
Jul 09 19:14:40.718836 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:40.718806    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz" event={"ID":"2bafae65-bb89-408d-a3e5-9ab19ed86d46","Type":"ContainerStarted","Data":"a013d91f360b6abca5411ef09c1d8ccdbf640c147a417674b7cc68572878952c"}
Jul 09 19:14:41.725122 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:41.725081    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz" event={"ID":"2bafae65-bb89-408d-a3e5-9ab19ed86d46","Type":"ContainerStarted","Data":"60e83ab8156198649fb719e56bc173f0e5a4755b64107737c7483b8ffb843ce6"}
Jul 09 19:14:41.725498 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:41.725218    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz"
Jul 09 19:14:41.746377 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:41.746324    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz" podStartSLOduration=2.313008185 podStartE2EDuration="2.746306572s" totalImagesPullingTime="433.298387ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:14:41.744160411 +0000 UTC m=+1736.953749650" watchObservedRunningTime="2026-07-09 19:14:41.746306572 +0000 UTC m=+1736.955895789"
Jul 09 19:14:47.735488 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:14:47.735462    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz"
Jul 09 19:15:21.966703 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:15:21.966674    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz"]
Jul 09 19:15:21.967273 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:15:21.966946    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz" podUID="2bafae65-bb89-408d-a3e5-9ab19ed86d46" containerName="maas-api" containerID="cri-o://60e83ab8156198649fb719e56bc173f0e5a4755b64107737c7483b8ffb843ce6" gracePeriod=30
Jul 09 19:15:22.214327 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:15:22.214303    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz"
Jul 09 19:15:22.334278 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:15:22.334184    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-856xd\" (UniqueName: \"kubernetes.io/projected/2bafae65-bb89-408d-a3e5-9ab19ed86d46-kube-api-access-856xd\") pod \"2bafae65-bb89-408d-a3e5-9ab19ed86d46\" (UID: \"2bafae65-bb89-408d-a3e5-9ab19ed86d46\") "
Jul 09 19:15:22.334278 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:15:22.334262    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bafae65-bb89-408d-a3e5-9ab19ed86d46-maas-api-tls\") pod \"2bafae65-bb89-408d-a3e5-9ab19ed86d46\" (UID: \"2bafae65-bb89-408d-a3e5-9ab19ed86d46\") "
Jul 09 19:15:22.334528 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:15:22.334298    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bafae65-bb89-408d-a3e5-9ab19ed86d46-openshift-service-ca\") pod \"2bafae65-bb89-408d-a3e5-9ab19ed86d46\" (UID: \"2bafae65-bb89-408d-a3e5-9ab19ed86d46\") "
Jul 09 19:15:22.334744 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:15:22.334713    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bafae65-bb89-408d-a3e5-9ab19ed86d46-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2bafae65-bb89-408d-a3e5-9ab19ed86d46" (UID: "2bafae65-bb89-408d-a3e5-9ab19ed86d46"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:15:22.336313 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:15:22.336287    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bafae65-bb89-408d-a3e5-9ab19ed86d46-kube-api-access-856xd" (OuterVolumeSpecName: "kube-api-access-856xd") pod "2bafae65-bb89-408d-a3e5-9ab19ed86d46" (UID: "2bafae65-bb89-408d-a3e5-9ab19ed86d46"). InnerVolumeSpecName "kube-api-access-856xd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:15:22.336423 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:15:22.336373    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bafae65-bb89-408d-a3e5-9ab19ed86d46-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2bafae65-bb89-408d-a3e5-9ab19ed86d46" (UID: "2bafae65-bb89-408d-a3e5-9ab19ed86d46"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:15:22.435780 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:15:22.435750    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bafae65-bb89-408d-a3e5-9ab19ed86d46-maas-api-tls\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:15:22.435780 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:15:22.435777    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bafae65-bb89-408d-a3e5-9ab19ed86d46-openshift-service-ca\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:15:22.435780 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:15:22.435786    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-856xd\" (UniqueName: \"kubernetes.io/projected/2bafae65-bb89-408d-a3e5-9ab19ed86d46-kube-api-access-856xd\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:15:22.929720 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:15:22.929678    2580 generic.go:356] "Generic (PLEG): container finished" podID="2bafae65-bb89-408d-a3e5-9ab19ed86d46" containerID="60e83ab8156198649fb719e56bc173f0e5a4755b64107737c7483b8ffb843ce6" exitCode=0
Jul 09 19:15:22.929911 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:15:22.929728    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz"
Jul 09 19:15:22.929911 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:15:22.929729    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz" event={"ID":"2bafae65-bb89-408d-a3e5-9ab19ed86d46","Type":"ContainerDied","Data":"60e83ab8156198649fb719e56bc173f0e5a4755b64107737c7483b8ffb843ce6"}
Jul 09 19:15:22.929911 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:15:22.929891    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz" event={"ID":"2bafae65-bb89-408d-a3e5-9ab19ed86d46","Type":"ContainerDied","Data":"a013d91f360b6abca5411ef09c1d8ccdbf640c147a417674b7cc68572878952c"}
Jul 09 19:15:22.930025 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:15:22.929924    2580 scope.go:117] "RemoveContainer" containerID="60e83ab8156198649fb719e56bc173f0e5a4755b64107737c7483b8ffb843ce6"
Jul 09 19:15:22.938926 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:15:22.938901    2580 scope.go:117] "RemoveContainer" containerID="60e83ab8156198649fb719e56bc173f0e5a4755b64107737c7483b8ffb843ce6"
Jul 09 19:15:22.939144 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:15:22.939126    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60e83ab8156198649fb719e56bc173f0e5a4755b64107737c7483b8ffb843ce6\": container with ID starting with 60e83ab8156198649fb719e56bc173f0e5a4755b64107737c7483b8ffb843ce6 not found: ID does not exist" containerID="60e83ab8156198649fb719e56bc173f0e5a4755b64107737c7483b8ffb843ce6"
Jul 09 19:15:22.939184 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:15:22.939151    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60e83ab8156198649fb719e56bc173f0e5a4755b64107737c7483b8ffb843ce6"} err="failed to get container status \"60e83ab8156198649fb719e56bc173f0e5a4755b64107737c7483b8ffb843ce6\": rpc error: code = NotFound desc = could not find container \"60e83ab8156198649fb719e56bc173f0e5a4755b64107737c7483b8ffb843ce6\": container with ID starting with 60e83ab8156198649fb719e56bc173f0e5a4755b64107737c7483b8ffb843ce6 not found: ID does not exist"
Jul 09 19:15:22.953636 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:15:22.953606    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz"]
Jul 09 19:15:22.958049 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:15:22.958025    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4cb532e2-5bcf657cc9-6f5dz"]
Jul 09 19:15:23.252811 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:15:23.252775    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bafae65-bb89-408d-a3e5-9ab19ed86d46" path="/var/lib/kubelet/pods/2bafae65-bb89-408d-a3e5-9ab19ed86d46/volumes"
Jul 09 19:15:45.297021 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:15:45.296990    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hps7x_30222ae0-b5d2-440e-a799-e808706d4b84/ovn-acl-logging/0.log"
Jul 09 19:15:45.300325 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:15:45.300302    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hps7x_30222ae0-b5d2-440e-a799-e808706d4b84/ovn-acl-logging/0.log"
Jul 09 19:17:23.926267 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:23.926185    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk"]
Jul 09 19:17:23.926809 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:23.926790    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bafae65-bb89-408d-a3e5-9ab19ed86d46" containerName="maas-api"
Jul 09 19:17:23.926890 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:23.926814    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bafae65-bb89-408d-a3e5-9ab19ed86d46" containerName="maas-api"
Jul 09 19:17:23.926989 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:23.926977    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bafae65-bb89-408d-a3e5-9ab19ed86d46" containerName="maas-api"
Jul 09 19:17:23.930443 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:23.930424    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk"
Jul 09 19:17:23.937405 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:17:23.937374    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk\" is forbidden: User \"system:node:ip-10-0-137-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-137-236.ec2.internal' and this object" podUID="0db7f750-aff1-4df1-b000-ba2bbe1d279e" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk"
Jul 09 19:17:23.937485 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:17:23.937398    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"maas-api-dockercfg-rxfcr\" is forbidden: User \"system:node:ip-10-0-137-236.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-137-236.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rxfcr\"" type="*v1.Secret"
Jul 09 19:17:23.938120 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:23.938106    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-2259a7-serving-cert\""
Jul 09 19:17:23.976343 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:23.976293    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk"]
Jul 09 19:17:24.062940 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:24.062900    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0db7f750-aff1-4df1-b000-ba2bbe1d279e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk\" (UID: \"0db7f750-aff1-4df1-b000-ba2bbe1d279e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk"
Jul 09 19:17:24.063160 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:24.062959    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0db7f750-aff1-4df1-b000-ba2bbe1d279e-maas-api-tls\") pod \"maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk\" (UID: \"0db7f750-aff1-4df1-b000-ba2bbe1d279e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk"
Jul 09 19:17:24.063160 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:24.063077    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmdv2\" (UniqueName: \"kubernetes.io/projected/0db7f750-aff1-4df1-b000-ba2bbe1d279e-kube-api-access-cmdv2\") pod \"maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk\" (UID: \"0db7f750-aff1-4df1-b000-ba2bbe1d279e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk"
Jul 09 19:17:24.164596 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:24.164557    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0db7f750-aff1-4df1-b000-ba2bbe1d279e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk\" (UID: \"0db7f750-aff1-4df1-b000-ba2bbe1d279e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk"
Jul 09 19:17:24.164796 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:24.164607    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0db7f750-aff1-4df1-b000-ba2bbe1d279e-maas-api-tls\") pod \"maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk\" (UID: \"0db7f750-aff1-4df1-b000-ba2bbe1d279e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk"
Jul 09 19:17:24.164796 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:24.164644    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmdv2\" (UniqueName: \"kubernetes.io/projected/0db7f750-aff1-4df1-b000-ba2bbe1d279e-kube-api-access-cmdv2\") pod \"maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk\" (UID: \"0db7f750-aff1-4df1-b000-ba2bbe1d279e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk"
Jul 09 19:17:24.164796 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:17:24.164736    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-serving-cert: secret "maas-api-e2e-inf-a-2259a7-serving-cert" not found
Jul 09 19:17:24.165027 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:17:24.164804    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db7f750-aff1-4df1-b000-ba2bbe1d279e-maas-api-tls podName:0db7f750-aff1-4df1-b000-ba2bbe1d279e nodeName:}" failed. No retries permitted until 2026-07-09 19:17:24.664785591 +0000 UTC m=+1899.874374800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0db7f750-aff1-4df1-b000-ba2bbe1d279e-maas-api-tls") pod "maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk" (UID: "0db7f750-aff1-4df1-b000-ba2bbe1d279e") : secret "maas-api-e2e-inf-a-2259a7-serving-cert" not found
Jul 09 19:17:24.165344 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:24.165320    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0db7f750-aff1-4df1-b000-ba2bbe1d279e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk\" (UID: \"0db7f750-aff1-4df1-b000-ba2bbe1d279e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk"
Jul 09 19:17:24.174886 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:24.174862    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmdv2\" (UniqueName: \"kubernetes.io/projected/0db7f750-aff1-4df1-b000-ba2bbe1d279e-kube-api-access-cmdv2\") pod \"maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk\" (UID: \"0db7f750-aff1-4df1-b000-ba2bbe1d279e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk"
Jul 09 19:17:24.669056 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:24.669015    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0db7f750-aff1-4df1-b000-ba2bbe1d279e-maas-api-tls\") pod \"maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk\" (UID: \"0db7f750-aff1-4df1-b000-ba2bbe1d279e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk"
Jul 09 19:17:24.671377 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:24.671355    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0db7f750-aff1-4df1-b000-ba2bbe1d279e-maas-api-tls\") pod \"maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk\" (UID: \"0db7f750-aff1-4df1-b000-ba2bbe1d279e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk"
Jul 09 19:17:24.854434 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:24.854401    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rxfcr\""
Jul 09 19:17:24.861737 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:24.861706    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk"
Jul 09 19:17:24.998621 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:24.998595    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk"]
Jul 09 19:17:25.000498 ip-10-0-137-236 kubenswrapper[2580]: W0709 19:17:25.000471    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0db7f750_aff1_4df1_b000_ba2bbe1d279e.slice/crio-1c4b15e4b0e0e23f222a7d4d6a6ce27a014552783588a34d026a7bb9dc31c457 WatchSource:0}: Error finding container 1c4b15e4b0e0e23f222a7d4d6a6ce27a014552783588a34d026a7bb9dc31c457: Status 404 returned error can't find the container with id 1c4b15e4b0e0e23f222a7d4d6a6ce27a014552783588a34d026a7bb9dc31c457
Jul 09 19:17:25.001843 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:25.001814    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 19:17:25.521013 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:25.520979    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk" event={"ID":"0db7f750-aff1-4df1-b000-ba2bbe1d279e","Type":"ContainerStarted","Data":"1c4b15e4b0e0e23f222a7d4d6a6ce27a014552783588a34d026a7bb9dc31c457"}
Jul 09 19:17:26.529019 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:26.528978    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk" event={"ID":"0db7f750-aff1-4df1-b000-ba2bbe1d279e","Type":"ContainerStarted","Data":"27598897b83893de0d1d4ca8a3611751f15dd3cbe581a7c5943d05202c78011e"}
Jul 09 19:17:26.529468 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:26.529114    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk"
Jul 09 19:17:26.550426 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:26.550370    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk" podStartSLOduration=2.9645504430000003 podStartE2EDuration="3.55035072s" totalImagesPullingTime="585.800277ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:17:26.548208166 +0000 UTC m=+1901.757797386" watchObservedRunningTime="2026-07-09 19:17:26.55035072 +0000 UTC m=+1901.759939938"
Jul 09 19:17:31.552472 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:31.552437    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k"]
Jul 09 19:17:31.556617 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:31.556593    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k"
Jul 09 19:17:31.559430 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:31.559407    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-fcd3da-serving-cert\""
Jul 09 19:17:31.568721 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:31.568697    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k"]
Jul 09 19:17:31.633337 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:31.633304    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b1c3871-95a7-420b-bb3d-83d1d01576a7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-fcd3da-568b56955c-t868k\" (UID: \"4b1c3871-95a7-420b-bb3d-83d1d01576a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k"
Jul 09 19:17:31.633506 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:31.633416    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b1c3871-95a7-420b-bb3d-83d1d01576a7-maas-api-tls\") pod \"maas-api-e2e-inf-b-fcd3da-568b56955c-t868k\" (UID: \"4b1c3871-95a7-420b-bb3d-83d1d01576a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k"
Jul 09 19:17:31.633506 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:31.633478    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv5w4\" (UniqueName: \"kubernetes.io/projected/4b1c3871-95a7-420b-bb3d-83d1d01576a7-kube-api-access-qv5w4\") pod \"maas-api-e2e-inf-b-fcd3da-568b56955c-t868k\" (UID: \"4b1c3871-95a7-420b-bb3d-83d1d01576a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k"
Jul 09 19:17:31.734519 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:31.734480    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b1c3871-95a7-420b-bb3d-83d1d01576a7-maas-api-tls\") pod \"maas-api-e2e-inf-b-fcd3da-568b56955c-t868k\" (UID: \"4b1c3871-95a7-420b-bb3d-83d1d01576a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k"
Jul 09 19:17:31.734704 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:31.734534    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv5w4\" (UniqueName: \"kubernetes.io/projected/4b1c3871-95a7-420b-bb3d-83d1d01576a7-kube-api-access-qv5w4\") pod \"maas-api-e2e-inf-b-fcd3da-568b56955c-t868k\" (UID: \"4b1c3871-95a7-420b-bb3d-83d1d01576a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k"
Jul 09 19:17:31.734704 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:31.734578    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b1c3871-95a7-420b-bb3d-83d1d01576a7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-fcd3da-568b56955c-t868k\" (UID: \"4b1c3871-95a7-420b-bb3d-83d1d01576a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k"
Jul 09 19:17:31.734704 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:17:31.734630    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-serving-cert: secret "maas-api-e2e-inf-b-fcd3da-serving-cert" not found
Jul 09 19:17:31.734704 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:17:31.734701    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b1c3871-95a7-420b-bb3d-83d1d01576a7-maas-api-tls podName:4b1c3871-95a7-420b-bb3d-83d1d01576a7 nodeName:}" failed. No retries permitted until 2026-07-09 19:17:32.234685091 +0000 UTC m=+1907.444274287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4b1c3871-95a7-420b-bb3d-83d1d01576a7-maas-api-tls") pod "maas-api-e2e-inf-b-fcd3da-568b56955c-t868k" (UID: "4b1c3871-95a7-420b-bb3d-83d1d01576a7") : secret "maas-api-e2e-inf-b-fcd3da-serving-cert" not found
Jul 09 19:17:31.735246 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:31.735229    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b1c3871-95a7-420b-bb3d-83d1d01576a7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-fcd3da-568b56955c-t868k\" (UID: \"4b1c3871-95a7-420b-bb3d-83d1d01576a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k"
Jul 09 19:17:31.746011 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:31.745981    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv5w4\" (UniqueName: \"kubernetes.io/projected/4b1c3871-95a7-420b-bb3d-83d1d01576a7-kube-api-access-qv5w4\") pod \"maas-api-e2e-inf-b-fcd3da-568b56955c-t868k\" (UID: \"4b1c3871-95a7-420b-bb3d-83d1d01576a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k"
Jul 09 19:17:32.239372 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:32.239332    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b1c3871-95a7-420b-bb3d-83d1d01576a7-maas-api-tls\") pod \"maas-api-e2e-inf-b-fcd3da-568b56955c-t868k\" (UID: \"4b1c3871-95a7-420b-bb3d-83d1d01576a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k"
Jul 09 19:17:32.241800 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:32.241765    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b1c3871-95a7-420b-bb3d-83d1d01576a7-maas-api-tls\") pod \"maas-api-e2e-inf-b-fcd3da-568b56955c-t868k\" (UID: \"4b1c3871-95a7-420b-bb3d-83d1d01576a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k"
Jul 09 19:17:32.468745 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:32.468697    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k"
Jul 09 19:17:32.541068 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:32.541037    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk"
Jul 09 19:17:32.612879 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:32.612854    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k"]
Jul 09 19:17:32.615480 ip-10-0-137-236 kubenswrapper[2580]: W0709 19:17:32.615439    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b1c3871_95a7_420b_bb3d_83d1d01576a7.slice/crio-dc3b4b37cc29d0cdb430fedf0bc7503ea5ae72734d61bc8224c709bbb5a187c3 WatchSource:0}: Error finding container dc3b4b37cc29d0cdb430fedf0bc7503ea5ae72734d61bc8224c709bbb5a187c3: Status 404 returned error can't find the container with id dc3b4b37cc29d0cdb430fedf0bc7503ea5ae72734d61bc8224c709bbb5a187c3
Jul 09 19:17:33.572205 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:33.572172    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k" event={"ID":"4b1c3871-95a7-420b-bb3d-83d1d01576a7","Type":"ContainerStarted","Data":"ffcacea8161a0dedfcf88cf334cdd8e0b4c7608340c388c35d5e6b0642eb08c9"}
Jul 09 19:17:33.572382 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:33.572231    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k" event={"ID":"4b1c3871-95a7-420b-bb3d-83d1d01576a7","Type":"ContainerStarted","Data":"dc3b4b37cc29d0cdb430fedf0bc7503ea5ae72734d61bc8224c709bbb5a187c3"}
Jul 09 19:17:33.572382 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:33.572261    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k"
Jul 09 19:17:33.595462 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:33.595422    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k" podStartSLOduration=2.230572294 podStartE2EDuration="2.595405904s" totalImagesPullingTime="364.83361ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:17:33.59443587 +0000 UTC m=+1908.804025089" watchObservedRunningTime="2026-07-09 19:17:33.595405904 +0000 UTC m=+1908.804995121"
Jul 09 19:17:39.583273 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:39.583244    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k"
Jul 09 19:17:43.821008 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:43.820969    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"]
Jul 09 19:17:43.824607 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:43.824585    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:17:43.827531 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:43.827509    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2259a7\"/\"default-dockercfg-w5nwr\""
Jul 09 19:17:43.828756 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:43.828739    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2259a7\"/\"test-model-2259a7-kserve-self-signed-certs\""
Jul 09 19:17:43.828871 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:43.828762    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2259a7\"/\"kube-root-ca.crt\""
Jul 09 19:17:43.828871 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:43.828779    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2259a7\"/\"openshift-service-ca.crt\""
Jul 09 19:17:43.834607 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:43.834585    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"]
Jul 09 19:17:43.953452 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:43.953416    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3004a837-7e68-4aa9-9c2b-306076b298ff-tmp-dir\") pod \"test-model-2259a7-kserve-7cb7d7d6d9-jrw55\" (UID: \"3004a837-7e68-4aa9-9c2b-306076b298ff\") " pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:17:43.953623 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:43.953463    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3004a837-7e68-4aa9-9c2b-306076b298ff-model-cache\") pod \"test-model-2259a7-kserve-7cb7d7d6d9-jrw55\" (UID: \"3004a837-7e68-4aa9-9c2b-306076b298ff\") " pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:17:43.953623 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:43.953492    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3004a837-7e68-4aa9-9c2b-306076b298ff-tls-certs\") pod \"test-model-2259a7-kserve-7cb7d7d6d9-jrw55\" (UID: \"3004a837-7e68-4aa9-9c2b-306076b298ff\") " pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:17:43.953623 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:43.953509    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3004a837-7e68-4aa9-9c2b-306076b298ff-dshm\") pod \"test-model-2259a7-kserve-7cb7d7d6d9-jrw55\" (UID: \"3004a837-7e68-4aa9-9c2b-306076b298ff\") " pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:17:43.953623 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:43.953530    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3004a837-7e68-4aa9-9c2b-306076b298ff-home\") pod \"test-model-2259a7-kserve-7cb7d7d6d9-jrw55\" (UID: \"3004a837-7e68-4aa9-9c2b-306076b298ff\") " pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:17:43.953623 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:43.953545    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6rnn\" (UniqueName: \"kubernetes.io/projected/3004a837-7e68-4aa9-9c2b-306076b298ff-kube-api-access-s6rnn\") pod \"test-model-2259a7-kserve-7cb7d7d6d9-jrw55\" (UID: \"3004a837-7e68-4aa9-9c2b-306076b298ff\") " pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:17:44.054098 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:44.054064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3004a837-7e68-4aa9-9c2b-306076b298ff-tmp-dir\") pod \"test-model-2259a7-kserve-7cb7d7d6d9-jrw55\" (UID: \"3004a837-7e68-4aa9-9c2b-306076b298ff\") " pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:17:44.054281 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:44.054111    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3004a837-7e68-4aa9-9c2b-306076b298ff-model-cache\") pod \"test-model-2259a7-kserve-7cb7d7d6d9-jrw55\" (UID: \"3004a837-7e68-4aa9-9c2b-306076b298ff\") " pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:17:44.054281 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:44.054142    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3004a837-7e68-4aa9-9c2b-306076b298ff-tls-certs\") pod \"test-model-2259a7-kserve-7cb7d7d6d9-jrw55\" (UID: \"3004a837-7e68-4aa9-9c2b-306076b298ff\") " pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:17:44.054281 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:44.054158    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3004a837-7e68-4aa9-9c2b-306076b298ff-dshm\") pod \"test-model-2259a7-kserve-7cb7d7d6d9-jrw55\" (UID: \"3004a837-7e68-4aa9-9c2b-306076b298ff\") " pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:17:44.054281 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:44.054178    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3004a837-7e68-4aa9-9c2b-306076b298ff-home\") pod \"test-model-2259a7-kserve-7cb7d7d6d9-jrw55\" (UID: \"3004a837-7e68-4aa9-9c2b-306076b298ff\") " pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:17:44.054281 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:44.054194    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6rnn\" (UniqueName: \"kubernetes.io/projected/3004a837-7e68-4aa9-9c2b-306076b298ff-kube-api-access-s6rnn\") pod \"test-model-2259a7-kserve-7cb7d7d6d9-jrw55\" (UID: \"3004a837-7e68-4aa9-9c2b-306076b298ff\") " pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:17:44.054568 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:44.054489    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3004a837-7e68-4aa9-9c2b-306076b298ff-tmp-dir\") pod \"test-model-2259a7-kserve-7cb7d7d6d9-jrw55\" (UID: \"3004a837-7e68-4aa9-9c2b-306076b298ff\") " pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:17:44.054568 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:44.054550    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3004a837-7e68-4aa9-9c2b-306076b298ff-model-cache\") pod \"test-model-2259a7-kserve-7cb7d7d6d9-jrw55\" (UID: \"3004a837-7e68-4aa9-9c2b-306076b298ff\") " pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:17:44.054648 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:44.054598    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3004a837-7e68-4aa9-9c2b-306076b298ff-home\") pod \"test-model-2259a7-kserve-7cb7d7d6d9-jrw55\" (UID: \"3004a837-7e68-4aa9-9c2b-306076b298ff\") " pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:17:44.056504 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:44.056484    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3004a837-7e68-4aa9-9c2b-306076b298ff-dshm\") pod \"test-model-2259a7-kserve-7cb7d7d6d9-jrw55\" (UID: \"3004a837-7e68-4aa9-9c2b-306076b298ff\") " pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:17:44.056628 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:44.056610    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3004a837-7e68-4aa9-9c2b-306076b298ff-tls-certs\") pod \"test-model-2259a7-kserve-7cb7d7d6d9-jrw55\" (UID: \"3004a837-7e68-4aa9-9c2b-306076b298ff\") " pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:17:44.072011 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:44.071959    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6rnn\" (UniqueName: \"kubernetes.io/projected/3004a837-7e68-4aa9-9c2b-306076b298ff-kube-api-access-s6rnn\") pod \"test-model-2259a7-kserve-7cb7d7d6d9-jrw55\" (UID: \"3004a837-7e68-4aa9-9c2b-306076b298ff\") " pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:17:44.135090 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:44.135047    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:17:44.272816 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:44.272668    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"]
Jul 09 19:17:44.275506 ip-10-0-137-236 kubenswrapper[2580]: W0709 19:17:44.275485    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3004a837_7e68_4aa9_9c2b_306076b298ff.slice/crio-10b3d33b73bad5ed3a3d2bf2938eee6ac9ace36a0a4e090933f0b7185ba844f2 WatchSource:0}: Error finding container 10b3d33b73bad5ed3a3d2bf2938eee6ac9ace36a0a4e090933f0b7185ba844f2: Status 404 returned error can't find the container with id 10b3d33b73bad5ed3a3d2bf2938eee6ac9ace36a0a4e090933f0b7185ba844f2
Jul 09 19:17:44.626891 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:44.626771    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55" event={"ID":"3004a837-7e68-4aa9-9c2b-306076b298ff","Type":"ContainerStarted","Data":"7f101572684c62d0b40f0522ae79cfb1c7b03495eaca11cdcaa3de899bfeae79"}
Jul 09 19:17:44.626891 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:44.626815    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55" event={"ID":"3004a837-7e68-4aa9-9c2b-306076b298ff","Type":"ContainerStarted","Data":"10b3d33b73bad5ed3a3d2bf2938eee6ac9ace36a0a4e090933f0b7185ba844f2"}
Jul 09 19:17:44.648007 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:44.647962    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55" podStartSLOduration=1.647946697 podStartE2EDuration="1.647946697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:17:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:17:44.645938117 +0000 UTC m=+1919.855527337" watchObservedRunningTime="2026-07-09 19:17:44.647946697 +0000 UTC m=+1919.857535960"
Jul 09 19:17:54.136045 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:54.136000    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:17:54.136490 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:54.136066    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:17:54.148991 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:54.148967    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:17:54.687606 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:17:54.687577    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:18:19.253048 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:19.253011    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"]
Jul 09 19:18:21.201594 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:21.201562    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk"]
Jul 09 19:18:21.202079 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:21.201814    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk" podUID="0db7f750-aff1-4df1-b000-ba2bbe1d279e" containerName="maas-api" containerID="cri-o://27598897b83893de0d1d4ca8a3611751f15dd3cbe581a7c5943d05202c78011e" gracePeriod=30
Jul 09 19:18:21.456313 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:21.456245    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk"
Jul 09 19:18:21.623010 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:21.622976    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0db7f750-aff1-4df1-b000-ba2bbe1d279e-openshift-service-ca\") pod \"0db7f750-aff1-4df1-b000-ba2bbe1d279e\" (UID: \"0db7f750-aff1-4df1-b000-ba2bbe1d279e\") "
Jul 09 19:18:21.623201 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:21.623066    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0db7f750-aff1-4df1-b000-ba2bbe1d279e-maas-api-tls\") pod \"0db7f750-aff1-4df1-b000-ba2bbe1d279e\" (UID: \"0db7f750-aff1-4df1-b000-ba2bbe1d279e\") "
Jul 09 19:18:21.623201 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:21.623181    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmdv2\" (UniqueName: \"kubernetes.io/projected/0db7f750-aff1-4df1-b000-ba2bbe1d279e-kube-api-access-cmdv2\") pod \"0db7f750-aff1-4df1-b000-ba2bbe1d279e\" (UID: \"0db7f750-aff1-4df1-b000-ba2bbe1d279e\") "
Jul 09 19:18:21.623354 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:21.623318    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0db7f750-aff1-4df1-b000-ba2bbe1d279e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0db7f750-aff1-4df1-b000-ba2bbe1d279e" (UID: "0db7f750-aff1-4df1-b000-ba2bbe1d279e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:18:21.623493 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:21.623464    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0db7f750-aff1-4df1-b000-ba2bbe1d279e-openshift-service-ca\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:18:21.625160 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:21.625130    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0db7f750-aff1-4df1-b000-ba2bbe1d279e-kube-api-access-cmdv2" (OuterVolumeSpecName: "kube-api-access-cmdv2") pod "0db7f750-aff1-4df1-b000-ba2bbe1d279e" (UID: "0db7f750-aff1-4df1-b000-ba2bbe1d279e"). InnerVolumeSpecName "kube-api-access-cmdv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:18:21.625248 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:21.625188    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0db7f750-aff1-4df1-b000-ba2bbe1d279e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0db7f750-aff1-4df1-b000-ba2bbe1d279e" (UID: "0db7f750-aff1-4df1-b000-ba2bbe1d279e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:18:21.724781 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:21.724742    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0db7f750-aff1-4df1-b000-ba2bbe1d279e-maas-api-tls\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:18:21.724781 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:21.724778    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmdv2\" (UniqueName: \"kubernetes.io/projected/0db7f750-aff1-4df1-b000-ba2bbe1d279e-kube-api-access-cmdv2\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:18:21.814102 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:21.814067    2580 generic.go:356] "Generic (PLEG): container finished" podID="0db7f750-aff1-4df1-b000-ba2bbe1d279e" containerID="27598897b83893de0d1d4ca8a3611751f15dd3cbe581a7c5943d05202c78011e" exitCode=0
Jul 09 19:18:21.814296 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:21.814110    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk"
Jul 09 19:18:21.814296 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:21.814130    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk" event={"ID":"0db7f750-aff1-4df1-b000-ba2bbe1d279e","Type":"ContainerDied","Data":"27598897b83893de0d1d4ca8a3611751f15dd3cbe581a7c5943d05202c78011e"}
Jul 09 19:18:21.814296 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:21.814182    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk" event={"ID":"0db7f750-aff1-4df1-b000-ba2bbe1d279e","Type":"ContainerDied","Data":"1c4b15e4b0e0e23f222a7d4d6a6ce27a014552783588a34d026a7bb9dc31c457"}
Jul 09 19:18:21.814296 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:21.814210    2580 scope.go:117] "RemoveContainer" containerID="27598897b83893de0d1d4ca8a3611751f15dd3cbe581a7c5943d05202c78011e"
Jul 09 19:18:21.823462 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:21.823445    2580 scope.go:117] "RemoveContainer" containerID="27598897b83893de0d1d4ca8a3611751f15dd3cbe581a7c5943d05202c78011e"
Jul 09 19:18:21.823763 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:18:21.823744    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27598897b83893de0d1d4ca8a3611751f15dd3cbe581a7c5943d05202c78011e\": container with ID starting with 27598897b83893de0d1d4ca8a3611751f15dd3cbe581a7c5943d05202c78011e not found: ID does not exist" containerID="27598897b83893de0d1d4ca8a3611751f15dd3cbe581a7c5943d05202c78011e"
Jul 09 19:18:21.823804 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:21.823771    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27598897b83893de0d1d4ca8a3611751f15dd3cbe581a7c5943d05202c78011e"} err="failed to get container status \"27598897b83893de0d1d4ca8a3611751f15dd3cbe581a7c5943d05202c78011e\": rpc error: code = NotFound desc = could not find container \"27598897b83893de0d1d4ca8a3611751f15dd3cbe581a7c5943d05202c78011e\": container with ID starting with 27598897b83893de0d1d4ca8a3611751f15dd3cbe581a7c5943d05202c78011e not found: ID does not exist"
Jul 09 19:18:21.839015 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:21.838979    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk"]
Jul 09 19:18:21.844011 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:21.843980    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2259a7-6dbbc8b9b9-9n5pk"]
Jul 09 19:18:23.253373 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:23.253339    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0db7f750-aff1-4df1-b000-ba2bbe1d279e" path="/var/lib/kubelet/pods/0db7f750-aff1-4df1-b000-ba2bbe1d279e/volumes"
Jul 09 19:18:34.273984 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.273934    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55" podUID="3004a837-7e68-4aa9-9c2b-306076b298ff" containerName="main" containerID="cri-o://7f101572684c62d0b40f0522ae79cfb1c7b03495eaca11cdcaa3de899bfeae79" gracePeriod=45
Jul 09 19:18:34.529969 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.529902    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:18:34.638222 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.638185    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6rnn\" (UniqueName: \"kubernetes.io/projected/3004a837-7e68-4aa9-9c2b-306076b298ff-kube-api-access-s6rnn\") pod \"3004a837-7e68-4aa9-9c2b-306076b298ff\" (UID: \"3004a837-7e68-4aa9-9c2b-306076b298ff\") "
Jul 09 19:18:34.638222 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.638226    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3004a837-7e68-4aa9-9c2b-306076b298ff-tmp-dir\") pod \"3004a837-7e68-4aa9-9c2b-306076b298ff\" (UID: \"3004a837-7e68-4aa9-9c2b-306076b298ff\") "
Jul 09 19:18:34.638474 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.638260    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3004a837-7e68-4aa9-9c2b-306076b298ff-dshm\") pod \"3004a837-7e68-4aa9-9c2b-306076b298ff\" (UID: \"3004a837-7e68-4aa9-9c2b-306076b298ff\") "
Jul 09 19:18:34.638474 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.638287    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3004a837-7e68-4aa9-9c2b-306076b298ff-model-cache\") pod \"3004a837-7e68-4aa9-9c2b-306076b298ff\" (UID: \"3004a837-7e68-4aa9-9c2b-306076b298ff\") "
Jul 09 19:18:34.638474 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.638324    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3004a837-7e68-4aa9-9c2b-306076b298ff-home\") pod \"3004a837-7e68-4aa9-9c2b-306076b298ff\" (UID: \"3004a837-7e68-4aa9-9c2b-306076b298ff\") "
Jul 09 19:18:34.638474 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.638350    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3004a837-7e68-4aa9-9c2b-306076b298ff-tls-certs\") pod \"3004a837-7e68-4aa9-9c2b-306076b298ff\" (UID: \"3004a837-7e68-4aa9-9c2b-306076b298ff\") "
Jul 09 19:18:34.638681 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.638549    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3004a837-7e68-4aa9-9c2b-306076b298ff-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3004a837-7e68-4aa9-9c2b-306076b298ff" (UID: "3004a837-7e68-4aa9-9c2b-306076b298ff"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:18:34.638681 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.638577    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3004a837-7e68-4aa9-9c2b-306076b298ff-model-cache" (OuterVolumeSpecName: "model-cache") pod "3004a837-7e68-4aa9-9c2b-306076b298ff" (UID: "3004a837-7e68-4aa9-9c2b-306076b298ff"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:18:34.638681 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.638622    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3004a837-7e68-4aa9-9c2b-306076b298ff-home" (OuterVolumeSpecName: "home") pod "3004a837-7e68-4aa9-9c2b-306076b298ff" (UID: "3004a837-7e68-4aa9-9c2b-306076b298ff"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:18:34.640612 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.640581    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3004a837-7e68-4aa9-9c2b-306076b298ff-dshm" (OuterVolumeSpecName: "dshm") pod "3004a837-7e68-4aa9-9c2b-306076b298ff" (UID: "3004a837-7e68-4aa9-9c2b-306076b298ff"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:18:34.640727 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.640651    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3004a837-7e68-4aa9-9c2b-306076b298ff-kube-api-access-s6rnn" (OuterVolumeSpecName: "kube-api-access-s6rnn") pod "3004a837-7e68-4aa9-9c2b-306076b298ff" (UID: "3004a837-7e68-4aa9-9c2b-306076b298ff"). InnerVolumeSpecName "kube-api-access-s6rnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:18:34.640727 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.640652    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3004a837-7e68-4aa9-9c2b-306076b298ff-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3004a837-7e68-4aa9-9c2b-306076b298ff" (UID: "3004a837-7e68-4aa9-9c2b-306076b298ff"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:18:34.740084 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.740043    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6rnn\" (UniqueName: \"kubernetes.io/projected/3004a837-7e68-4aa9-9c2b-306076b298ff-kube-api-access-s6rnn\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:18:34.740084 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.740075    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3004a837-7e68-4aa9-9c2b-306076b298ff-tmp-dir\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:18:34.740084 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.740088    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3004a837-7e68-4aa9-9c2b-306076b298ff-dshm\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:18:34.740337 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.740099    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3004a837-7e68-4aa9-9c2b-306076b298ff-model-cache\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:18:34.740337 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.740110    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3004a837-7e68-4aa9-9c2b-306076b298ff-home\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:18:34.740337 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.740121    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3004a837-7e68-4aa9-9c2b-306076b298ff-tls-certs\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:18:34.880063 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.879966    2580 generic.go:356] "Generic (PLEG): container finished" podID="3004a837-7e68-4aa9-9c2b-306076b298ff" containerID="7f101572684c62d0b40f0522ae79cfb1c7b03495eaca11cdcaa3de899bfeae79" exitCode=0
Jul 09 19:18:34.880063 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.880011    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"
Jul 09 19:18:34.880063 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.880032    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55" event={"ID":"3004a837-7e68-4aa9-9c2b-306076b298ff","Type":"ContainerDied","Data":"7f101572684c62d0b40f0522ae79cfb1c7b03495eaca11cdcaa3de899bfeae79"}
Jul 09 19:18:34.880353 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.880072    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55" event={"ID":"3004a837-7e68-4aa9-9c2b-306076b298ff","Type":"ContainerDied","Data":"10b3d33b73bad5ed3a3d2bf2938eee6ac9ace36a0a4e090933f0b7185ba844f2"}
Jul 09 19:18:34.880353 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.880090    2580 scope.go:117] "RemoveContainer" containerID="7f101572684c62d0b40f0522ae79cfb1c7b03495eaca11cdcaa3de899bfeae79"
Jul 09 19:18:34.890308 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.890246    2580 scope.go:117] "RemoveContainer" containerID="7f101572684c62d0b40f0522ae79cfb1c7b03495eaca11cdcaa3de899bfeae79"
Jul 09 19:18:34.891585 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:18:34.891559    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f101572684c62d0b40f0522ae79cfb1c7b03495eaca11cdcaa3de899bfeae79\": container with ID starting with 7f101572684c62d0b40f0522ae79cfb1c7b03495eaca11cdcaa3de899bfeae79 not found: ID does not exist" containerID="7f101572684c62d0b40f0522ae79cfb1c7b03495eaca11cdcaa3de899bfeae79"
Jul 09 19:18:34.891698 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.891593    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f101572684c62d0b40f0522ae79cfb1c7b03495eaca11cdcaa3de899bfeae79"} err="failed to get container status \"7f101572684c62d0b40f0522ae79cfb1c7b03495eaca11cdcaa3de899bfeae79\": rpc error: code = NotFound desc = could not find container \"7f101572684c62d0b40f0522ae79cfb1c7b03495eaca11cdcaa3de899bfeae79\": container with ID starting with 7f101572684c62d0b40f0522ae79cfb1c7b03495eaca11cdcaa3de899bfeae79 not found: ID does not exist"
Jul 09 19:18:34.903795 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.903769    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"]
Jul 09 19:18:34.909322 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:34.909298    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-2259a7/test-model-2259a7-kserve-7cb7d7d6d9-jrw55"]
Jul 09 19:18:35.253387 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:18:35.253345    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3004a837-7e68-4aa9-9c2b-306076b298ff" path="/var/lib/kubelet/pods/3004a837-7e68-4aa9-9c2b-306076b298ff/volumes"
Jul 09 19:19:05.482082 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:05.482042    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k"]
Jul 09 19:19:05.482614 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:05.482265    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k" podUID="4b1c3871-95a7-420b-bb3d-83d1d01576a7" containerName="maas-api" containerID="cri-o://ffcacea8161a0dedfcf88cf334cdd8e0b4c7608340c388c35d5e6b0642eb08c9" gracePeriod=30
Jul 09 19:19:05.734410 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:05.734345    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k"
Jul 09 19:19:05.839664 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:05.839631    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b1c3871-95a7-420b-bb3d-83d1d01576a7-maas-api-tls\") pod \"4b1c3871-95a7-420b-bb3d-83d1d01576a7\" (UID: \"4b1c3871-95a7-420b-bb3d-83d1d01576a7\") "
Jul 09 19:19:05.839881 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:05.839672    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b1c3871-95a7-420b-bb3d-83d1d01576a7-openshift-service-ca\") pod \"4b1c3871-95a7-420b-bb3d-83d1d01576a7\" (UID: \"4b1c3871-95a7-420b-bb3d-83d1d01576a7\") "
Jul 09 19:19:05.839881 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:05.839727    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qv5w4\" (UniqueName: \"kubernetes.io/projected/4b1c3871-95a7-420b-bb3d-83d1d01576a7-kube-api-access-qv5w4\") pod \"4b1c3871-95a7-420b-bb3d-83d1d01576a7\" (UID: \"4b1c3871-95a7-420b-bb3d-83d1d01576a7\") "
Jul 09 19:19:05.840131 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:05.840103    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b1c3871-95a7-420b-bb3d-83d1d01576a7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4b1c3871-95a7-420b-bb3d-83d1d01576a7" (UID: "4b1c3871-95a7-420b-bb3d-83d1d01576a7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:19:05.841822 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:05.841795    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b1c3871-95a7-420b-bb3d-83d1d01576a7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4b1c3871-95a7-420b-bb3d-83d1d01576a7" (UID: "4b1c3871-95a7-420b-bb3d-83d1d01576a7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:19:05.841952 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:05.841857    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b1c3871-95a7-420b-bb3d-83d1d01576a7-kube-api-access-qv5w4" (OuterVolumeSpecName: "kube-api-access-qv5w4") pod "4b1c3871-95a7-420b-bb3d-83d1d01576a7" (UID: "4b1c3871-95a7-420b-bb3d-83d1d01576a7"). InnerVolumeSpecName "kube-api-access-qv5w4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:19:05.941056 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:05.941017    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b1c3871-95a7-420b-bb3d-83d1d01576a7-maas-api-tls\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:19:05.941056 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:05.941048    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b1c3871-95a7-420b-bb3d-83d1d01576a7-openshift-service-ca\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:19:05.941056 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:05.941059    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qv5w4\" (UniqueName: \"kubernetes.io/projected/4b1c3871-95a7-420b-bb3d-83d1d01576a7-kube-api-access-qv5w4\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:19:06.034509 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:06.034408    2580 generic.go:356] "Generic (PLEG): container finished" podID="4b1c3871-95a7-420b-bb3d-83d1d01576a7" containerID="ffcacea8161a0dedfcf88cf334cdd8e0b4c7608340c388c35d5e6b0642eb08c9" exitCode=0
Jul 09 19:19:06.034509 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:06.034453    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k"
Jul 09 19:19:06.034509 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:06.034498    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k" event={"ID":"4b1c3871-95a7-420b-bb3d-83d1d01576a7","Type":"ContainerDied","Data":"ffcacea8161a0dedfcf88cf334cdd8e0b4c7608340c388c35d5e6b0642eb08c9"}
Jul 09 19:19:06.034758 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:06.034555    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k" event={"ID":"4b1c3871-95a7-420b-bb3d-83d1d01576a7","Type":"ContainerDied","Data":"dc3b4b37cc29d0cdb430fedf0bc7503ea5ae72734d61bc8224c709bbb5a187c3"}
Jul 09 19:19:06.034758 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:06.034585    2580 scope.go:117] "RemoveContainer" containerID="ffcacea8161a0dedfcf88cf334cdd8e0b4c7608340c388c35d5e6b0642eb08c9"
Jul 09 19:19:06.043945 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:06.043924    2580 scope.go:117] "RemoveContainer" containerID="ffcacea8161a0dedfcf88cf334cdd8e0b4c7608340c388c35d5e6b0642eb08c9"
Jul 09 19:19:06.044202 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:19:06.044183    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffcacea8161a0dedfcf88cf334cdd8e0b4c7608340c388c35d5e6b0642eb08c9\": container with ID starting with ffcacea8161a0dedfcf88cf334cdd8e0b4c7608340c388c35d5e6b0642eb08c9 not found: ID does not exist" containerID="ffcacea8161a0dedfcf88cf334cdd8e0b4c7608340c388c35d5e6b0642eb08c9"
Jul 09 19:19:06.044299 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:06.044219    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffcacea8161a0dedfcf88cf334cdd8e0b4c7608340c388c35d5e6b0642eb08c9"} err="failed to get container status \"ffcacea8161a0dedfcf88cf334cdd8e0b4c7608340c388c35d5e6b0642eb08c9\": rpc error: code = NotFound desc = could not find container \"ffcacea8161a0dedfcf88cf334cdd8e0b4c7608340c388c35d5e6b0642eb08c9\": container with ID starting with ffcacea8161a0dedfcf88cf334cdd8e0b4c7608340c388c35d5e6b0642eb08c9 not found: ID does not exist"
Jul 09 19:19:06.063905 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:06.063872    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k"]
Jul 09 19:19:06.067381 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:06.067357    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fcd3da-568b56955c-t868k"]
Jul 09 19:19:07.253514 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:07.253478    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b1c3871-95a7-420b-bb3d-83d1d01576a7" path="/var/lib/kubelet/pods/4b1c3871-95a7-420b-bb3d-83d1d01576a7/volumes"
Jul 09 19:19:15.432820 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:15.432783    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9"]
Jul 09 19:19:15.433427 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:15.433408    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3004a837-7e68-4aa9-9c2b-306076b298ff" containerName="main"
Jul 09 19:19:15.433486 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:15.433433    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3004a837-7e68-4aa9-9c2b-306076b298ff" containerName="main"
Jul 09 19:19:15.433486 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:15.433450    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b1c3871-95a7-420b-bb3d-83d1d01576a7" containerName="maas-api"
Jul 09 19:19:15.433486 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:15.433461    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b1c3871-95a7-420b-bb3d-83d1d01576a7" containerName="maas-api"
Jul 09 19:19:15.433486 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:15.433475    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0db7f750-aff1-4df1-b000-ba2bbe1d279e" containerName="maas-api"
Jul 09 19:19:15.433486 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:15.433485    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0db7f750-aff1-4df1-b000-ba2bbe1d279e" containerName="maas-api"
Jul 09 19:19:15.433642 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:15.433617    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0db7f750-aff1-4df1-b000-ba2bbe1d279e" containerName="maas-api"
Jul 09 19:19:15.433642 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:15.433631    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3004a837-7e68-4aa9-9c2b-306076b298ff" containerName="main"
Jul 09 19:19:15.433712 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:15.433642    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b1c3871-95a7-420b-bb3d-83d1d01576a7" containerName="maas-api"
Jul 09 19:19:15.438598 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:15.438571    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9"
Jul 09 19:19:15.441248 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:15.441228    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-2b3eb7-serving-cert\""
Jul 09 19:19:15.441548 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:15.441531    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rxfcr\""
Jul 09 19:19:15.447452 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:15.447427    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9"]
Jul 09 19:19:15.525081 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:15.525041    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jcqf\" (UniqueName: \"kubernetes.io/projected/c61ead65-4c2d-4647-8195-eda693dc5e2f-kube-api-access-4jcqf\") pod \"maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9\" (UID: \"c61ead65-4c2d-4647-8195-eda693dc5e2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9"
Jul 09 19:19:15.525255 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:15.525164    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c61ead65-4c2d-4647-8195-eda693dc5e2f-openshift-service-ca\") pod \"maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9\" (UID: \"c61ead65-4c2d-4647-8195-eda693dc5e2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9"
Jul 09 19:19:15.525255 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:15.525208    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c61ead65-4c2d-4647-8195-eda693dc5e2f-maas-api-tls\") pod \"maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9\" (UID: \"c61ead65-4c2d-4647-8195-eda693dc5e2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9"
Jul 09 19:19:15.625665 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:15.625626    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jcqf\" (UniqueName: \"kubernetes.io/projected/c61ead65-4c2d-4647-8195-eda693dc5e2f-kube-api-access-4jcqf\") pod \"maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9\" (UID: \"c61ead65-4c2d-4647-8195-eda693dc5e2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9"
Jul 09 19:19:15.625887 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:15.625709    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c61ead65-4c2d-4647-8195-eda693dc5e2f-openshift-service-ca\") pod \"maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9\" (UID: \"c61ead65-4c2d-4647-8195-eda693dc5e2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9"
Jul 09 19:19:15.625887 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:15.625739    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c61ead65-4c2d-4647-8195-eda693dc5e2f-maas-api-tls\") pod \"maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9\" (UID: \"c61ead65-4c2d-4647-8195-eda693dc5e2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9"
Jul 09 19:19:15.625980 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:19:15.625885    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-serving-cert: secret "maas-api-e2e-api-a-2b3eb7-serving-cert" not found
Jul 09 19:19:15.625980 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:19:15.625949    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c61ead65-4c2d-4647-8195-eda693dc5e2f-maas-api-tls podName:c61ead65-4c2d-4647-8195-eda693dc5e2f nodeName:}" failed. No retries permitted until 2026-07-09 19:19:16.125934262 +0000 UTC m=+2011.335523458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c61ead65-4c2d-4647-8195-eda693dc5e2f-maas-api-tls") pod "maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9" (UID: "c61ead65-4c2d-4647-8195-eda693dc5e2f") : secret "maas-api-e2e-api-a-2b3eb7-serving-cert" not found
Jul 09 19:19:15.626399 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:15.626379    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c61ead65-4c2d-4647-8195-eda693dc5e2f-openshift-service-ca\") pod \"maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9\" (UID: \"c61ead65-4c2d-4647-8195-eda693dc5e2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9"
Jul 09 19:19:15.634704 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:15.634684    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jcqf\" (UniqueName: \"kubernetes.io/projected/c61ead65-4c2d-4647-8195-eda693dc5e2f-kube-api-access-4jcqf\") pod \"maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9\" (UID: \"c61ead65-4c2d-4647-8195-eda693dc5e2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9"
Jul 09 19:19:16.131360 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:16.131321    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c61ead65-4c2d-4647-8195-eda693dc5e2f-maas-api-tls\") pod \"maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9\" (UID: \"c61ead65-4c2d-4647-8195-eda693dc5e2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9"
Jul 09 19:19:16.133694 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:16.133675    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c61ead65-4c2d-4647-8195-eda693dc5e2f-maas-api-tls\") pod \"maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9\" (UID: \"c61ead65-4c2d-4647-8195-eda693dc5e2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9"
Jul 09 19:19:16.352628 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:16.352589    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9"
Jul 09 19:19:16.489671 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:16.489645    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9"]
Jul 09 19:19:16.491856 ip-10-0-137-236 kubenswrapper[2580]: W0709 19:19:16.491812    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc61ead65_4c2d_4647_8195_eda693dc5e2f.slice/crio-29556fe199a6f13fc9f34afb9b17aee0ea4ec6f85f7ccef28fad8ff769dd4a6b WatchSource:0}: Error finding container 29556fe199a6f13fc9f34afb9b17aee0ea4ec6f85f7ccef28fad8ff769dd4a6b: Status 404 returned error can't find the container with id 29556fe199a6f13fc9f34afb9b17aee0ea4ec6f85f7ccef28fad8ff769dd4a6b
Jul 09 19:19:17.097630 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:17.097532    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9" event={"ID":"c61ead65-4c2d-4647-8195-eda693dc5e2f","Type":"ContainerStarted","Data":"b0ac90427240f2b34091480a129961b8e7898166f8f971ec40c53b1747472386"}
Jul 09 19:19:17.097630 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:17.097595    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9" event={"ID":"c61ead65-4c2d-4647-8195-eda693dc5e2f","Type":"ContainerStarted","Data":"29556fe199a6f13fc9f34afb9b17aee0ea4ec6f85f7ccef28fad8ff769dd4a6b"}
Jul 09 19:19:17.097630 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:17.097622    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9"
Jul 09 19:19:17.118537 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:17.118479    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9" podStartSLOduration=1.7702112620000001 podStartE2EDuration="2.118458835s" totalImagesPullingTime="348.247573ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:19:17.117594531 +0000 UTC m=+2012.327183748" watchObservedRunningTime="2026-07-09 19:19:17.118458835 +0000 UTC m=+2012.328048053"
Jul 09 19:19:23.108120 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:23.108093    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9"
Jul 09 19:19:23.490437 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:23.490407    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z"]
Jul 09 19:19:23.494111 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:23.494090    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z"
Jul 09 19:19:23.497014 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:23.496992    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-dc9769-serving-cert\""
Jul 09 19:19:23.506899 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:23.506875    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z"]
Jul 09 19:19:23.602898 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:23.602863    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbdjn\" (UniqueName: \"kubernetes.io/projected/2c8047d2-034c-4ed1-8718-a95e9cea23a6-kube-api-access-lbdjn\") pod \"maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z\" (UID: \"2c8047d2-034c-4ed1-8718-a95e9cea23a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z"
Jul 09 19:19:23.603081 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:23.602969    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c8047d2-034c-4ed1-8718-a95e9cea23a6-maas-api-tls\") pod \"maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z\" (UID: \"2c8047d2-034c-4ed1-8718-a95e9cea23a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z"
Jul 09 19:19:23.603081 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:23.603029    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c8047d2-034c-4ed1-8718-a95e9cea23a6-openshift-service-ca\") pod \"maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z\" (UID: \"2c8047d2-034c-4ed1-8718-a95e9cea23a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z"
Jul 09 19:19:23.703671 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:23.703634    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c8047d2-034c-4ed1-8718-a95e9cea23a6-openshift-service-ca\") pod \"maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z\" (UID: \"2c8047d2-034c-4ed1-8718-a95e9cea23a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z"
Jul 09 19:19:23.703871 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:23.703698    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbdjn\" (UniqueName: \"kubernetes.io/projected/2c8047d2-034c-4ed1-8718-a95e9cea23a6-kube-api-access-lbdjn\") pod \"maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z\" (UID: \"2c8047d2-034c-4ed1-8718-a95e9cea23a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z"
Jul 09 19:19:23.703871 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:23.703752    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c8047d2-034c-4ed1-8718-a95e9cea23a6-maas-api-tls\") pod \"maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z\" (UID: \"2c8047d2-034c-4ed1-8718-a95e9cea23a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z"
Jul 09 19:19:23.703871 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:19:23.703865    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-serving-cert: secret "maas-api-e2e-api-b-dc9769-serving-cert" not found
Jul 09 19:19:23.703981 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:19:23.703913    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c8047d2-034c-4ed1-8718-a95e9cea23a6-maas-api-tls podName:2c8047d2-034c-4ed1-8718-a95e9cea23a6 nodeName:}" failed. No retries permitted until 2026-07-09 19:19:24.203898719 +0000 UTC m=+2019.413487915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2c8047d2-034c-4ed1-8718-a95e9cea23a6-maas-api-tls") pod "maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z" (UID: "2c8047d2-034c-4ed1-8718-a95e9cea23a6") : secret "maas-api-e2e-api-b-dc9769-serving-cert" not found
Jul 09 19:19:23.704321 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:23.704301    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c8047d2-034c-4ed1-8718-a95e9cea23a6-openshift-service-ca\") pod \"maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z\" (UID: \"2c8047d2-034c-4ed1-8718-a95e9cea23a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z"
Jul 09 19:19:23.714974 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:23.714953    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbdjn\" (UniqueName: \"kubernetes.io/projected/2c8047d2-034c-4ed1-8718-a95e9cea23a6-kube-api-access-lbdjn\") pod \"maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z\" (UID: \"2c8047d2-034c-4ed1-8718-a95e9cea23a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z"
Jul 09 19:19:24.210247 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:24.210217    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c8047d2-034c-4ed1-8718-a95e9cea23a6-maas-api-tls\") pod \"maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z\" (UID: \"2c8047d2-034c-4ed1-8718-a95e9cea23a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z"
Jul 09 19:19:24.210658 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:19:24.210363    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-serving-cert: secret "maas-api-e2e-api-b-dc9769-serving-cert" not found
Jul 09 19:19:24.210658 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:19:24.210428    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c8047d2-034c-4ed1-8718-a95e9cea23a6-maas-api-tls podName:2c8047d2-034c-4ed1-8718-a95e9cea23a6 nodeName:}" failed. No retries permitted until 2026-07-09 19:19:25.210412293 +0000 UTC m=+2020.420001491 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2c8047d2-034c-4ed1-8718-a95e9cea23a6-maas-api-tls") pod "maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z" (UID: "2c8047d2-034c-4ed1-8718-a95e9cea23a6") : secret "maas-api-e2e-api-b-dc9769-serving-cert" not found
Jul 09 19:19:25.220907 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:25.220847    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c8047d2-034c-4ed1-8718-a95e9cea23a6-maas-api-tls\") pod \"maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z\" (UID: \"2c8047d2-034c-4ed1-8718-a95e9cea23a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z"
Jul 09 19:19:25.223342 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:25.223316    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c8047d2-034c-4ed1-8718-a95e9cea23a6-maas-api-tls\") pod \"maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z\" (UID: \"2c8047d2-034c-4ed1-8718-a95e9cea23a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z"
Jul 09 19:19:25.308409 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:25.308380    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z"
Jul 09 19:19:25.450408 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:25.450383    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z"]
Jul 09 19:19:25.452467 ip-10-0-137-236 kubenswrapper[2580]: W0709 19:19:25.452442    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c8047d2_034c_4ed1_8718_a95e9cea23a6.slice/crio-fe093d7ed7ec2c2782dbdb33c1885913d278e479c366807598d28acb2d246f91 WatchSource:0}: Error finding container fe093d7ed7ec2c2782dbdb33c1885913d278e479c366807598d28acb2d246f91: Status 404 returned error can't find the container with id fe093d7ed7ec2c2782dbdb33c1885913d278e479c366807598d28acb2d246f91
Jul 09 19:19:26.145246 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:26.145215    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z" event={"ID":"2c8047d2-034c-4ed1-8718-a95e9cea23a6","Type":"ContainerStarted","Data":"34355d872e74f6e401b4c0b742a7b4ee289bee10cf537c84a98658d44ba1ee21"}
Jul 09 19:19:26.145410 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:26.145270    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z" event={"ID":"2c8047d2-034c-4ed1-8718-a95e9cea23a6","Type":"ContainerStarted","Data":"fe093d7ed7ec2c2782dbdb33c1885913d278e479c366807598d28acb2d246f91"}
Jul 09 19:19:26.145410 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:26.145320    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z"
Jul 09 19:19:26.163492 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:26.163439    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z" podStartSLOduration=2.640085242 podStartE2EDuration="3.163421272s" totalImagesPullingTime="523.33603ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:19:26.162811243 +0000 UTC m=+2021.372400464" watchObservedRunningTime="2026-07-09 19:19:26.163421272 +0000 UTC m=+2021.373010492"
Jul 09 19:19:32.157433 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:32.157400    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z"
Jul 09 19:19:36.854778 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:36.854749    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9"]
Jul 09 19:19:36.855305 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:36.854967    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9" podUID="c61ead65-4c2d-4647-8195-eda693dc5e2f" containerName="maas-api" containerID="cri-o://b0ac90427240f2b34091480a129961b8e7898166f8f971ec40c53b1747472386" gracePeriod=30
Jul 09 19:19:37.114712 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:37.114643    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9"
Jul 09 19:19:37.200998 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:37.200959    2580 generic.go:356] "Generic (PLEG): container finished" podID="c61ead65-4c2d-4647-8195-eda693dc5e2f" containerID="b0ac90427240f2b34091480a129961b8e7898166f8f971ec40c53b1747472386" exitCode=0
Jul 09 19:19:37.201172 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:37.201011    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9"
Jul 09 19:19:37.201172 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:37.201042    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9" event={"ID":"c61ead65-4c2d-4647-8195-eda693dc5e2f","Type":"ContainerDied","Data":"b0ac90427240f2b34091480a129961b8e7898166f8f971ec40c53b1747472386"}
Jul 09 19:19:37.201172 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:37.201097    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9" event={"ID":"c61ead65-4c2d-4647-8195-eda693dc5e2f","Type":"ContainerDied","Data":"29556fe199a6f13fc9f34afb9b17aee0ea4ec6f85f7ccef28fad8ff769dd4a6b"}
Jul 09 19:19:37.201172 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:37.201132    2580 scope.go:117] "RemoveContainer" containerID="b0ac90427240f2b34091480a129961b8e7898166f8f971ec40c53b1747472386"
Jul 09 19:19:37.209893 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:37.209875    2580 scope.go:117] "RemoveContainer" containerID="b0ac90427240f2b34091480a129961b8e7898166f8f971ec40c53b1747472386"
Jul 09 19:19:37.210169 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:19:37.210153    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0ac90427240f2b34091480a129961b8e7898166f8f971ec40c53b1747472386\": container with ID starting with b0ac90427240f2b34091480a129961b8e7898166f8f971ec40c53b1747472386 not found: ID does not exist" containerID="b0ac90427240f2b34091480a129961b8e7898166f8f971ec40c53b1747472386"
Jul 09 19:19:37.210234 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:37.210197    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0ac90427240f2b34091480a129961b8e7898166f8f971ec40c53b1747472386"} err="failed to get container status \"b0ac90427240f2b34091480a129961b8e7898166f8f971ec40c53b1747472386\": rpc error: code = NotFound desc = could not find container \"b0ac90427240f2b34091480a129961b8e7898166f8f971ec40c53b1747472386\": container with ID starting with b0ac90427240f2b34091480a129961b8e7898166f8f971ec40c53b1747472386 not found: ID does not exist"
Jul 09 19:19:37.245149 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:37.245112    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c61ead65-4c2d-4647-8195-eda693dc5e2f-maas-api-tls\") pod \"c61ead65-4c2d-4647-8195-eda693dc5e2f\" (UID: \"c61ead65-4c2d-4647-8195-eda693dc5e2f\") "
Jul 09 19:19:37.245295 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:37.245177    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jcqf\" (UniqueName: \"kubernetes.io/projected/c61ead65-4c2d-4647-8195-eda693dc5e2f-kube-api-access-4jcqf\") pod \"c61ead65-4c2d-4647-8195-eda693dc5e2f\" (UID: \"c61ead65-4c2d-4647-8195-eda693dc5e2f\") "
Jul 09 19:19:37.245334 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:37.245303    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c61ead65-4c2d-4647-8195-eda693dc5e2f-openshift-service-ca\") pod \"c61ead65-4c2d-4647-8195-eda693dc5e2f\" (UID: \"c61ead65-4c2d-4647-8195-eda693dc5e2f\") "
Jul 09 19:19:37.245643 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:37.245610    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c61ead65-4c2d-4647-8195-eda693dc5e2f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c61ead65-4c2d-4647-8195-eda693dc5e2f" (UID: "c61ead65-4c2d-4647-8195-eda693dc5e2f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:19:37.247297 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:37.247272    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c61ead65-4c2d-4647-8195-eda693dc5e2f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c61ead65-4c2d-4647-8195-eda693dc5e2f" (UID: "c61ead65-4c2d-4647-8195-eda693dc5e2f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:19:37.247384 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:37.247364    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c61ead65-4c2d-4647-8195-eda693dc5e2f-kube-api-access-4jcqf" (OuterVolumeSpecName: "kube-api-access-4jcqf") pod "c61ead65-4c2d-4647-8195-eda693dc5e2f" (UID: "c61ead65-4c2d-4647-8195-eda693dc5e2f"). InnerVolumeSpecName "kube-api-access-4jcqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:19:37.346661 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:37.346624    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c61ead65-4c2d-4647-8195-eda693dc5e2f-maas-api-tls\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:19:37.346661 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:37.346657    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jcqf\" (UniqueName: \"kubernetes.io/projected/c61ead65-4c2d-4647-8195-eda693dc5e2f-kube-api-access-4jcqf\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:19:37.346901 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:37.346680    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c61ead65-4c2d-4647-8195-eda693dc5e2f-openshift-service-ca\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:19:37.527240 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:37.527197    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9"]
Jul 09 19:19:37.528505 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:37.528479    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2b3eb7-59c79dc59c-q4xk9"]
Jul 09 19:19:39.253086 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:39.253045    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c61ead65-4c2d-4647-8195-eda693dc5e2f" path="/var/lib/kubelet/pods/c61ead65-4c2d-4647-8195-eda693dc5e2f/volumes"
Jul 09 19:19:44.428762 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:44.428725    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z"]
Jul 09 19:19:44.429566 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:44.429532    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z" podUID="2c8047d2-034c-4ed1-8718-a95e9cea23a6" containerName="maas-api" containerID="cri-o://34355d872e74f6e401b4c0b742a7b4ee289bee10cf537c84a98658d44ba1ee21" gracePeriod=30
Jul 09 19:19:44.683083 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:44.683025    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z"
Jul 09 19:19:44.820803 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:44.820772    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbdjn\" (UniqueName: \"kubernetes.io/projected/2c8047d2-034c-4ed1-8718-a95e9cea23a6-kube-api-access-lbdjn\") pod \"2c8047d2-034c-4ed1-8718-a95e9cea23a6\" (UID: \"2c8047d2-034c-4ed1-8718-a95e9cea23a6\") "
Jul 09 19:19:44.820991 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:44.820814    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c8047d2-034c-4ed1-8718-a95e9cea23a6-maas-api-tls\") pod \"2c8047d2-034c-4ed1-8718-a95e9cea23a6\" (UID: \"2c8047d2-034c-4ed1-8718-a95e9cea23a6\") "
Jul 09 19:19:44.820991 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:44.820925    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c8047d2-034c-4ed1-8718-a95e9cea23a6-openshift-service-ca\") pod \"2c8047d2-034c-4ed1-8718-a95e9cea23a6\" (UID: \"2c8047d2-034c-4ed1-8718-a95e9cea23a6\") "
Jul 09 19:19:44.821361 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:44.821333    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c8047d2-034c-4ed1-8718-a95e9cea23a6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2c8047d2-034c-4ed1-8718-a95e9cea23a6" (UID: "2c8047d2-034c-4ed1-8718-a95e9cea23a6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:19:44.823015 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:44.822989    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c8047d2-034c-4ed1-8718-a95e9cea23a6-kube-api-access-lbdjn" (OuterVolumeSpecName: "kube-api-access-lbdjn") pod "2c8047d2-034c-4ed1-8718-a95e9cea23a6" (UID: "2c8047d2-034c-4ed1-8718-a95e9cea23a6"). InnerVolumeSpecName "kube-api-access-lbdjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:19:44.823125 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:44.823096    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c8047d2-034c-4ed1-8718-a95e9cea23a6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2c8047d2-034c-4ed1-8718-a95e9cea23a6" (UID: "2c8047d2-034c-4ed1-8718-a95e9cea23a6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:19:44.922233 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:44.922194    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbdjn\" (UniqueName: \"kubernetes.io/projected/2c8047d2-034c-4ed1-8718-a95e9cea23a6-kube-api-access-lbdjn\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:19:44.922233 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:44.922225    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c8047d2-034c-4ed1-8718-a95e9cea23a6-maas-api-tls\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:19:44.922233 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:44.922238    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c8047d2-034c-4ed1-8718-a95e9cea23a6-openshift-service-ca\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:19:45.242620 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:45.242582    2580 generic.go:356] "Generic (PLEG): container finished" podID="2c8047d2-034c-4ed1-8718-a95e9cea23a6" containerID="34355d872e74f6e401b4c0b742a7b4ee289bee10cf537c84a98658d44ba1ee21" exitCode=0
Jul 09 19:19:45.242849 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:45.242625    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z"
Jul 09 19:19:45.242849 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:45.242667    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z" event={"ID":"2c8047d2-034c-4ed1-8718-a95e9cea23a6","Type":"ContainerDied","Data":"34355d872e74f6e401b4c0b742a7b4ee289bee10cf537c84a98658d44ba1ee21"}
Jul 09 19:19:45.242849 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:45.242720    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z" event={"ID":"2c8047d2-034c-4ed1-8718-a95e9cea23a6","Type":"ContainerDied","Data":"fe093d7ed7ec2c2782dbdb33c1885913d278e479c366807598d28acb2d246f91"}
Jul 09 19:19:45.242849 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:45.242742    2580 scope.go:117] "RemoveContainer" containerID="34355d872e74f6e401b4c0b742a7b4ee289bee10cf537c84a98658d44ba1ee21"
Jul 09 19:19:45.252419 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:45.252398    2580 scope.go:117] "RemoveContainer" containerID="34355d872e74f6e401b4c0b742a7b4ee289bee10cf537c84a98658d44ba1ee21"
Jul 09 19:19:45.252691 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:19:45.252668    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34355d872e74f6e401b4c0b742a7b4ee289bee10cf537c84a98658d44ba1ee21\": container with ID starting with 34355d872e74f6e401b4c0b742a7b4ee289bee10cf537c84a98658d44ba1ee21 not found: ID does not exist" containerID="34355d872e74f6e401b4c0b742a7b4ee289bee10cf537c84a98658d44ba1ee21"
Jul 09 19:19:45.252764 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:45.252704    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34355d872e74f6e401b4c0b742a7b4ee289bee10cf537c84a98658d44ba1ee21"} err="failed to get container status \"34355d872e74f6e401b4c0b742a7b4ee289bee10cf537c84a98658d44ba1ee21\": rpc error: code = NotFound desc = could not find container \"34355d872e74f6e401b4c0b742a7b4ee289bee10cf537c84a98658d44ba1ee21\": container with ID starting with 34355d872e74f6e401b4c0b742a7b4ee289bee10cf537c84a98658d44ba1ee21 not found: ID does not exist"
Jul 09 19:19:45.302281 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:45.302249    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z"]
Jul 09 19:19:45.303971 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:45.303951    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dc9769-8658b9cddf-d2n2z"]
Jul 09 19:19:47.252730 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:47.252696    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c8047d2-034c-4ed1-8718-a95e9cea23a6" path="/var/lib/kubelet/pods/2c8047d2-034c-4ed1-8718-a95e9cea23a6/volumes"
Jul 09 19:19:54.266165 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:54.266134    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z"]
Jul 09 19:19:54.266548 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:54.266523    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c8047d2-034c-4ed1-8718-a95e9cea23a6" containerName="maas-api"
Jul 09 19:19:54.266548 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:54.266535    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c8047d2-034c-4ed1-8718-a95e9cea23a6" containerName="maas-api"
Jul 09 19:19:54.266677 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:54.266555    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c61ead65-4c2d-4647-8195-eda693dc5e2f" containerName="maas-api"
Jul 09 19:19:54.266677 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:54.266561    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c61ead65-4c2d-4647-8195-eda693dc5e2f" containerName="maas-api"
Jul 09 19:19:54.266677 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:54.266637    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c61ead65-4c2d-4647-8195-eda693dc5e2f" containerName="maas-api"
Jul 09 19:19:54.266677 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:54.266652    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c8047d2-034c-4ed1-8718-a95e9cea23a6" containerName="maas-api"
Jul 09 19:19:54.269754 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:54.269732    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z"
Jul 09 19:19:54.272501 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:54.272482    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-6e8c75-serving-cert\""
Jul 09 19:19:54.272598 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:54.272517    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rxfcr\""
Jul 09 19:19:54.279734 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:54.279712    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z"]
Jul 09 19:19:54.306630 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:54.306601    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90669557-f56b-4603-8e28-abb92a74f515-openshift-service-ca\") pod \"maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z\" (UID: \"90669557-f56b-4603-8e28-abb92a74f515\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z"
Jul 09 19:19:54.306779 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:54.306642    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm99q\" (UniqueName: \"kubernetes.io/projected/90669557-f56b-4603-8e28-abb92a74f515-kube-api-access-fm99q\") pod \"maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z\" (UID: \"90669557-f56b-4603-8e28-abb92a74f515\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z"
Jul 09 19:19:54.306873 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:54.306808    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90669557-f56b-4603-8e28-abb92a74f515-maas-api-tls\") pod \"maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z\" (UID: \"90669557-f56b-4603-8e28-abb92a74f515\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z"
Jul 09 19:19:54.407738 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:54.407701    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90669557-f56b-4603-8e28-abb92a74f515-maas-api-tls\") pod \"maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z\" (UID: \"90669557-f56b-4603-8e28-abb92a74f515\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z"
Jul 09 19:19:54.407963 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:54.407750    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90669557-f56b-4603-8e28-abb92a74f515-openshift-service-ca\") pod \"maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z\" (UID: \"90669557-f56b-4603-8e28-abb92a74f515\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z"
Jul 09 19:19:54.407963 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:54.407769    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm99q\" (UniqueName: \"kubernetes.io/projected/90669557-f56b-4603-8e28-abb92a74f515-kube-api-access-fm99q\") pod \"maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z\" (UID: \"90669557-f56b-4603-8e28-abb92a74f515\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z"
Jul 09 19:19:54.408378 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:54.408354    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90669557-f56b-4603-8e28-abb92a74f515-openshift-service-ca\") pod \"maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z\" (UID: \"90669557-f56b-4603-8e28-abb92a74f515\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z"
Jul 09 19:19:54.410179 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:54.410155    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90669557-f56b-4603-8e28-abb92a74f515-maas-api-tls\") pod \"maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z\" (UID: \"90669557-f56b-4603-8e28-abb92a74f515\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z"
Jul 09 19:19:54.419853 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:54.419810    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm99q\" (UniqueName: \"kubernetes.io/projected/90669557-f56b-4603-8e28-abb92a74f515-kube-api-access-fm99q\") pod \"maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z\" (UID: \"90669557-f56b-4603-8e28-abb92a74f515\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z"
Jul 09 19:19:54.581773 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:54.581689    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z"
Jul 09 19:19:54.714951 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:54.714919    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z"]
Jul 09 19:19:54.718276 ip-10-0-137-236 kubenswrapper[2580]: W0709 19:19:54.718247    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90669557_f56b_4603_8e28_abb92a74f515.slice/crio-47db674bb47621009db55c86e5d08fc34885f46b8a920d06dfba2730aa836c97 WatchSource:0}: Error finding container 47db674bb47621009db55c86e5d08fc34885f46b8a920d06dfba2730aa836c97: Status 404 returned error can't find the container with id 47db674bb47621009db55c86e5d08fc34885f46b8a920d06dfba2730aa836c97
Jul 09 19:19:55.291864 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:55.291815    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z" event={"ID":"90669557-f56b-4603-8e28-abb92a74f515","Type":"ContainerStarted","Data":"05cbcd3df507c7e9128898fe9a10fd763b69b49e949b728f94be6a98ce455afe"}
Jul 09 19:19:55.292247 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:55.291880    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z" event={"ID":"90669557-f56b-4603-8e28-abb92a74f515","Type":"ContainerStarted","Data":"47db674bb47621009db55c86e5d08fc34885f46b8a920d06dfba2730aa836c97"}
Jul 09 19:19:55.292247 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:55.291907    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z"
Jul 09 19:19:55.334414 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:19:55.334361    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z" podStartSLOduration=0.923337051 podStartE2EDuration="1.334343085s" totalImagesPullingTime="411.006034ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:19:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:19:55.333087445 +0000 UTC m=+2050.542676664" watchObservedRunningTime="2026-07-09 19:19:55.334343085 +0000 UTC m=+2050.543932302"
Jul 09 19:20:01.302859 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:01.302797    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z"
Jul 09 19:20:02.653969 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:02.653933    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml"]
Jul 09 19:20:02.658197 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:02.658177    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml"
Jul 09 19:20:02.660784 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:02.660762    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-a966ef-serving-cert\""
Jul 09 19:20:02.666300 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:02.666275    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml"]
Jul 09 19:20:02.790225 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:02.790191    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml\" (UID: \"e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml"
Jul 09 19:20:02.790394 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:02.790230    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e-maas-api-tls\") pod \"maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml\" (UID: \"e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml"
Jul 09 19:20:02.790394 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:02.790330    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc86f\" (UniqueName: \"kubernetes.io/projected/e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e-kube-api-access-sc86f\") pod \"maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml\" (UID: \"e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml"
Jul 09 19:20:02.891009 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:02.890974    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc86f\" (UniqueName: \"kubernetes.io/projected/e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e-kube-api-access-sc86f\") pod \"maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml\" (UID: \"e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml"
Jul 09 19:20:02.891172 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:02.891063    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml\" (UID: \"e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml"
Jul 09 19:20:02.891172 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:02.891089    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e-maas-api-tls\") pod \"maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml\" (UID: \"e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml"
Jul 09 19:20:02.891251 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:20:02.891203    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-serving-cert: secret "maas-api-e2e-shared-b-a966ef-serving-cert" not found
Jul 09 19:20:02.891287 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:20:02.891281    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e-maas-api-tls podName:e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e nodeName:}" failed. No retries permitted until 2026-07-09 19:20:03.391261385 +0000 UTC m=+2058.600850589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e-maas-api-tls") pod "maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml" (UID: "e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e") : secret "maas-api-e2e-shared-b-a966ef-serving-cert" not found
Jul 09 19:20:02.891759 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:02.891738    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml\" (UID: \"e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml"
Jul 09 19:20:02.900933 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:02.900907    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc86f\" (UniqueName: \"kubernetes.io/projected/e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e-kube-api-access-sc86f\") pod \"maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml\" (UID: \"e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml"
Jul 09 19:20:03.397168 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:03.397136    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e-maas-api-tls\") pod \"maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml\" (UID: \"e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml"
Jul 09 19:20:03.397344 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:20:03.397289    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-serving-cert: secret "maas-api-e2e-shared-b-a966ef-serving-cert" not found
Jul 09 19:20:03.397387 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:20:03.397356    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e-maas-api-tls podName:e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e nodeName:}" failed. No retries permitted until 2026-07-09 19:20:04.397341662 +0000 UTC m=+2059.606930861 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e-maas-api-tls") pod "maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml" (UID: "e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e") : secret "maas-api-e2e-shared-b-a966ef-serving-cert" not found
Jul 09 19:20:04.405812 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:04.405776    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e-maas-api-tls\") pod \"maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml\" (UID: \"e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml"
Jul 09 19:20:04.408125 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:04.408105    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e-maas-api-tls\") pod \"maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml\" (UID: \"e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml"
Jul 09 19:20:04.470251 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:04.470210    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml"
Jul 09 19:20:04.605570 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:04.605546    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml"]
Jul 09 19:20:04.607749 ip-10-0-137-236 kubenswrapper[2580]: W0709 19:20:04.607721    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4dcc7a5_8e99_4b99_8ca5_5649e5065f0e.slice/crio-641c1ad88c663f35a0fb1b6c0f3afa2794caca5d5f5911a62f29857d3d34ba65 WatchSource:0}: Error finding container 641c1ad88c663f35a0fb1b6c0f3afa2794caca5d5f5911a62f29857d3d34ba65: Status 404 returned error can't find the container with id 641c1ad88c663f35a0fb1b6c0f3afa2794caca5d5f5911a62f29857d3d34ba65
Jul 09 19:20:05.344389 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:05.344291    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml" event={"ID":"e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e","Type":"ContainerStarted","Data":"4e8b7250c234615c075ee5505638358ae8723e9ddb383dddbc3a23891be5b4ff"}
Jul 09 19:20:05.344389 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:05.344349    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml" event={"ID":"e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e","Type":"ContainerStarted","Data":"641c1ad88c663f35a0fb1b6c0f3afa2794caca5d5f5911a62f29857d3d34ba65"}
Jul 09 19:20:05.344587 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:05.344456    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml"
Jul 09 19:20:05.365208 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:05.365130    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml" podStartSLOduration=2.977594014 podStartE2EDuration="3.365105698s" totalImagesPullingTime="387.511684ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:20:05.361801417 +0000 UTC m=+2060.571390636" watchObservedRunningTime="2026-07-09 19:20:05.365105698 +0000 UTC m=+2060.574694917"
Jul 09 19:20:11.354266 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:11.354195    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml"
Jul 09 19:20:22.618047 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.618013    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"]
Jul 09 19:20:22.621718 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.621699    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:20:22.625541 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.625520    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6e8c75\"/\"default-dockercfg-kbbx5\""
Jul 09 19:20:22.625676 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.625554    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6e8c75\"/\"openshift-service-ca.crt\""
Jul 09 19:20:22.625676 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.625621    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6e8c75\"/\"auth-test-model-6e8c75-kserve-self-signed-certs\""
Jul 09 19:20:22.625676 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.625624    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6e8c75\"/\"kube-root-ca.crt\""
Jul 09 19:20:22.630111 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.630087    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"]
Jul 09 19:20:22.778419 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.778385    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5bed622-ce34-42e5-8fab-9691119d935d-dshm\") pod \"auth-test-model-6e8c75-kserve-7b46d97967-4slnd\" (UID: \"a5bed622-ce34-42e5-8fab-9691119d935d\") " pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:20:22.778419 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.778423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5bed622-ce34-42e5-8fab-9691119d935d-model-cache\") pod \"auth-test-model-6e8c75-kserve-7b46d97967-4slnd\" (UID: \"a5bed622-ce34-42e5-8fab-9691119d935d\") " pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:20:22.778625 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.778501    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5bed622-ce34-42e5-8fab-9691119d935d-tls-certs\") pod \"auth-test-model-6e8c75-kserve-7b46d97967-4slnd\" (UID: \"a5bed622-ce34-42e5-8fab-9691119d935d\") " pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:20:22.778625 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.778560    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5bed622-ce34-42e5-8fab-9691119d935d-tmp-dir\") pod \"auth-test-model-6e8c75-kserve-7b46d97967-4slnd\" (UID: \"a5bed622-ce34-42e5-8fab-9691119d935d\") " pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:20:22.778625 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.778586    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5bed622-ce34-42e5-8fab-9691119d935d-home\") pod \"auth-test-model-6e8c75-kserve-7b46d97967-4slnd\" (UID: \"a5bed622-ce34-42e5-8fab-9691119d935d\") " pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:20:22.778727 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.778644    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf759\" (UniqueName: \"kubernetes.io/projected/a5bed622-ce34-42e5-8fab-9691119d935d-kube-api-access-bf759\") pod \"auth-test-model-6e8c75-kserve-7b46d97967-4slnd\" (UID: \"a5bed622-ce34-42e5-8fab-9691119d935d\") " pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:20:22.879888 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.879798    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf759\" (UniqueName: \"kubernetes.io/projected/a5bed622-ce34-42e5-8fab-9691119d935d-kube-api-access-bf759\") pod \"auth-test-model-6e8c75-kserve-7b46d97967-4slnd\" (UID: \"a5bed622-ce34-42e5-8fab-9691119d935d\") " pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:20:22.879888 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.879868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5bed622-ce34-42e5-8fab-9691119d935d-dshm\") pod \"auth-test-model-6e8c75-kserve-7b46d97967-4slnd\" (UID: \"a5bed622-ce34-42e5-8fab-9691119d935d\") " pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:20:22.880120 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.879893    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5bed622-ce34-42e5-8fab-9691119d935d-model-cache\") pod \"auth-test-model-6e8c75-kserve-7b46d97967-4slnd\" (UID: \"a5bed622-ce34-42e5-8fab-9691119d935d\") " pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:20:22.880120 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.879935    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5bed622-ce34-42e5-8fab-9691119d935d-tls-certs\") pod \"auth-test-model-6e8c75-kserve-7b46d97967-4slnd\" (UID: \"a5bed622-ce34-42e5-8fab-9691119d935d\") " pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:20:22.880120 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.879967    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5bed622-ce34-42e5-8fab-9691119d935d-tmp-dir\") pod \"auth-test-model-6e8c75-kserve-7b46d97967-4slnd\" (UID: \"a5bed622-ce34-42e5-8fab-9691119d935d\") " pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:20:22.880120 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.879987    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5bed622-ce34-42e5-8fab-9691119d935d-home\") pod \"auth-test-model-6e8c75-kserve-7b46d97967-4slnd\" (UID: \"a5bed622-ce34-42e5-8fab-9691119d935d\") " pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:20:22.880351 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.880301    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5bed622-ce34-42e5-8fab-9691119d935d-model-cache\") pod \"auth-test-model-6e8c75-kserve-7b46d97967-4slnd\" (UID: \"a5bed622-ce34-42e5-8fab-9691119d935d\") " pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:20:22.880415 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.880373    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5bed622-ce34-42e5-8fab-9691119d935d-tmp-dir\") pod \"auth-test-model-6e8c75-kserve-7b46d97967-4slnd\" (UID: \"a5bed622-ce34-42e5-8fab-9691119d935d\") " pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:20:22.880465 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.880389    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5bed622-ce34-42e5-8fab-9691119d935d-home\") pod \"auth-test-model-6e8c75-kserve-7b46d97967-4slnd\" (UID: \"a5bed622-ce34-42e5-8fab-9691119d935d\") " pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:20:22.882253 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.882224    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5bed622-ce34-42e5-8fab-9691119d935d-dshm\") pod \"auth-test-model-6e8c75-kserve-7b46d97967-4slnd\" (UID: \"a5bed622-ce34-42e5-8fab-9691119d935d\") " pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:20:22.882625 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.882605    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5bed622-ce34-42e5-8fab-9691119d935d-tls-certs\") pod \"auth-test-model-6e8c75-kserve-7b46d97967-4slnd\" (UID: \"a5bed622-ce34-42e5-8fab-9691119d935d\") " pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:20:22.889467 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.889444    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf759\" (UniqueName: \"kubernetes.io/projected/a5bed622-ce34-42e5-8fab-9691119d935d-kube-api-access-bf759\") pod \"auth-test-model-6e8c75-kserve-7b46d97967-4slnd\" (UID: \"a5bed622-ce34-42e5-8fab-9691119d935d\") " pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:20:22.932521 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:22.932485    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:20:23.069683 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:23.069656    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"]
Jul 09 19:20:23.072531 ip-10-0-137-236 kubenswrapper[2580]: W0709 19:20:23.072490    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5bed622_ce34_42e5_8fab_9691119d935d.slice/crio-698c52e16cc47f3dc3a81649de5e48ba5f2e87483e6986a3c4049d15ce93bbdf WatchSource:0}: Error finding container 698c52e16cc47f3dc3a81649de5e48ba5f2e87483e6986a3c4049d15ce93bbdf: Status 404 returned error can't find the container with id 698c52e16cc47f3dc3a81649de5e48ba5f2e87483e6986a3c4049d15ce93bbdf
Jul 09 19:20:23.438968 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:23.438926    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd" event={"ID":"a5bed622-ce34-42e5-8fab-9691119d935d","Type":"ContainerStarted","Data":"c878556172273c22ef54c5a14454d0a18eb832c4d6e46b968a7dbbf98bfbaebb"}
Jul 09 19:20:23.439137 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:23.438976    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd" event={"ID":"a5bed622-ce34-42e5-8fab-9691119d935d","Type":"ContainerStarted","Data":"698c52e16cc47f3dc3a81649de5e48ba5f2e87483e6986a3c4049d15ce93bbdf"}
Jul 09 19:20:23.458755 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:23.458704    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd" podStartSLOduration=1.458687387 podStartE2EDuration="1.458687387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:20:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:20:23.457964783 +0000 UTC m=+2078.667554005" watchObservedRunningTime="2026-07-09 19:20:23.458687387 +0000 UTC m=+2078.668276605"
Jul 09 19:20:32.933570 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:32.933534    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:20:32.934017 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:32.933589    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:20:32.946138 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:32.946111    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:20:33.500540 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:33.500506    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:20:45.327820 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:45.327794    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hps7x_30222ae0-b5d2-440e-a799-e808706d4b84/ovn-acl-logging/0.log"
Jul 09 19:20:45.332537 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:20:45.332512    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hps7x_30222ae0-b5d2-440e-a799-e808706d4b84/ovn-acl-logging/0.log"
Jul 09 19:23:24.239980 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:24.239905    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"]
Jul 09 19:23:37.799906 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:37.799869    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"]
Jul 09 19:23:37.804399 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:37.804376    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:23:37.807303 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:37.807282    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6e8c75\"/\"sub-test-model-6e8c75-kserve-self-signed-certs\""
Jul 09 19:23:37.812935 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:37.812915    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"]
Jul 09 19:23:37.860100 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:37.860072    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f280de5e-a1e4-41b7-9a98-a44af83bae66-model-cache\") pod \"sub-test-model-6e8c75-kserve-5699d57c95-mxsd5\" (UID: \"f280de5e-a1e4-41b7-9a98-a44af83bae66\") " pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:23:37.860245 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:37.860103    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f280de5e-a1e4-41b7-9a98-a44af83bae66-dshm\") pod \"sub-test-model-6e8c75-kserve-5699d57c95-mxsd5\" (UID: \"f280de5e-a1e4-41b7-9a98-a44af83bae66\") " pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:23:37.860245 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:37.860120    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f280de5e-a1e4-41b7-9a98-a44af83bae66-tmp-dir\") pod \"sub-test-model-6e8c75-kserve-5699d57c95-mxsd5\" (UID: \"f280de5e-a1e4-41b7-9a98-a44af83bae66\") " pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:23:37.860245 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:37.860136    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f280de5e-a1e4-41b7-9a98-a44af83bae66-tls-certs\") pod \"sub-test-model-6e8c75-kserve-5699d57c95-mxsd5\" (UID: \"f280de5e-a1e4-41b7-9a98-a44af83bae66\") " pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:23:37.860424 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:37.860282    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbjxl\" (UniqueName: \"kubernetes.io/projected/f280de5e-a1e4-41b7-9a98-a44af83bae66-kube-api-access-jbjxl\") pod \"sub-test-model-6e8c75-kserve-5699d57c95-mxsd5\" (UID: \"f280de5e-a1e4-41b7-9a98-a44af83bae66\") " pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:23:37.860424 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:37.860400    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f280de5e-a1e4-41b7-9a98-a44af83bae66-home\") pod \"sub-test-model-6e8c75-kserve-5699d57c95-mxsd5\" (UID: \"f280de5e-a1e4-41b7-9a98-a44af83bae66\") " pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:23:37.961919 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:37.961887    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f280de5e-a1e4-41b7-9a98-a44af83bae66-tls-certs\") pod \"sub-test-model-6e8c75-kserve-5699d57c95-mxsd5\" (UID: \"f280de5e-a1e4-41b7-9a98-a44af83bae66\") " pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:23:37.962121 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:37.961949    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbjxl\" (UniqueName: \"kubernetes.io/projected/f280de5e-a1e4-41b7-9a98-a44af83bae66-kube-api-access-jbjxl\") pod \"sub-test-model-6e8c75-kserve-5699d57c95-mxsd5\" (UID: \"f280de5e-a1e4-41b7-9a98-a44af83bae66\") " pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:23:37.962121 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:37.962025    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f280de5e-a1e4-41b7-9a98-a44af83bae66-home\") pod \"sub-test-model-6e8c75-kserve-5699d57c95-mxsd5\" (UID: \"f280de5e-a1e4-41b7-9a98-a44af83bae66\") " pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:23:37.962253 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:37.962145    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f280de5e-a1e4-41b7-9a98-a44af83bae66-model-cache\") pod \"sub-test-model-6e8c75-kserve-5699d57c95-mxsd5\" (UID: \"f280de5e-a1e4-41b7-9a98-a44af83bae66\") " pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:23:37.962253 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:37.962184    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f280de5e-a1e4-41b7-9a98-a44af83bae66-dshm\") pod \"sub-test-model-6e8c75-kserve-5699d57c95-mxsd5\" (UID: \"f280de5e-a1e4-41b7-9a98-a44af83bae66\") " pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:23:37.962253 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:37.962200    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f280de5e-a1e4-41b7-9a98-a44af83bae66-tmp-dir\") pod \"sub-test-model-6e8c75-kserve-5699d57c95-mxsd5\" (UID: \"f280de5e-a1e4-41b7-9a98-a44af83bae66\") " pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:23:37.962484 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:37.962466    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f280de5e-a1e4-41b7-9a98-a44af83bae66-home\") pod \"sub-test-model-6e8c75-kserve-5699d57c95-mxsd5\" (UID: \"f280de5e-a1e4-41b7-9a98-a44af83bae66\") " pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:23:37.962577 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:37.962481    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f280de5e-a1e4-41b7-9a98-a44af83bae66-model-cache\") pod \"sub-test-model-6e8c75-kserve-5699d57c95-mxsd5\" (UID: \"f280de5e-a1e4-41b7-9a98-a44af83bae66\") " pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:23:37.962628 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:37.962612    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f280de5e-a1e4-41b7-9a98-a44af83bae66-tmp-dir\") pod \"sub-test-model-6e8c75-kserve-5699d57c95-mxsd5\" (UID: \"f280de5e-a1e4-41b7-9a98-a44af83bae66\") " pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:23:37.964275 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:37.964253    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f280de5e-a1e4-41b7-9a98-a44af83bae66-dshm\") pod \"sub-test-model-6e8c75-kserve-5699d57c95-mxsd5\" (UID: \"f280de5e-a1e4-41b7-9a98-a44af83bae66\") " pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:23:37.964567 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:37.964548    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f280de5e-a1e4-41b7-9a98-a44af83bae66-tls-certs\") pod \"sub-test-model-6e8c75-kserve-5699d57c95-mxsd5\" (UID: \"f280de5e-a1e4-41b7-9a98-a44af83bae66\") " pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:23:37.970716 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:37.970694    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbjxl\" (UniqueName: \"kubernetes.io/projected/f280de5e-a1e4-41b7-9a98-a44af83bae66-kube-api-access-jbjxl\") pod \"sub-test-model-6e8c75-kserve-5699d57c95-mxsd5\" (UID: \"f280de5e-a1e4-41b7-9a98-a44af83bae66\") " pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:23:38.115235 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:38.115153    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:23:38.255432 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:38.255403    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"]
Jul 09 19:23:38.257658 ip-10-0-137-236 kubenswrapper[2580]: W0709 19:23:38.257630    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf280de5e_a1e4_41b7_9a98_a44af83bae66.slice/crio-631931f1a270ec4e79e2f78aec15a125a8db49ef3a1bdd507ecc1b2201564201 WatchSource:0}: Error finding container 631931f1a270ec4e79e2f78aec15a125a8db49ef3a1bdd507ecc1b2201564201: Status 404 returned error can't find the container with id 631931f1a270ec4e79e2f78aec15a125a8db49ef3a1bdd507ecc1b2201564201
Jul 09 19:23:38.460128 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:38.460095    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5" event={"ID":"f280de5e-a1e4-41b7-9a98-a44af83bae66","Type":"ContainerStarted","Data":"a5aae10e6aa5d0dd830fe5b7f4007035bbddc987afdfaa20b5bf7c1ebc8ae169"}
Jul 09 19:23:38.460303 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:38.460152    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5" event={"ID":"f280de5e-a1e4-41b7-9a98-a44af83bae66","Type":"ContainerStarted","Data":"631931f1a270ec4e79e2f78aec15a125a8db49ef3a1bdd507ecc1b2201564201"}
Jul 09 19:23:38.485620 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:38.485569    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5" podStartSLOduration=1.4855529 podStartE2EDuration="1.4855529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:23:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:23:38.48324168 +0000 UTC m=+2273.692830897" watchObservedRunningTime="2026-07-09 19:23:38.4855529 +0000 UTC m=+2273.695142117"
Jul 09 19:23:39.260666 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:39.260624    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd" podUID="a5bed622-ce34-42e5-8fab-9691119d935d" containerName="main" containerID="cri-o://c878556172273c22ef54c5a14454d0a18eb832c4d6e46b968a7dbbf98bfbaebb" gracePeriod=45
Jul 09 19:23:39.467392 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:39.467357    2580 generic.go:356] "Generic (PLEG): container finished" podID="a5bed622-ce34-42e5-8fab-9691119d935d" containerID="c878556172273c22ef54c5a14454d0a18eb832c4d6e46b968a7dbbf98bfbaebb" exitCode=0
Jul 09 19:23:39.467551 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:39.467431    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd" event={"ID":"a5bed622-ce34-42e5-8fab-9691119d935d","Type":"ContainerDied","Data":"c878556172273c22ef54c5a14454d0a18eb832c4d6e46b968a7dbbf98bfbaebb"}
Jul 09 19:23:39.506387 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:39.506364    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:23:39.579438 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:39.579372    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5bed622-ce34-42e5-8fab-9691119d935d-dshm\") pod \"a5bed622-ce34-42e5-8fab-9691119d935d\" (UID: \"a5bed622-ce34-42e5-8fab-9691119d935d\") "
Jul 09 19:23:39.579438 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:39.579404    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf759\" (UniqueName: \"kubernetes.io/projected/a5bed622-ce34-42e5-8fab-9691119d935d-kube-api-access-bf759\") pod \"a5bed622-ce34-42e5-8fab-9691119d935d\" (UID: \"a5bed622-ce34-42e5-8fab-9691119d935d\") "
Jul 09 19:23:39.579438 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:39.579433    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5bed622-ce34-42e5-8fab-9691119d935d-model-cache\") pod \"a5bed622-ce34-42e5-8fab-9691119d935d\" (UID: \"a5bed622-ce34-42e5-8fab-9691119d935d\") "
Jul 09 19:23:39.579683 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:39.579471    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5bed622-ce34-42e5-8fab-9691119d935d-home\") pod \"a5bed622-ce34-42e5-8fab-9691119d935d\" (UID: \"a5bed622-ce34-42e5-8fab-9691119d935d\") "
Jul 09 19:23:39.579683 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:39.579546    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5bed622-ce34-42e5-8fab-9691119d935d-tls-certs\") pod \"a5bed622-ce34-42e5-8fab-9691119d935d\" (UID: \"a5bed622-ce34-42e5-8fab-9691119d935d\") "
Jul 09 19:23:39.579683 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:39.579638    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5bed622-ce34-42e5-8fab-9691119d935d-tmp-dir\") pod \"a5bed622-ce34-42e5-8fab-9691119d935d\" (UID: \"a5bed622-ce34-42e5-8fab-9691119d935d\") "
Jul 09 19:23:39.579873 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:39.579738    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5bed622-ce34-42e5-8fab-9691119d935d-model-cache" (OuterVolumeSpecName: "model-cache") pod "a5bed622-ce34-42e5-8fab-9691119d935d" (UID: "a5bed622-ce34-42e5-8fab-9691119d935d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:23:39.579873 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:39.579799    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5bed622-ce34-42e5-8fab-9691119d935d-home" (OuterVolumeSpecName: "home") pod "a5bed622-ce34-42e5-8fab-9691119d935d" (UID: "a5bed622-ce34-42e5-8fab-9691119d935d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:23:39.579994 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:39.579927    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5bed622-ce34-42e5-8fab-9691119d935d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a5bed622-ce34-42e5-8fab-9691119d935d" (UID: "a5bed622-ce34-42e5-8fab-9691119d935d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:23:39.580085 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:39.580065    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5bed622-ce34-42e5-8fab-9691119d935d-tmp-dir\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:23:39.580139 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:39.580090    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5bed622-ce34-42e5-8fab-9691119d935d-model-cache\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:23:39.580139 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:39.580104    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5bed622-ce34-42e5-8fab-9691119d935d-home\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:23:39.581701 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:39.581679    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5bed622-ce34-42e5-8fab-9691119d935d-dshm" (OuterVolumeSpecName: "dshm") pod "a5bed622-ce34-42e5-8fab-9691119d935d" (UID: "a5bed622-ce34-42e5-8fab-9691119d935d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:23:39.581782 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:39.581704    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5bed622-ce34-42e5-8fab-9691119d935d-kube-api-access-bf759" (OuterVolumeSpecName: "kube-api-access-bf759") pod "a5bed622-ce34-42e5-8fab-9691119d935d" (UID: "a5bed622-ce34-42e5-8fab-9691119d935d"). InnerVolumeSpecName "kube-api-access-bf759". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:23:39.581782 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:39.581732    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5bed622-ce34-42e5-8fab-9691119d935d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a5bed622-ce34-42e5-8fab-9691119d935d" (UID: "a5bed622-ce34-42e5-8fab-9691119d935d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:23:39.681070 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:39.681040    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5bed622-ce34-42e5-8fab-9691119d935d-tls-certs\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:23:39.681070 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:39.681064    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5bed622-ce34-42e5-8fab-9691119d935d-dshm\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:23:39.681070 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:39.681073    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf759\" (UniqueName: \"kubernetes.io/projected/a5bed622-ce34-42e5-8fab-9691119d935d-kube-api-access-bf759\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:23:40.473806 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:40.473778    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"
Jul 09 19:23:40.474235 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:40.473777    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd" event={"ID":"a5bed622-ce34-42e5-8fab-9691119d935d","Type":"ContainerDied","Data":"698c52e16cc47f3dc3a81649de5e48ba5f2e87483e6986a3c4049d15ce93bbdf"}
Jul 09 19:23:40.474235 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:40.473910    2580 scope.go:117] "RemoveContainer" containerID="c878556172273c22ef54c5a14454d0a18eb832c4d6e46b968a7dbbf98bfbaebb"
Jul 09 19:23:40.498346 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:40.498319    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"]
Jul 09 19:23:40.503056 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:40.503031    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-6e8c75/auth-test-model-6e8c75-kserve-7b46d97967-4slnd"]
Jul 09 19:23:41.254140 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:41.254107    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5bed622-ce34-42e5-8fab-9691119d935d" path="/var/lib/kubelet/pods/a5bed622-ce34-42e5-8fab-9691119d935d/volumes"
Jul 09 19:23:48.115564 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:48.115521    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:23:48.115564 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:48.115569    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:23:48.133064 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:48.133040    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:23:48.526449 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:23:48.526421    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:24:51.111198 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:24:51.111167    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"]
Jul 09 19:25:06.131170 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.131132    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5" podUID="f280de5e-a1e4-41b7-9a98-a44af83bae66" containerName="main" containerID="cri-o://a5aae10e6aa5d0dd830fe5b7f4007035bbddc987afdfaa20b5bf7c1ebc8ae169" gracePeriod=45
Jul 09 19:25:06.371645 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.371616    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:25:06.392056 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.391994    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbjxl\" (UniqueName: \"kubernetes.io/projected/f280de5e-a1e4-41b7-9a98-a44af83bae66-kube-api-access-jbjxl\") pod \"f280de5e-a1e4-41b7-9a98-a44af83bae66\" (UID: \"f280de5e-a1e4-41b7-9a98-a44af83bae66\") "
Jul 09 19:25:06.392056 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.392045    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f280de5e-a1e4-41b7-9a98-a44af83bae66-home\") pod \"f280de5e-a1e4-41b7-9a98-a44af83bae66\" (UID: \"f280de5e-a1e4-41b7-9a98-a44af83bae66\") "
Jul 09 19:25:06.392258 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.392083    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f280de5e-a1e4-41b7-9a98-a44af83bae66-tls-certs\") pod \"f280de5e-a1e4-41b7-9a98-a44af83bae66\" (UID: \"f280de5e-a1e4-41b7-9a98-a44af83bae66\") "
Jul 09 19:25:06.392258 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.392103    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f280de5e-a1e4-41b7-9a98-a44af83bae66-dshm\") pod \"f280de5e-a1e4-41b7-9a98-a44af83bae66\" (UID: \"f280de5e-a1e4-41b7-9a98-a44af83bae66\") "
Jul 09 19:25:06.392258 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.392130    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f280de5e-a1e4-41b7-9a98-a44af83bae66-model-cache\") pod \"f280de5e-a1e4-41b7-9a98-a44af83bae66\" (UID: \"f280de5e-a1e4-41b7-9a98-a44af83bae66\") "
Jul 09 19:25:06.392258 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.392244    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f280de5e-a1e4-41b7-9a98-a44af83bae66-tmp-dir\") pod \"f280de5e-a1e4-41b7-9a98-a44af83bae66\" (UID: \"f280de5e-a1e4-41b7-9a98-a44af83bae66\") "
Jul 09 19:25:06.392787 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.392736    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f280de5e-a1e4-41b7-9a98-a44af83bae66-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f280de5e-a1e4-41b7-9a98-a44af83bae66" (UID: "f280de5e-a1e4-41b7-9a98-a44af83bae66"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:25:06.392787 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.392754    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f280de5e-a1e4-41b7-9a98-a44af83bae66-model-cache" (OuterVolumeSpecName: "model-cache") pod "f280de5e-a1e4-41b7-9a98-a44af83bae66" (UID: "f280de5e-a1e4-41b7-9a98-a44af83bae66"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:25:06.392986 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.392819    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f280de5e-a1e4-41b7-9a98-a44af83bae66-home" (OuterVolumeSpecName: "home") pod "f280de5e-a1e4-41b7-9a98-a44af83bae66" (UID: "f280de5e-a1e4-41b7-9a98-a44af83bae66"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:25:06.394407 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.394372    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f280de5e-a1e4-41b7-9a98-a44af83bae66-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f280de5e-a1e4-41b7-9a98-a44af83bae66" (UID: "f280de5e-a1e4-41b7-9a98-a44af83bae66"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:25:06.394533 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.394467    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f280de5e-a1e4-41b7-9a98-a44af83bae66-kube-api-access-jbjxl" (OuterVolumeSpecName: "kube-api-access-jbjxl") pod "f280de5e-a1e4-41b7-9a98-a44af83bae66" (UID: "f280de5e-a1e4-41b7-9a98-a44af83bae66"). InnerVolumeSpecName "kube-api-access-jbjxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:25:06.394580 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.394551    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f280de5e-a1e4-41b7-9a98-a44af83bae66-dshm" (OuterVolumeSpecName: "dshm") pod "f280de5e-a1e4-41b7-9a98-a44af83bae66" (UID: "f280de5e-a1e4-41b7-9a98-a44af83bae66"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:25:06.493055 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.493016    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f280de5e-a1e4-41b7-9a98-a44af83bae66-tls-certs\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:25:06.493055 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.493048    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f280de5e-a1e4-41b7-9a98-a44af83bae66-dshm\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:25:06.493055 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.493059    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f280de5e-a1e4-41b7-9a98-a44af83bae66-model-cache\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:25:06.493291 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.493069    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f280de5e-a1e4-41b7-9a98-a44af83bae66-tmp-dir\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:25:06.493291 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.493081    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbjxl\" (UniqueName: \"kubernetes.io/projected/f280de5e-a1e4-41b7-9a98-a44af83bae66-kube-api-access-jbjxl\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:25:06.493291 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.493094    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f280de5e-a1e4-41b7-9a98-a44af83bae66-home\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:25:06.907094 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.907056    2580 generic.go:356] "Generic (PLEG): container finished" podID="f280de5e-a1e4-41b7-9a98-a44af83bae66" containerID="a5aae10e6aa5d0dd830fe5b7f4007035bbddc987afdfaa20b5bf7c1ebc8ae169" exitCode=0
Jul 09 19:25:06.907094 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.907095    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"
Jul 09 19:25:06.907307 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.907101    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5" event={"ID":"f280de5e-a1e4-41b7-9a98-a44af83bae66","Type":"ContainerDied","Data":"a5aae10e6aa5d0dd830fe5b7f4007035bbddc987afdfaa20b5bf7c1ebc8ae169"}
Jul 09 19:25:06.907307 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.907146    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5" event={"ID":"f280de5e-a1e4-41b7-9a98-a44af83bae66","Type":"ContainerDied","Data":"631931f1a270ec4e79e2f78aec15a125a8db49ef3a1bdd507ecc1b2201564201"}
Jul 09 19:25:06.907307 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.907164    2580 scope.go:117] "RemoveContainer" containerID="a5aae10e6aa5d0dd830fe5b7f4007035bbddc987afdfaa20b5bf7c1ebc8ae169"
Jul 09 19:25:06.916369 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.916351    2580 scope.go:117] "RemoveContainer" containerID="a5aae10e6aa5d0dd830fe5b7f4007035bbddc987afdfaa20b5bf7c1ebc8ae169"
Jul 09 19:25:06.916625 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:25:06.916608    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5aae10e6aa5d0dd830fe5b7f4007035bbddc987afdfaa20b5bf7c1ebc8ae169\": container with ID starting with a5aae10e6aa5d0dd830fe5b7f4007035bbddc987afdfaa20b5bf7c1ebc8ae169 not found: ID does not exist" containerID="a5aae10e6aa5d0dd830fe5b7f4007035bbddc987afdfaa20b5bf7c1ebc8ae169"
Jul 09 19:25:06.916690 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.916632    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5aae10e6aa5d0dd830fe5b7f4007035bbddc987afdfaa20b5bf7c1ebc8ae169"} err="failed to get container status \"a5aae10e6aa5d0dd830fe5b7f4007035bbddc987afdfaa20b5bf7c1ebc8ae169\": rpc error: code = NotFound desc = could not find container \"a5aae10e6aa5d0dd830fe5b7f4007035bbddc987afdfaa20b5bf7c1ebc8ae169\": container with ID starting with a5aae10e6aa5d0dd830fe5b7f4007035bbddc987afdfaa20b5bf7c1ebc8ae169 not found: ID does not exist"
Jul 09 19:25:06.929206 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.929176    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"]
Jul 09 19:25:06.935954 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:06.935933    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-6e8c75/sub-test-model-6e8c75-kserve-5699d57c95-mxsd5"]
Jul 09 19:25:07.253137 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:07.253101    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f280de5e-a1e4-41b7-9a98-a44af83bae66" path="/var/lib/kubelet/pods/f280de5e-a1e4-41b7-9a98-a44af83bae66/volumes"
Jul 09 19:25:15.702589 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.702518    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"]
Jul 09 19:25:15.703078 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.702971    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f280de5e-a1e4-41b7-9a98-a44af83bae66" containerName="main"
Jul 09 19:25:15.703078 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.702984    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f280de5e-a1e4-41b7-9a98-a44af83bae66" containerName="main"
Jul 09 19:25:15.703078 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.703003    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5bed622-ce34-42e5-8fab-9691119d935d" containerName="main"
Jul 09 19:25:15.703078 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.703008    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5bed622-ce34-42e5-8fab-9691119d935d" containerName="main"
Jul 09 19:25:15.703078 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.703080    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5bed622-ce34-42e5-8fab-9691119d935d" containerName="main"
Jul 09 19:25:15.703346 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.703086    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f280de5e-a1e4-41b7-9a98-a44af83bae66" containerName="main"
Jul 09 19:25:15.707247 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.707229    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:25:15.709770 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.709750    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6e8c75\"/\"openshift-service-ca.crt\""
Jul 09 19:25:15.710990 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.710974    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6e8c75\"/\"kube-root-ca.crt\""
Jul 09 19:25:15.711083 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.711057    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6e8c75\"/\"default-dockercfg-kbbx5\""
Jul 09 19:25:15.711151 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.711118    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6e8c75\"/\"rate-test-model-6e8c75-kserve-self-signed-certs\""
Jul 09 19:25:15.717205 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.717186    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"]
Jul 09 19:25:15.781100 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.781069    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ada951e8-0034-4159-aa24-6c79c1f4c0a4-dshm\") pod \"rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r\" (UID: \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\") " pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:25:15.781100 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.781103    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ada951e8-0034-4159-aa24-6c79c1f4c0a4-model-cache\") pod \"rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r\" (UID: \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\") " pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:25:15.781268 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.781126    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x9qj\" (UniqueName: \"kubernetes.io/projected/ada951e8-0034-4159-aa24-6c79c1f4c0a4-kube-api-access-8x9qj\") pod \"rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r\" (UID: \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\") " pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:25:15.781268 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.781217    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ada951e8-0034-4159-aa24-6c79c1f4c0a4-tmp-dir\") pod \"rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r\" (UID: \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\") " pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:25:15.781340 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.781307    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ada951e8-0034-4159-aa24-6c79c1f4c0a4-home\") pod \"rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r\" (UID: \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\") " pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:25:15.781375 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.781337    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ada951e8-0034-4159-aa24-6c79c1f4c0a4-tls-certs\") pod \"rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r\" (UID: \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\") " pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:25:15.882335 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.882305    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ada951e8-0034-4159-aa24-6c79c1f4c0a4-dshm\") pod \"rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r\" (UID: \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\") " pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:25:15.882335 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.882337    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ada951e8-0034-4159-aa24-6c79c1f4c0a4-model-cache\") pod \"rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r\" (UID: \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\") " pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:25:15.882559 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.882362    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x9qj\" (UniqueName: \"kubernetes.io/projected/ada951e8-0034-4159-aa24-6c79c1f4c0a4-kube-api-access-8x9qj\") pod \"rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r\" (UID: \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\") " pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:25:15.882559 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.882408    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ada951e8-0034-4159-aa24-6c79c1f4c0a4-tmp-dir\") pod \"rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r\" (UID: \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\") " pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:25:15.882559 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.882465    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ada951e8-0034-4159-aa24-6c79c1f4c0a4-home\") pod \"rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r\" (UID: \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\") " pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:25:15.882559 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.882490    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ada951e8-0034-4159-aa24-6c79c1f4c0a4-tls-certs\") pod \"rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r\" (UID: \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\") " pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:25:15.882813 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.882791    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ada951e8-0034-4159-aa24-6c79c1f4c0a4-model-cache\") pod \"rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r\" (UID: \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\") " pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:25:15.882900 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.882855    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ada951e8-0034-4159-aa24-6c79c1f4c0a4-tmp-dir\") pod \"rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r\" (UID: \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\") " pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:25:15.882900 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.882872    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ada951e8-0034-4159-aa24-6c79c1f4c0a4-home\") pod \"rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r\" (UID: \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\") " pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:25:15.884489 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.884471    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ada951e8-0034-4159-aa24-6c79c1f4c0a4-dshm\") pod \"rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r\" (UID: \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\") " pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:25:15.884781 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.884765    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ada951e8-0034-4159-aa24-6c79c1f4c0a4-tls-certs\") pod \"rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r\" (UID: \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\") " pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:25:15.892575 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:15.892552    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x9qj\" (UniqueName: \"kubernetes.io/projected/ada951e8-0034-4159-aa24-6c79c1f4c0a4-kube-api-access-8x9qj\") pod \"rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r\" (UID: \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\") " pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:25:16.017755 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:16.017727    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:25:16.151794 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:16.151773    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"]
Jul 09 19:25:16.153943 ip-10-0-137-236 kubenswrapper[2580]: W0709 19:25:16.153916    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podada951e8_0034_4159_aa24_6c79c1f4c0a4.slice/crio-1f09020e985600d4c2179b7bafedfc747f98de8085d5d89104435ce21a136c85 WatchSource:0}: Error finding container 1f09020e985600d4c2179b7bafedfc747f98de8085d5d89104435ce21a136c85: Status 404 returned error can't find the container with id 1f09020e985600d4c2179b7bafedfc747f98de8085d5d89104435ce21a136c85
Jul 09 19:25:16.959051 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:16.959013    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r" event={"ID":"ada951e8-0034-4159-aa24-6c79c1f4c0a4","Type":"ContainerStarted","Data":"034a2705aade50402051f444a2b45fa80815ff87c71b66b0488fa821b6ada31f"}
Jul 09 19:25:16.959490 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:16.959067    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r" event={"ID":"ada951e8-0034-4159-aa24-6c79c1f4c0a4","Type":"ContainerStarted","Data":"1f09020e985600d4c2179b7bafedfc747f98de8085d5d89104435ce21a136c85"}
Jul 09 19:25:16.979395 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:16.979343    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r" podStartSLOduration=1.9793300010000001 podStartE2EDuration="1.979330001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:25:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:25:16.978220537 +0000 UTC m=+2372.187809768" watchObservedRunningTime="2026-07-09 19:25:16.979330001 +0000 UTC m=+2372.188919216"
Jul 09 19:25:26.018122 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:26.018092    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:25:26.018510 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:26.018141    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:25:26.030426 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:26.030400    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:25:27.022678 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:27.022650    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:25:45.364353 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:45.364319    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hps7x_30222ae0-b5d2-440e-a799-e808706d4b84/ovn-acl-logging/0.log"
Jul 09 19:25:45.367524 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:25:45.367503    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hps7x_30222ae0-b5d2-440e-a799-e808706d4b84/ovn-acl-logging/0.log"
Jul 09 19:26:28.775548 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:28.775461    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"]
Jul 09 19:26:43.796363 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:43.796317    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r" podUID="ada951e8-0034-4159-aa24-6c79c1f4c0a4" containerName="main" containerID="cri-o://034a2705aade50402051f444a2b45fa80815ff87c71b66b0488fa821b6ada31f" gracePeriod=45
Jul 09 19:26:44.057986 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.057925    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:26:44.147047 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.147014    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ada951e8-0034-4159-aa24-6c79c1f4c0a4-tmp-dir\") pod \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\" (UID: \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\") "
Jul 09 19:26:44.147047 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.147052    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ada951e8-0034-4159-aa24-6c79c1f4c0a4-model-cache\") pod \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\" (UID: \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\") "
Jul 09 19:26:44.147288 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.147086    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ada951e8-0034-4159-aa24-6c79c1f4c0a4-tls-certs\") pod \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\" (UID: \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\") "
Jul 09 19:26:44.147288 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.147137    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8x9qj\" (UniqueName: \"kubernetes.io/projected/ada951e8-0034-4159-aa24-6c79c1f4c0a4-kube-api-access-8x9qj\") pod \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\" (UID: \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\") "
Jul 09 19:26:44.147288 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.147167    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ada951e8-0034-4159-aa24-6c79c1f4c0a4-home\") pod \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\" (UID: \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\") "
Jul 09 19:26:44.147288 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.147225    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ada951e8-0034-4159-aa24-6c79c1f4c0a4-dshm\") pod \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\" (UID: \"ada951e8-0034-4159-aa24-6c79c1f4c0a4\") "
Jul 09 19:26:44.147505 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.147298    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ada951e8-0034-4159-aa24-6c79c1f4c0a4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ada951e8-0034-4159-aa24-6c79c1f4c0a4" (UID: "ada951e8-0034-4159-aa24-6c79c1f4c0a4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:26:44.147505 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.147412    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ada951e8-0034-4159-aa24-6c79c1f4c0a4-model-cache" (OuterVolumeSpecName: "model-cache") pod "ada951e8-0034-4159-aa24-6c79c1f4c0a4" (UID: "ada951e8-0034-4159-aa24-6c79c1f4c0a4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:26:44.147505 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.147459    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ada951e8-0034-4159-aa24-6c79c1f4c0a4-home" (OuterVolumeSpecName: "home") pod "ada951e8-0034-4159-aa24-6c79c1f4c0a4" (UID: "ada951e8-0034-4159-aa24-6c79c1f4c0a4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:26:44.147505 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.147487    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ada951e8-0034-4159-aa24-6c79c1f4c0a4-tmp-dir\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:26:44.149376 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.149347    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ada951e8-0034-4159-aa24-6c79c1f4c0a4-dshm" (OuterVolumeSpecName: "dshm") pod "ada951e8-0034-4159-aa24-6c79c1f4c0a4" (UID: "ada951e8-0034-4159-aa24-6c79c1f4c0a4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:26:44.149493 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.149428    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ada951e8-0034-4159-aa24-6c79c1f4c0a4-kube-api-access-8x9qj" (OuterVolumeSpecName: "kube-api-access-8x9qj") pod "ada951e8-0034-4159-aa24-6c79c1f4c0a4" (UID: "ada951e8-0034-4159-aa24-6c79c1f4c0a4"). InnerVolumeSpecName "kube-api-access-8x9qj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:26:44.149550 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.149530    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ada951e8-0034-4159-aa24-6c79c1f4c0a4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ada951e8-0034-4159-aa24-6c79c1f4c0a4" (UID: "ada951e8-0034-4159-aa24-6c79c1f4c0a4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:26:44.248053 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.248026    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ada951e8-0034-4159-aa24-6c79c1f4c0a4-dshm\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:26:44.248053 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.248050    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ada951e8-0034-4159-aa24-6c79c1f4c0a4-model-cache\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:26:44.248053 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.248060    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ada951e8-0034-4159-aa24-6c79c1f4c0a4-tls-certs\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:26:44.248291 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.248069    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8x9qj\" (UniqueName: \"kubernetes.io/projected/ada951e8-0034-4159-aa24-6c79c1f4c0a4-kube-api-access-8x9qj\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:26:44.248291 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.248077    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ada951e8-0034-4159-aa24-6c79c1f4c0a4-home\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:26:44.401871 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.401757    2580 generic.go:356] "Generic (PLEG): container finished" podID="ada951e8-0034-4159-aa24-6c79c1f4c0a4" containerID="034a2705aade50402051f444a2b45fa80815ff87c71b66b0488fa821b6ada31f" exitCode=0
Jul 09 19:26:44.401871 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.401804    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"
Jul 09 19:26:44.402116 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.401866    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r" event={"ID":"ada951e8-0034-4159-aa24-6c79c1f4c0a4","Type":"ContainerDied","Data":"034a2705aade50402051f444a2b45fa80815ff87c71b66b0488fa821b6ada31f"}
Jul 09 19:26:44.402116 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.401910    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r" event={"ID":"ada951e8-0034-4159-aa24-6c79c1f4c0a4","Type":"ContainerDied","Data":"1f09020e985600d4c2179b7bafedfc747f98de8085d5d89104435ce21a136c85"}
Jul 09 19:26:44.402116 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.401926    2580 scope.go:117] "RemoveContainer" containerID="034a2705aade50402051f444a2b45fa80815ff87c71b66b0488fa821b6ada31f"
Jul 09 19:26:44.411169 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.411153    2580 scope.go:117] "RemoveContainer" containerID="034a2705aade50402051f444a2b45fa80815ff87c71b66b0488fa821b6ada31f"
Jul 09 19:26:44.411458 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:26:44.411440    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"034a2705aade50402051f444a2b45fa80815ff87c71b66b0488fa821b6ada31f\": container with ID starting with 034a2705aade50402051f444a2b45fa80815ff87c71b66b0488fa821b6ada31f not found: ID does not exist" containerID="034a2705aade50402051f444a2b45fa80815ff87c71b66b0488fa821b6ada31f"
Jul 09 19:26:44.411508 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.411468    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"034a2705aade50402051f444a2b45fa80815ff87c71b66b0488fa821b6ada31f"} err="failed to get container status \"034a2705aade50402051f444a2b45fa80815ff87c71b66b0488fa821b6ada31f\": rpc error: code = NotFound desc = could not find container \"034a2705aade50402051f444a2b45fa80815ff87c71b66b0488fa821b6ada31f\": container with ID starting with 034a2705aade50402051f444a2b45fa80815ff87c71b66b0488fa821b6ada31f not found: ID does not exist"
Jul 09 19:26:44.426590 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.426567    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"]
Jul 09 19:26:44.431228 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:44.431201    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-6e8c75/rate-test-model-6e8c75-kserve-7d4d456bb7-x4q4r"]
Jul 09 19:26:45.253531 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:26:45.253496    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ada951e8-0034-4159-aa24-6c79c1f4c0a4" path="/var/lib/kubelet/pods/ada951e8-0034-4159-aa24-6c79c1f4c0a4/volumes"
Jul 09 19:27:02.998363 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:02.998324    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z"]
Jul 09 19:27:03.001064 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:02.998588    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z" podUID="90669557-f56b-4603-8e28-abb92a74f515" containerName="maas-api" containerID="cri-o://05cbcd3df507c7e9128898fe9a10fd763b69b49e949b728f94be6a98ce455afe" gracePeriod=30
Jul 09 19:27:03.248303 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:03.248276    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z"
Jul 09 19:27:03.329663 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:03.329579    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90669557-f56b-4603-8e28-abb92a74f515-maas-api-tls\") pod \"90669557-f56b-4603-8e28-abb92a74f515\" (UID: \"90669557-f56b-4603-8e28-abb92a74f515\") "
Jul 09 19:27:03.329856 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:03.329683    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fm99q\" (UniqueName: \"kubernetes.io/projected/90669557-f56b-4603-8e28-abb92a74f515-kube-api-access-fm99q\") pod \"90669557-f56b-4603-8e28-abb92a74f515\" (UID: \"90669557-f56b-4603-8e28-abb92a74f515\") "
Jul 09 19:27:03.329856 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:03.329720    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90669557-f56b-4603-8e28-abb92a74f515-openshift-service-ca\") pod \"90669557-f56b-4603-8e28-abb92a74f515\" (UID: \"90669557-f56b-4603-8e28-abb92a74f515\") "
Jul 09 19:27:03.330091 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:03.330066    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90669557-f56b-4603-8e28-abb92a74f515-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "90669557-f56b-4603-8e28-abb92a74f515" (UID: "90669557-f56b-4603-8e28-abb92a74f515"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:27:03.331804 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:03.331781    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90669557-f56b-4603-8e28-abb92a74f515-kube-api-access-fm99q" (OuterVolumeSpecName: "kube-api-access-fm99q") pod "90669557-f56b-4603-8e28-abb92a74f515" (UID: "90669557-f56b-4603-8e28-abb92a74f515"). InnerVolumeSpecName "kube-api-access-fm99q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:27:03.331902 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:03.331840    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90669557-f56b-4603-8e28-abb92a74f515-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "90669557-f56b-4603-8e28-abb92a74f515" (UID: "90669557-f56b-4603-8e28-abb92a74f515"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:27:03.431297 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:03.431263    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fm99q\" (UniqueName: \"kubernetes.io/projected/90669557-f56b-4603-8e28-abb92a74f515-kube-api-access-fm99q\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:27:03.431297 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:03.431296    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90669557-f56b-4603-8e28-abb92a74f515-openshift-service-ca\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:27:03.431505 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:03.431310    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90669557-f56b-4603-8e28-abb92a74f515-maas-api-tls\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:27:03.499269 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:03.499238    2580 generic.go:356] "Generic (PLEG): container finished" podID="90669557-f56b-4603-8e28-abb92a74f515" containerID="05cbcd3df507c7e9128898fe9a10fd763b69b49e949b728f94be6a98ce455afe" exitCode=0
Jul 09 19:27:03.499438 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:03.499284    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z"
Jul 09 19:27:03.499438 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:03.499285    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z" event={"ID":"90669557-f56b-4603-8e28-abb92a74f515","Type":"ContainerDied","Data":"05cbcd3df507c7e9128898fe9a10fd763b69b49e949b728f94be6a98ce455afe"}
Jul 09 19:27:03.499438 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:03.499417    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z" event={"ID":"90669557-f56b-4603-8e28-abb92a74f515","Type":"ContainerDied","Data":"47db674bb47621009db55c86e5d08fc34885f46b8a920d06dfba2730aa836c97"}
Jul 09 19:27:03.499566 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:03.499448    2580 scope.go:117] "RemoveContainer" containerID="05cbcd3df507c7e9128898fe9a10fd763b69b49e949b728f94be6a98ce455afe"
Jul 09 19:27:03.508822 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:03.508807    2580 scope.go:117] "RemoveContainer" containerID="05cbcd3df507c7e9128898fe9a10fd763b69b49e949b728f94be6a98ce455afe"
Jul 09 19:27:03.509131 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:27:03.509111    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05cbcd3df507c7e9128898fe9a10fd763b69b49e949b728f94be6a98ce455afe\": container with ID starting with 05cbcd3df507c7e9128898fe9a10fd763b69b49e949b728f94be6a98ce455afe not found: ID does not exist" containerID="05cbcd3df507c7e9128898fe9a10fd763b69b49e949b728f94be6a98ce455afe"
Jul 09 19:27:03.509208 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:03.509138    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05cbcd3df507c7e9128898fe9a10fd763b69b49e949b728f94be6a98ce455afe"} err="failed to get container status \"05cbcd3df507c7e9128898fe9a10fd763b69b49e949b728f94be6a98ce455afe\": rpc error: code = NotFound desc = could not find container \"05cbcd3df507c7e9128898fe9a10fd763b69b49e949b728f94be6a98ce455afe\": container with ID starting with 05cbcd3df507c7e9128898fe9a10fd763b69b49e949b728f94be6a98ce455afe not found: ID does not exist"
Jul 09 19:27:03.522076 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:03.522051    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z"]
Jul 09 19:27:03.528897 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:03.528873    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-6e8c75-587c4564dc-m2v7z"]
Jul 09 19:27:05.253886 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:05.253850    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90669557-f56b-4603-8e28-abb92a74f515" path="/var/lib/kubelet/pods/90669557-f56b-4603-8e28-abb92a74f515/volumes"
Jul 09 19:27:11.118203 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:11.118169    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml"]
Jul 09 19:27:11.118681 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:11.118369    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml" podUID="e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e" containerName="maas-api" containerID="cri-o://4e8b7250c234615c075ee5505638358ae8723e9ddb383dddbc3a23891be5b4ff" gracePeriod=30
Jul 09 19:27:11.364283 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:11.364260    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml"
Jul 09 19:27:11.502608 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:11.502578    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e-openshift-service-ca\") pod \"e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e\" (UID: \"e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e\") "
Jul 09 19:27:11.502791 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:11.502716    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sc86f\" (UniqueName: \"kubernetes.io/projected/e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e-kube-api-access-sc86f\") pod \"e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e\" (UID: \"e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e\") "
Jul 09 19:27:11.502791 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:11.502762    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e-maas-api-tls\") pod \"e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e\" (UID: \"e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e\") "
Jul 09 19:27:11.503005 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:11.502981    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e" (UID: "e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:27:11.504704 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:11.504675    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e" (UID: "e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:27:11.504811 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:11.504711    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e-kube-api-access-sc86f" (OuterVolumeSpecName: "kube-api-access-sc86f") pod "e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e" (UID: "e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e"). InnerVolumeSpecName "kube-api-access-sc86f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:27:11.540708 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:11.540668    2580 generic.go:356] "Generic (PLEG): container finished" podID="e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e" containerID="4e8b7250c234615c075ee5505638358ae8723e9ddb383dddbc3a23891be5b4ff" exitCode=0
Jul 09 19:27:11.540879 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:11.540718    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml"
Jul 09 19:27:11.540879 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:11.540715    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml" event={"ID":"e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e","Type":"ContainerDied","Data":"4e8b7250c234615c075ee5505638358ae8723e9ddb383dddbc3a23891be5b4ff"}
Jul 09 19:27:11.540879 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:11.540857    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml" event={"ID":"e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e","Type":"ContainerDied","Data":"641c1ad88c663f35a0fb1b6c0f3afa2794caca5d5f5911a62f29857d3d34ba65"}
Jul 09 19:27:11.541001 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:11.540888    2580 scope.go:117] "RemoveContainer" containerID="4e8b7250c234615c075ee5505638358ae8723e9ddb383dddbc3a23891be5b4ff"
Jul 09 19:27:11.550047 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:11.550031    2580 scope.go:117] "RemoveContainer" containerID="4e8b7250c234615c075ee5505638358ae8723e9ddb383dddbc3a23891be5b4ff"
Jul 09 19:27:11.550286 ip-10-0-137-236 kubenswrapper[2580]: E0709 19:27:11.550266    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e8b7250c234615c075ee5505638358ae8723e9ddb383dddbc3a23891be5b4ff\": container with ID starting with 4e8b7250c234615c075ee5505638358ae8723e9ddb383dddbc3a23891be5b4ff not found: ID does not exist" containerID="4e8b7250c234615c075ee5505638358ae8723e9ddb383dddbc3a23891be5b4ff"
Jul 09 19:27:11.550335 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:11.550294    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e8b7250c234615c075ee5505638358ae8723e9ddb383dddbc3a23891be5b4ff"} err="failed to get container status \"4e8b7250c234615c075ee5505638358ae8723e9ddb383dddbc3a23891be5b4ff\": rpc error: code = NotFound desc = could not find container \"4e8b7250c234615c075ee5505638358ae8723e9ddb383dddbc3a23891be5b4ff\": container with ID starting with 4e8b7250c234615c075ee5505638358ae8723e9ddb383dddbc3a23891be5b4ff not found: ID does not exist"
Jul 09 19:27:11.563369 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:11.563334    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml"]
Jul 09 19:27:11.565860 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:11.565819    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml"]
Jul 09 19:27:11.604009 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:11.603987    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sc86f\" (UniqueName: \"kubernetes.io/projected/e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e-kube-api-access-sc86f\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:27:11.604009 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:11.604007    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e-maas-api-tls\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:27:11.604132 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:11.604017    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e-openshift-service-ca\") on node \"ip-10-0-137-236.ec2.internal\" DevicePath \"\""
Jul 09 19:27:13.252977 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:13.252943    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e" path="/var/lib/kubelet/pods/e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e/volumes"
Jul 09 19:27:14.350293 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:14.350248    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a966ef-6dd9684949-4b7ml" podUID="e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.45:8443/health\": context deadline exceeded"
Jul 09 19:27:18.763895 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:18.763857    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7447f46df5-zksck_587b4978-b1ca-4e8f-a75b-810c5048d0ca/authorino/0.log"
Jul 09 19:27:24.285286 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:24.285256    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c9d9c8f47-65ldw_31374bb4-4673-4bd5-b031-69446db921c5/copy-manifests/0.log"
Jul 09 19:27:24.299471 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:24.299449    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c9d9c8f47-65ldw_31374bb4-4673-4bd5-b031-69446db921c5/manager/0.log"
Jul 09 19:27:24.912327 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:24.912297    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-65485f9c6f-gnsdz_fd625fef-02d3-473c-bc52-476a24cb898a/maas-api/0.log"
Jul 09 19:27:26.359625 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:26.359590    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7447f46df5-zksck_587b4978-b1ca-4e8f-a75b-810c5048d0ca/authorino/0.log"
Jul 09 19:27:26.720939 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:26.720910    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-sq852_b2f7000c-1dd8-4988-9239-dbb6a865872e/kuadrant-console-plugin/0.log"
Jul 09 19:27:27.200360 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:27.200285    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-h5psj_67632df0-1ade-4fde-9302-2351b7af767e/manager/0.log"
Jul 09 19:27:27.790945 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:27.790909    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86888fb94c-5tcgr_ecf91263-9e9b-4bc9-b372-57c5d7889f03/kube-auth-proxy/0.log"
Jul 09 19:27:29.232592 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:29.232563    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-rpv4g_47d0fc68-96dc-4c7f-9ecb-86dae721117d/main/0.log"
Jul 09 19:27:29.352261 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:29.352230    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-drhds_4f2246ce-a132-4e96-b6c7-1fd3b8ddbfeb/main/0.log"
Jul 09 19:27:36.732996 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:36.732970    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8zclz_493326cf-6bd0-480f-b459-66089efc73c8/global-pull-secret-syncer/0.log"
Jul 09 19:27:36.910383 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:36.910350    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r5584_7c638eb0-3766-4e75-9a1e-5d22fdac873b/konnectivity-agent/0.log"
Jul 09 19:27:36.992753 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:36.992677    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-236.ec2.internal_f3668d4575d5d0e1336d26672db23ccf/haproxy/0.log"
Jul 09 19:27:41.761172 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:41.761136    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7447f46df5-zksck_587b4978-b1ca-4e8f-a75b-810c5048d0ca/authorino/0.log"
Jul 09 19:27:41.851958 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:41.851931    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-sq852_b2f7000c-1dd8-4988-9239-dbb6a865872e/kuadrant-console-plugin/0.log"
Jul 09 19:27:42.177599 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:42.177569    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-h5psj_67632df0-1ade-4fde-9302-2351b7af767e/manager/0.log"
Jul 09 19:27:43.681246 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:43.681219    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_57588778-da98-4438-9740-16acd6e532f7/alertmanager/0.log"
Jul 09 19:27:43.712265 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:43.712240    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_57588778-da98-4438-9740-16acd6e532f7/config-reloader/0.log"
Jul 09 19:27:43.745457 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:43.745426    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_57588778-da98-4438-9740-16acd6e532f7/kube-rbac-proxy-web/0.log"
Jul 09 19:27:43.768670 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:43.768642    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_57588778-da98-4438-9740-16acd6e532f7/kube-rbac-proxy/0.log"
Jul 09 19:27:43.791596 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:43.791574    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_57588778-da98-4438-9740-16acd6e532f7/kube-rbac-proxy-metric/0.log"
Jul 09 19:27:43.814482 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:43.814456    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_57588778-da98-4438-9740-16acd6e532f7/prom-label-proxy/0.log"
Jul 09 19:27:43.838614 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:43.838591    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_57588778-da98-4438-9740-16acd6e532f7/init-config-reloader/0.log"
Jul 09 19:27:43.911818 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:43.911742    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-8k72m_ab88fcea-bfec-4089-a99a-c0d8826fddc7/kube-state-metrics/0.log"
Jul 09 19:27:43.933978 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:43.933956    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-8k72m_ab88fcea-bfec-4089-a99a-c0d8826fddc7/kube-rbac-proxy-main/0.log"
Jul 09 19:27:43.958867 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:43.958800    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-8k72m_ab88fcea-bfec-4089-a99a-c0d8826fddc7/kube-rbac-proxy-self/0.log"
Jul 09 19:27:43.989296 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:43.989274    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7cf5c88d78-gkqb7_1a9511e5-7e16-4392-bbac-a870cdf36731/metrics-server/0.log"
Jul 09 19:27:44.028967 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.028943    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-bk4sn_e3f4de02-9de1-4a96-b990-d8ea76e72bcf/monitoring-plugin/0.log"
Jul 09 19:27:44.179592 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.179519    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j7wdv_41e4d200-0985-42ca-bd82-cd71c81a8751/node-exporter/0.log"
Jul 09 19:27:44.204356 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.204331    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j7wdv_41e4d200-0985-42ca-bd82-cd71c81a8751/kube-rbac-proxy/0.log"
Jul 09 19:27:44.239389 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.239362    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j7wdv_41e4d200-0985-42ca-bd82-cd71c81a8751/init-textfile/0.log"
Jul 09 19:27:44.359551 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.359525    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-ldfdz_7339cea5-78bc-4051-b35a-af9307b1fb4e/kube-rbac-proxy-main/0.log"
Jul 09 19:27:44.382416 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.382392    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-ldfdz_7339cea5-78bc-4051-b35a-af9307b1fb4e/kube-rbac-proxy-self/0.log"
Jul 09 19:27:44.404270 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.404239    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-ldfdz_7339cea5-78bc-4051-b35a-af9307b1fb4e/openshift-state-metrics/0.log"
Jul 09 19:27:44.450418 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.450345    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a34232dd-2f96-4632-b4b3-d942f4f8ad95/prometheus/0.log"
Jul 09 19:27:44.488608 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.488583    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a34232dd-2f96-4632-b4b3-d942f4f8ad95/config-reloader/0.log"
Jul 09 19:27:44.512883 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.512856    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a34232dd-2f96-4632-b4b3-d942f4f8ad95/thanos-sidecar/0.log"
Jul 09 19:27:44.539625 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.539601    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a34232dd-2f96-4632-b4b3-d942f4f8ad95/kube-rbac-proxy-web/0.log"
Jul 09 19:27:44.567314 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.567289    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a34232dd-2f96-4632-b4b3-d942f4f8ad95/kube-rbac-proxy/0.log"
Jul 09 19:27:44.593268 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.593244    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a34232dd-2f96-4632-b4b3-d942f4f8ad95/kube-rbac-proxy-thanos/0.log"
Jul 09 19:27:44.616854 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.616816    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a34232dd-2f96-4632-b4b3-d942f4f8ad95/init-config-reloader/0.log"
Jul 09 19:27:44.648525 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.648495    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-r8q67_995c8aee-eb2a-4982-a139-c799a348e842/prometheus-operator/0.log"
Jul 09 19:27:44.670577 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.670557    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-r8q67_995c8aee-eb2a-4982-a139-c799a348e842/kube-rbac-proxy/0.log"
Jul 09 19:27:44.713660 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.713625    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-hjqf2_9fb288ee-fd54-478a-957f-fc37200a3cdb/prometheus-operator-admission-webhook/0.log"
Jul 09 19:27:44.743119 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.743098    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5968c46dc4-m9rdd_82311880-326a-4676-9cc1-942a47b86e70/telemeter-client/0.log"
Jul 09 19:27:44.768804 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.768781    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5968c46dc4-m9rdd_82311880-326a-4676-9cc1-942a47b86e70/reload/0.log"
Jul 09 19:27:44.793507 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.793485    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5968c46dc4-m9rdd_82311880-326a-4676-9cc1-942a47b86e70/kube-rbac-proxy/0.log"
Jul 09 19:27:44.835874 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.835848    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67c9866758-xqg89_25590d78-0735-4607-b442-97f364905500/thanos-query/0.log"
Jul 09 19:27:44.861589 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.861565    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67c9866758-xqg89_25590d78-0735-4607-b442-97f364905500/kube-rbac-proxy-web/0.log"
Jul 09 19:27:44.885454 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.885433    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67c9866758-xqg89_25590d78-0735-4607-b442-97f364905500/kube-rbac-proxy/0.log"
Jul 09 19:27:44.911411 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.911390    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67c9866758-xqg89_25590d78-0735-4607-b442-97f364905500/prom-label-proxy/0.log"
Jul 09 19:27:44.936963 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.936942    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67c9866758-xqg89_25590d78-0735-4607-b442-97f364905500/kube-rbac-proxy-rules/0.log"
Jul 09 19:27:44.963851 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:44.963769    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67c9866758-xqg89_25590d78-0735-4607-b442-97f364905500/kube-rbac-proxy-metrics/0.log"
Jul 09 19:27:46.548199 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.548166    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qgfk6/perf-node-gather-daemonset-nbxkt"]
Jul 09 19:27:46.548676 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.548652    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90669557-f56b-4603-8e28-abb92a74f515" containerName="maas-api"
Jul 09 19:27:46.548676 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.548672    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="90669557-f56b-4603-8e28-abb92a74f515" containerName="maas-api"
Jul 09 19:27:46.548852 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.548702    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e" containerName="maas-api"
Jul 09 19:27:46.548852 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.548717    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e" containerName="maas-api"
Jul 09 19:27:46.548852 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.548733    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ada951e8-0034-4159-aa24-6c79c1f4c0a4" containerName="main"
Jul 09 19:27:46.548852 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.548739    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ada951e8-0034-4159-aa24-6c79c1f4c0a4" containerName="main"
Jul 09 19:27:46.548852 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.548810    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ada951e8-0034-4159-aa24-6c79c1f4c0a4" containerName="main"
Jul 09 19:27:46.548852 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.548820    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="90669557-f56b-4603-8e28-abb92a74f515" containerName="maas-api"
Jul 09 19:27:46.548852 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.548846    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4dcc7a5-8e99-4b99-8ca5-5649e5065f0e" containerName="maas-api"
Jul 09 19:27:46.553346 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.553329    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-nbxkt"
Jul 09 19:27:46.556084 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.556065    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qgfk6\"/\"openshift-service-ca.crt\""
Jul 09 19:27:46.556197 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.556065    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qgfk6\"/\"kube-root-ca.crt\""
Jul 09 19:27:46.556197 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.556122    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qgfk6\"/\"default-dockercfg-2s96h\""
Jul 09 19:27:46.560668 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.560321    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qgfk6/perf-node-gather-daemonset-nbxkt"]
Jul 09 19:27:46.634560 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.634524    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3-proc\") pod \"perf-node-gather-daemonset-nbxkt\" (UID: \"7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-nbxkt"
Jul 09 19:27:46.634560 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.634563    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3-podres\") pod \"perf-node-gather-daemonset-nbxkt\" (UID: \"7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-nbxkt"
Jul 09 19:27:46.634758 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.634687    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsd9v\" (UniqueName: \"kubernetes.io/projected/7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3-kube-api-access-dsd9v\") pod \"perf-node-gather-daemonset-nbxkt\" (UID: \"7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-nbxkt"
Jul 09 19:27:46.634758 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.634726    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3-sys\") pod \"perf-node-gather-daemonset-nbxkt\" (UID: \"7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-nbxkt"
Jul 09 19:27:46.634758 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.634744    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3-lib-modules\") pod \"perf-node-gather-daemonset-nbxkt\" (UID: \"7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-nbxkt"
Jul 09 19:27:46.736117 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.736085    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3-sys\") pod \"perf-node-gather-daemonset-nbxkt\" (UID: \"7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-nbxkt"
Jul 09 19:27:46.736117 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.736114    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3-lib-modules\") pod \"perf-node-gather-daemonset-nbxkt\" (UID: \"7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-nbxkt"
Jul 09 19:27:46.736334 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.736153    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3-proc\") pod \"perf-node-gather-daemonset-nbxkt\" (UID: \"7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-nbxkt"
Jul 09 19:27:46.736334 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.736185    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3-podres\") pod \"perf-node-gather-daemonset-nbxkt\" (UID: \"7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-nbxkt"
Jul 09 19:27:46.736334 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.736206    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3-sys\") pod \"perf-node-gather-daemonset-nbxkt\" (UID: \"7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-nbxkt"
Jul 09 19:27:46.736334 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.736282    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3-lib-modules\") pod \"perf-node-gather-daemonset-nbxkt\" (UID: \"7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-nbxkt"
Jul 09 19:27:46.736334 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.736286    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3-proc\") pod \"perf-node-gather-daemonset-nbxkt\" (UID: \"7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-nbxkt"
Jul 09 19:27:46.736334 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.736302    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsd9v\" (UniqueName: \"kubernetes.io/projected/7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3-kube-api-access-dsd9v\") pod \"perf-node-gather-daemonset-nbxkt\" (UID: \"7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-nbxkt"
Jul 09 19:27:46.736334 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.736329    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3-podres\") pod \"perf-node-gather-daemonset-nbxkt\" (UID: \"7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-nbxkt"
Jul 09 19:27:46.746022 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.745997    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsd9v\" (UniqueName: \"kubernetes.io/projected/7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3-kube-api-access-dsd9v\") pod \"perf-node-gather-daemonset-nbxkt\" (UID: \"7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3\") " pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-nbxkt"
Jul 09 19:27:46.864943 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:46.864863    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-nbxkt"
Jul 09 19:27:47.003678 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:47.003622    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qgfk6/perf-node-gather-daemonset-nbxkt"]
Jul 09 19:27:47.006078 ip-10-0-137-236 kubenswrapper[2580]: W0709 19:27:47.006039    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7085ac55_dbdb_45cd_a8c7_8c68a27bd5c3.slice/crio-94c035b861b0de32b09df63920dcdbb7d2cc7312967c7670b33fcfa66febf861 WatchSource:0}: Error finding container 94c035b861b0de32b09df63920dcdbb7d2cc7312967c7670b33fcfa66febf861: Status 404 returned error can't find the container with id 94c035b861b0de32b09df63920dcdbb7d2cc7312967c7670b33fcfa66febf861
Jul 09 19:27:47.500361 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:47.500330    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-pnfzt_e1b91068-b1a8-4128-8c0d-59ee1bb15b04/download-server/0.log"
Jul 09 19:27:47.723745 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:47.723711    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-nbxkt" event={"ID":"7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3","Type":"ContainerStarted","Data":"77f6888a1d23f639034ce0d23ee88d46b292528909e9a70a7bb26f38d8e0fc56"}
Jul 09 19:27:47.724166 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:47.723763    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-nbxkt" event={"ID":"7085ac55-dbdb-45cd-a8c7-8c68a27bd5c3","Type":"ContainerStarted","Data":"94c035b861b0de32b09df63920dcdbb7d2cc7312967c7670b33fcfa66febf861"}
Jul 09 19:27:47.724166 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:47.723800    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-nbxkt"
Jul 09 19:27:47.743315 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:47.743269    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-nbxkt" podStartSLOduration=1.7432550249999998 podStartE2EDuration="1.743255025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 19:27:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:27:47.741791816 +0000 UTC m=+2522.951381046" watchObservedRunningTime="2026-07-09 19:27:47.743255025 +0000 UTC m=+2522.952844280"
Jul 09 19:27:49.201760 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:49.201727    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s44qr_a551c810-7d9f-45dc-b952-61a190a39f0a/dns/0.log"
Jul 09 19:27:49.225343 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:49.225321    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s44qr_a551c810-7d9f-45dc-b952-61a190a39f0a/kube-rbac-proxy/0.log"
Jul 09 19:27:49.327648 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:49.327615    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9stx9_fa63441b-d9d3-4572-be55-ce08ce5d3cbe/dns-node-resolver/0.log"
Jul 09 19:27:50.024299 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:50.024271    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kcv9j_c08f64a5-c9f2-4791-9cb0-0e3737d610cf/node-ca/0.log"
Jul 09 19:27:51.163824 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:51.163797    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86888fb94c-5tcgr_ecf91263-9e9b-4bc9-b372-57c5d7889f03/kube-auth-proxy/0.log"
Jul 09 19:27:52.122467 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:52.122432    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pbpbb_936f9fdc-29a0-4383-a5f8-7d3e9ddc4ca3/serve-healthcheck-canary/0.log"
Jul 09 19:27:52.671615 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:52.671585    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-255x7_7e8f2682-e04e-4988-9a54-3b56a2a8d10a/kube-rbac-proxy/0.log"
Jul 09 19:27:52.695627 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:52.695602    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-255x7_7e8f2682-e04e-4988-9a54-3b56a2a8d10a/exporter/0.log"
Jul 09 19:27:52.717914 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:52.717891    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-255x7_7e8f2682-e04e-4988-9a54-3b56a2a8d10a/extractor/0.log"
Jul 09 19:27:53.738293 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:53.738262    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qgfk6/perf-node-gather-daemonset-nbxkt"
Jul 09 19:27:55.485546 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:55.485490    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c9d9c8f47-65ldw_31374bb4-4673-4bd5-b031-69446db921c5/manager/0.log"
Jul 09 19:27:55.504187 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:55.504157    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c9d9c8f47-65ldw_31374bb4-4673-4bd5-b031-69446db921c5/copy-manifests/0.log"
Jul 09 19:27:56.600438 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:56.600415    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86888fb94c-5tcgr_ecf91263-9e9b-4bc9-b372-57c5d7889f03/kube-auth-proxy/0.log"
Jul 09 19:27:57.001742 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:57.001721    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5f9b9fdbf7-9qzph_4dbf2bb5-0fc1-4b67-b23b-58d36014cc53/manager/0.log"
Jul 09 19:27:58.237277 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:27:58.237254    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86888fb94c-5tcgr_ecf91263-9e9b-4bc9-b372-57c5d7889f03/kube-auth-proxy/0.log"
Jul 09 19:28:04.098990 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:28:04.098902    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kqr58_eaa7461d-b281-4e7f-86f0-4caebd6a396d/kube-multus-additional-cni-plugins/0.log"
Jul 09 19:28:04.122925 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:28:04.122898    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kqr58_eaa7461d-b281-4e7f-86f0-4caebd6a396d/egress-router-binary-copy/0.log"
Jul 09 19:28:04.145732 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:28:04.145712    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kqr58_eaa7461d-b281-4e7f-86f0-4caebd6a396d/cni-plugins/0.log"
Jul 09 19:28:04.168613 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:28:04.168593    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kqr58_eaa7461d-b281-4e7f-86f0-4caebd6a396d/bond-cni-plugin/0.log"
Jul 09 19:28:04.191942 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:28:04.191922    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kqr58_eaa7461d-b281-4e7f-86f0-4caebd6a396d/routeoverride-cni/0.log"
Jul 09 19:28:04.217503 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:28:04.217484    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kqr58_eaa7461d-b281-4e7f-86f0-4caebd6a396d/whereabouts-cni-bincopy/0.log"
Jul 09 19:28:04.240159 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:28:04.240140    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kqr58_eaa7461d-b281-4e7f-86f0-4caebd6a396d/whereabouts-cni/0.log"
Jul 09 19:28:04.488843 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:28:04.488808    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lf5c6_311e85d9-feb7-414a-9e8f-ca306874a6f3/kube-multus/0.log"
Jul 09 19:28:04.591110 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:28:04.591088    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-c4kbs_409661cb-d599-4f25-a45b-58c69fd015f8/network-metrics-daemon/0.log"
Jul 09 19:28:04.617513 ip-10-0-137-236 kubenswrapper[2580]: I0709 19:28:04.617493    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-c4kbs_409661cb-d599-4f25-a45b-58c69fd015f8/kube-rbac-proxy/0.log"