Jun 03 01:37:51.765483 ip-10-0-137-62 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jun 03 01:37:51.765497 ip-10-0-137-62 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jun 03 01:37:51.765507 ip-10-0-137-62 systemd[1]: kubelet.service: Failed with result 'resources'.
Jun 03 01:37:51.765841 ip-10-0-137-62 systemd[1]: Failed to start Kubernetes Kubelet.
Jun 03 01:38:01.976940 ip-10-0-137-62 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jun 03 01:38:01.976954 ip-10-0-137-62 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 980fd9e79bd943a7bb151a6b27de4dba --
Jun 03 01:40:30.298978 ip-10-0-137-62 systemd[1]: Starting Kubernetes Kubelet...
Jun 03 01:40:30.808740 ip-10-0-137-62 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 01:40:30.808740 ip-10-0-137-62 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 03 01:40:30.808740 ip-10-0-137-62 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 01:40:30.808740 ip-10-0-137-62 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 03 01:40:30.808740 ip-10-0-137-62 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 01:40:30.809647 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.809539    2577 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 03 01:40:30.813539 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813517    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 01:40:30.813539 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813537    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 01:40:30.813539 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813542    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 01:40:30.813662 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813546    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 01:40:30.813662 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813549    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 01:40:30.813662 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813552    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 01:40:30.813662 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813555    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 01:40:30.813662 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813557    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 01:40:30.813662 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813560    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 01:40:30.813662 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813563    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 01:40:30.813662 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813566    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 01:40:30.813662 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813569    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 01:40:30.813662 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813572    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 01:40:30.813662 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813576    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 01:40:30.813662 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813592    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 01:40:30.813662 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813603    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 01:40:30.813662 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813606    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 01:40:30.813662 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813609    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 01:40:30.813662 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813612    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 01:40:30.813662 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813614    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 01:40:30.813662 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813617    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 01:40:30.813662 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813620    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 01:40:30.814119 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813623    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 01:40:30.814119 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813626    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 01:40:30.814119 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813629    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 01:40:30.814119 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813632    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 01:40:30.814119 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813634    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 01:40:30.814119 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813637    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 01:40:30.814119 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813640    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 01:40:30.814119 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813642    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 01:40:30.814119 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813645    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 01:40:30.814119 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813648    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 01:40:30.814119 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813651    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 01:40:30.814119 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813653    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 01:40:30.814119 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813656    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 01:40:30.814119 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813658    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 01:40:30.814119 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813662    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 01:40:30.814119 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813665    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 01:40:30.814119 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813668    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 01:40:30.814119 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813671    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 01:40:30.814119 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813674    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 01:40:30.814119 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813677    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 01:40:30.814621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813680    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 01:40:30.814621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813682    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 01:40:30.814621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813685    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 01:40:30.814621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813689    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 01:40:30.814621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813693    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 01:40:30.814621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813697    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 01:40:30.814621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813700    2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 01:40:30.814621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813703    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 01:40:30.814621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813706    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 01:40:30.814621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813708    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 01:40:30.814621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813711    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 01:40:30.814621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813714    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 01:40:30.814621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813717    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 01:40:30.814621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813720    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 01:40:30.814621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813723    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 01:40:30.814621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813726    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 01:40:30.814621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813728    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 01:40:30.814621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813732    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 01:40:30.814621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813735    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 01:40:30.815085 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813737    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 01:40:30.815085 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813740    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 01:40:30.815085 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813742    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 01:40:30.815085 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813745    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 01:40:30.815085 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813748    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 01:40:30.815085 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813751    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 01:40:30.815085 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813753    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 01:40:30.815085 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813756    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 01:40:30.815085 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813760    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 01:40:30.815085 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813762    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 01:40:30.815085 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813765    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 01:40:30.815085 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813767    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 01:40:30.815085 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813770    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 01:40:30.815085 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813773    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 01:40:30.815085 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813775    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 01:40:30.815085 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813780    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 01:40:30.815085 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813782    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 01:40:30.815085 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813785    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 01:40:30.815085 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813788    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 01:40:30.815085 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813791    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 01:40:30.815588 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813793    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 01:40:30.815588 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813797    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 01:40:30.815588 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813799    2577 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 01:40:30.815588 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813802    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 01:40:30.815588 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.813805    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 01:40:30.815588 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814265    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 01:40:30.815588 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814271    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 01:40:30.815588 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814274    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 01:40:30.815588 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814277    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 01:40:30.815588 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814280    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 01:40:30.815588 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814282    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 01:40:30.815588 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814285    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 01:40:30.815588 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814288    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 01:40:30.815588 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814290    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 01:40:30.815588 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814293    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 01:40:30.815588 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814296    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 01:40:30.815588 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814299    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 01:40:30.815588 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814302    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 01:40:30.815588 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814305    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 01:40:30.815588 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814309    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 01:40:30.816127 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814312    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 01:40:30.816127 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814314    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 01:40:30.816127 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814317    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 01:40:30.816127 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814320    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 01:40:30.816127 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814323    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 01:40:30.816127 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814328    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 01:40:30.816127 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814330    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 01:40:30.816127 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814333    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 01:40:30.816127 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814336    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 01:40:30.816127 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814339    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 01:40:30.816127 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814342    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 01:40:30.816127 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814352    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 01:40:30.816127 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814355    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 01:40:30.816127 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814358    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 01:40:30.816127 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814360    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 01:40:30.816127 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814363    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 01:40:30.816127 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814367    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 01:40:30.816127 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814371    2577 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 01:40:30.816127 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814374    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 01:40:30.816611 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814377    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 01:40:30.816611 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814380    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 01:40:30.816611 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814383    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 01:40:30.816611 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814386    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 01:40:30.816611 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814390    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 01:40:30.816611 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814393    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 01:40:30.816611 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814396    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 01:40:30.816611 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814398    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 01:40:30.816611 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814401    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 01:40:30.816611 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814403    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 01:40:30.816611 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814407    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 01:40:30.816611 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814409    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 01:40:30.816611 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814412    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 01:40:30.816611 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814415    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 01:40:30.816611 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814418    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 01:40:30.816611 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814421    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 01:40:30.816611 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814423    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 01:40:30.816611 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814426    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 01:40:30.816611 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814429    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 01:40:30.816611 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814431    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 01:40:30.817096 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814434    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 01:40:30.817096 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814437    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 01:40:30.817096 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814439    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 01:40:30.817096 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814442    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 01:40:30.817096 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814445    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 01:40:30.817096 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814453    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 01:40:30.817096 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814456    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 01:40:30.817096 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814459    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 01:40:30.817096 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814461    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 01:40:30.817096 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814464    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 01:40:30.817096 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814467    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 01:40:30.817096 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814469    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 01:40:30.817096 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814473    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 01:40:30.817096 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814475    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 01:40:30.817096 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814478    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 01:40:30.817096 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814480    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 01:40:30.817096 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814483    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 01:40:30.817096 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814485    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 01:40:30.817096 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814488    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 01:40:30.817096 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814490    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 01:40:30.817622 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814493    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 01:40:30.817622 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814495    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 01:40:30.817622 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814498    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 01:40:30.817622 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814501    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 01:40:30.817622 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814504    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 01:40:30.817622 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814507    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 01:40:30.817622 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814510    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 01:40:30.817622 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814513    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 01:40:30.817622 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814515    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 01:40:30.817622 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814518    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 01:40:30.817622 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814520    2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 01:40:30.817622 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.814523    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 01:40:30.817622 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816040    2577 flags.go:64] FLAG: --address="0.0.0.0"
Jun 03 01:40:30.817622 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816052    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 03 01:40:30.817622 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816063    2577 flags.go:64] FLAG: --anonymous-auth="true"
Jun 03 01:40:30.817622 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816068    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 03 01:40:30.817622 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816073    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 03 01:40:30.817622 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816076    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 03 01:40:30.817622 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816081    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 03 01:40:30.817622 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816086    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 03 01:40:30.817622 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816090    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 03 01:40:30.818138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816093    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 03 01:40:30.818138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816096    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 03 01:40:30.818138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816099    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 03 01:40:30.818138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816103    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 03 01:40:30.818138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816106    2577 flags.go:64] FLAG: --cgroup-root=""
Jun 03 01:40:30.818138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816109    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 03 01:40:30.818138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816113    2577 flags.go:64] FLAG: --client-ca-file=""
Jun 03 01:40:30.818138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816116    2577 flags.go:64] FLAG: --cloud-config=""
Jun 03 01:40:30.818138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816119    2577 flags.go:64] FLAG: --cloud-provider="external"
Jun 03 01:40:30.818138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816122    2577 flags.go:64] FLAG: --cluster-dns="[]"
Jun 03 01:40:30.818138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816126    2577 flags.go:64] FLAG: --cluster-domain=""
Jun 03 01:40:30.818138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816129    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 03 01:40:30.818138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816132    2577 flags.go:64] FLAG: --config-dir=""
Jun 03 01:40:30.818138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816136    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 03 01:40:30.818138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816139    2577 flags.go:64] FLAG: --container-log-max-files="5"
Jun 03 01:40:30.818138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816144    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 03 01:40:30.818138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816147    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 03 01:40:30.818138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816151    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 03 01:40:30.818138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816155    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 03 01:40:30.818138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816158    2577 flags.go:64] FLAG: --contention-profiling="false"
Jun 03 01:40:30.818138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816161    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 03 01:40:30.818138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816164    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 03 01:40:30.818138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816167    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 03 01:40:30.818138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816170    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 03 01:40:30.818138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816175    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 03 01:40:30.818775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816178    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 03 01:40:30.818775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816182    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 03 01:40:30.818775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816185    2577 flags.go:64] FLAG: --enable-load-reader="false"
Jun 03 01:40:30.818775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816188    2577 flags.go:64] FLAG: --enable-server="true"
Jun 03 01:40:30.818775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816192    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 03 01:40:30.818775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816197    2577 flags.go:64] FLAG: --event-burst="100"
Jun 03 01:40:30.818775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816200    2577 flags.go:64] FLAG: --event-qps="50"
Jun 03 01:40:30.818775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816204    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 03 01:40:30.818775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816207    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 03 01:40:30.818775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816210    2577 flags.go:64] FLAG: --eviction-hard=""
Jun 03 01:40:30.818775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816214    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 03 01:40:30.818775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816217    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 03 01:40:30.818775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816220    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 03 01:40:30.818775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816224    2577 flags.go:64] FLAG: --eviction-soft=""
Jun 03 01:40:30.818775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816226    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 03 01:40:30.818775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816230    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 03 01:40:30.818775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816233    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 03 01:40:30.818775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816236    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 03 01:40:30.818775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816239    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 03 01:40:30.818775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816242    2577 flags.go:64] FLAG: --fail-swap-on="true"
Jun 03 01:40:30.818775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816245    2577 flags.go:64] FLAG: --feature-gates=""
Jun 03 01:40:30.818775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816249    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 03 01:40:30.818775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816253    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 03 01:40:30.818775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816256    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 03 01:40:30.818775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816260    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 03 01:40:30.819385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816263    2577 flags.go:64] FLAG: --healthz-port="10248"
Jun 03 01:40:30.819385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816266    2577 flags.go:64] FLAG: --help="false"
Jun 03 01:40:30.819385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816270    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-137-62.ec2.internal"
Jun 03 01:40:30.819385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816273    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 03 01:40:30.819385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816276    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 03 01:40:30.819385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816279    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 03 01:40:30.819385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816283    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 03 01:40:30.819385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816287    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 03 01:40:30.819385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816289    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 03 01:40:30.819385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816292    2577 flags.go:64] FLAG: --image-service-endpoint=""
Jun 03 01:40:30.819385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816295    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 03 01:40:30.819385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816299    2577 flags.go:64] FLAG: --kube-api-burst="100"
Jun 03 01:40:30.819385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816302    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 03 01:40:30.819385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816306    2577 flags.go:64] FLAG: --kube-api-qps="50"
Jun 03 01:40:30.819385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816308    2577 flags.go:64] FLAG: --kube-reserved=""
Jun 03 01:40:30.819385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816312    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 03 01:40:30.819385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816315    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 03 01:40:30.819385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816318    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 03 01:40:30.819385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816321    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 03 01:40:30.819385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816324    2577 flags.go:64] FLAG: --lock-file=""
Jun 03 01:40:30.819385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816327    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 03 01:40:30.819385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816331    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 03 01:40:30.819385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816334    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 03 01:40:30.819385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816340    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 03 01:40:30.819979 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816343    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 03 01:40:30.819979 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816346    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 03 01:40:30.819979 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816349    2577 flags.go:64] FLAG: --logging-format="text"
Jun 03 01:40:30.819979 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816353    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 03 01:40:30.819979 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816356    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 03 01:40:30.819979 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816359    2577 flags.go:64] FLAG: --manifest-url=""
Jun 03 01:40:30.819979 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816362    2577 flags.go:64] FLAG: --manifest-url-header=""
Jun 03 01:40:30.819979 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816367    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 03 01:40:30.819979 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816370    2577 flags.go:64] FLAG: --max-open-files="1000000"
Jun 03 01:40:30.819979 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816374    2577 flags.go:64] FLAG: --max-pods="110"
Jun 03 01:40:30.819979 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816377    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 03 01:40:30.819979 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816381    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 03 01:40:30.819979 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816384    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 03 01:40:30.819979 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816387    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 03 01:40:30.819979 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816390    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 03 01:40:30.819979 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816393    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 03 01:40:30.819979 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816396    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 03 01:40:30.819979 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816404    2577 flags.go:64] FLAG: --node-status-max-images="50"
Jun 03 01:40:30.819979 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816407    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 03 01:40:30.819979 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816411    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 03 01:40:30.819979 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816414    2577 flags.go:64] FLAG: --pod-cidr=""
Jun 03 01:40:30.819979 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816417    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983"
Jun 03 01:40:30.819979 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816424    2577 flags.go:64] FLAG: --pod-manifest-path=""
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816427    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816430    2577 flags.go:64] FLAG: --pods-per-core="0"
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816433    2577 flags.go:64] FLAG: --port="10250"
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816436    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816440    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fb7c67b14e3c3dd5"
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816443    2577 flags.go:64] FLAG: --qos-reserved=""
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816446    2577 flags.go:64] FLAG: --read-only-port="10255"
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816450    2577 flags.go:64] FLAG: --register-node="true"
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816453    2577 flags.go:64] FLAG: --register-schedulable="true"
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816456    2577 flags.go:64] FLAG: --register-with-taints=""
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816460    2577 flags.go:64] FLAG: --registry-burst="10"
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816463    2577 flags.go:64] FLAG: --registry-qps="5"
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816466    2577 flags.go:64] FLAG: --reserved-cpus=""
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816469    2577 flags.go:64] FLAG: --reserved-memory=""
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816473    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816477    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816480    2577 flags.go:64] FLAG: --rotate-certificates="false"
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816483    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816486    2577 flags.go:64] FLAG: --runonce="false"
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816489    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816492    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816495    2577 flags.go:64] FLAG: --seccomp-default="false"
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816498    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816501    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816504    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 03 01:40:30.820529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816507    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 03 01:40:30.821186 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816511    2577 flags.go:64] FLAG: --storage-driver-password="root"
Jun 03 01:40:30.821186 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816513    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 03 01:40:30.821186 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816517    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 03 01:40:30.821186 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816520    2577 flags.go:64] FLAG: --storage-driver-user="root"
Jun 03 01:40:30.821186 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816522    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 03 01:40:30.821186 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816526    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 03 01:40:30.821186 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816529    2577 flags.go:64] FLAG: --system-cgroups=""
Jun 03 01:40:30.821186 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816532    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 03 01:40:30.821186 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816538    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 03 01:40:30.821186 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816541    2577 flags.go:64] FLAG: --tls-cert-file=""
Jun 03 01:40:30.821186 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816545    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 03 01:40:30.821186 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816549    2577 flags.go:64] FLAG: --tls-min-version=""
Jun 03 01:40:30.821186 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816552    2577 flags.go:64] FLAG: --tls-private-key-file=""
Jun 03 01:40:30.821186 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816555    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 03 01:40:30.821186 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816558    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 03 01:40:30.821186 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816562    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 03 01:40:30.821186 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816565    2577 flags.go:64] FLAG: --v="2"
Jun 03 01:40:30.821186 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816569    2577 flags.go:64] FLAG: --version="false"
Jun 03 01:40:30.821186 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816574    2577 flags.go:64] FLAG: --vmodule=""
Jun 03 01:40:30.821186 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816588    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 03 01:40:30.821186 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.816592    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 03 01:40:30.821186 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817610    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 01:40:30.821186 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817616    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 01:40:30.821186 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817619    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 01:40:30.821796 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817622    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 01:40:30.821796 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817625    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 01:40:30.821796 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817628    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 01:40:30.821796 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817630    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 01:40:30.821796 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817634    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 01:40:30.821796 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817637    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 01:40:30.821796 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817640    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 01:40:30.821796 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817643    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 01:40:30.821796 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817645    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 01:40:30.821796 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817648    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 01:40:30.821796 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817651    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 01:40:30.821796 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817653    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 01:40:30.821796 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817656    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 01:40:30.821796 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817658    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 01:40:30.821796 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817661    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 01:40:30.821796 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817664    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 01:40:30.821796 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817667    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 01:40:30.821796 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817670    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 01:40:30.821796 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817673    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 01:40:30.821796 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817676    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 01:40:30.822308 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817678    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 01:40:30.822308 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817681    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 01:40:30.822308 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817684    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 01:40:30.822308 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817687    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 01:40:30.822308 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817689    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 01:40:30.822308 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817692    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 01:40:30.822308 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817695    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 01:40:30.822308 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817699    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 01:40:30.822308 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817703    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 01:40:30.822308 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817706    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 01:40:30.822308 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817709    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 01:40:30.822308 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817712    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 01:40:30.822308 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817715    2577 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 01:40:30.822308 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817719    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 01:40:30.822308 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817721    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 01:40:30.822308 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817724    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 01:40:30.822308 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817727    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 01:40:30.822308 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817729    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 01:40:30.822308 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817732    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 01:40:30.822880 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817735    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 01:40:30.822880 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817737    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 01:40:30.822880 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817740    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 01:40:30.822880 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817742    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 01:40:30.822880 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817745    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 01:40:30.822880 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817748    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 01:40:30.822880 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817751    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 01:40:30.822880 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817755    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 01:40:30.822880 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817757    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 01:40:30.822880 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817760    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 01:40:30.822880 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817764    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 01:40:30.822880 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817769    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 01:40:30.822880 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817776    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 01:40:30.822880 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817779    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 01:40:30.822880 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817782    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 01:40:30.822880 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817784    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 01:40:30.822880 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817788    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 01:40:30.822880 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817790    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 01:40:30.822880 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817793    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 01:40:30.822880 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817796    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 01:40:30.823369 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817798    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 01:40:30.823369 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817801    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 01:40:30.823369 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817804    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 01:40:30.823369 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817807    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 01:40:30.823369 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817809    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 01:40:30.823369 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817812    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 01:40:30.823369 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817815    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 01:40:30.823369 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817818    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 01:40:30.823369 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817820    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 01:40:30.823369 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817823    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 01:40:30.823369 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817826    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 01:40:30.823369 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817828    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 01:40:30.823369 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817831    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 01:40:30.823369 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817834    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 01:40:30.823369 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817836    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 01:40:30.823369 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817839    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 01:40:30.823369 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817841    2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 01:40:30.823369 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817844    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 01:40:30.823369 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817846    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 01:40:30.823369 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817849    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 01:40:30.823884 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817851    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 01:40:30.823884 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817854    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 01:40:30.823884 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817857    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 01:40:30.823884 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.817861    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 01:40:30.823884 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.818567    2577 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 03 01:40:30.827663 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.827628    2577 server.go:530] "Kubelet version" kubeletVersion="v1.33.12"
Jun 03 01:40:30.827663 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.827653    2577 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 03 01:40:30.827786 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827713    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 01:40:30.827786 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827719    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 01:40:30.827786 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827723    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 01:40:30.827786 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827726    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 01:40:30.827786 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827730    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 01:40:30.827786 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827733    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 01:40:30.827786 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827736    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 01:40:30.827786 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827739    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 01:40:30.827786 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827744    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 01:40:30.827786 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827748    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 01:40:30.827786 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827752    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 01:40:30.827786 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827756    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 01:40:30.827786 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827759    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 01:40:30.827786 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827761    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 01:40:30.827786 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827764    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 01:40:30.827786 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827768    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 01:40:30.827786 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827770    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 01:40:30.827786 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827773    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 01:40:30.827786 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827776    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 01:40:30.827786 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827779    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 01:40:30.828299 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827782    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 01:40:30.828299 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827784    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 01:40:30.828299 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827788    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 01:40:30.828299 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827790    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 01:40:30.828299 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827793    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 01:40:30.828299 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827796    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 01:40:30.828299 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827799    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 01:40:30.828299 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827802    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 01:40:30.828299 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827804    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 01:40:30.828299 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827808    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 01:40:30.828299 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827811    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 01:40:30.828299 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827813    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 01:40:30.828299 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827817    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 01:40:30.828299 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827821    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 01:40:30.828299 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827826    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 01:40:30.828299 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827830    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 01:40:30.828299 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827833    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 01:40:30.828299 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827836    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 01:40:30.828299 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827839    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 01:40:30.828299 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827841    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 01:40:30.828808 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827844    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 01:40:30.828808 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827846    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 01:40:30.828808 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827849    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 01:40:30.828808 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827851    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 01:40:30.828808 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827854    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 01:40:30.828808 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827856    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 01:40:30.828808 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827859    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 01:40:30.828808 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827861    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 01:40:30.828808 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827864    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 01:40:30.828808 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827866    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 01:40:30.828808 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827870    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 01:40:30.828808 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827872    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 01:40:30.828808 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827875    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 01:40:30.828808 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827878    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 01:40:30.828808 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827881    2577 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 01:40:30.828808 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827884    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 01:40:30.828808 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827886    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 01:40:30.828808 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827889    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 01:40:30.828808 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827894    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 01:40:30.829274 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827901    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 01:40:30.829274 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827905    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 01:40:30.829274 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827910    2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 01:40:30.829274 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827913    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 01:40:30.829274 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827916    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 01:40:30.829274 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827919    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 01:40:30.829274 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827921    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 01:40:30.829274 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827924    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 01:40:30.829274 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827926    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 01:40:30.829274 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827929    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 01:40:30.829274 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827932    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 01:40:30.829274 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827934    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 01:40:30.829274 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827937    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 01:40:30.829274 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827939    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 01:40:30.829274 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827942    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 01:40:30.829274 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827944    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 01:40:30.829274 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827947    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 01:40:30.829274 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827949    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 01:40:30.829274 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827952    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 01:40:30.829765 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827955    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 01:40:30.829765 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827958    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 01:40:30.829765 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827961    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 01:40:30.829765 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827963    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 01:40:30.829765 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827966    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 01:40:30.829765 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827969    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 01:40:30.829765 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827973    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 01:40:30.829765 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.827980    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 01:40:30.829765 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.827987    2577 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 03 01:40:30.829765 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828099    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 01:40:30.829765 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828106    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 01:40:30.829765 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828111    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 01:40:30.829765 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828114    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 01:40:30.829765 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828118    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 01:40:30.829765 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828121    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 01:40:30.830142 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828124    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 01:40:30.830142 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828127    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 01:40:30.830142 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828130    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 01:40:30.830142 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828132    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 01:40:30.830142 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828135    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 01:40:30.830142 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828138    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 01:40:30.830142 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828141    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 01:40:30.830142 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828143    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 01:40:30.830142 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828146    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 01:40:30.830142 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828149    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 01:40:30.830142 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828151    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 01:40:30.830142 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828154    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 01:40:30.830142 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828156    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 01:40:30.830142 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828159    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 01:40:30.830142 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828161    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 01:40:30.830142 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828164    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 01:40:30.830142 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828168    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 01:40:30.830142 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828171    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 01:40:30.830142 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828174    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 01:40:30.830142 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828177    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 01:40:30.830649 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828179    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 01:40:30.830649 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828182    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 01:40:30.830649 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828184    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 01:40:30.830649 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828187    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 01:40:30.830649 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828190    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 01:40:30.830649 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828192    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 01:40:30.830649 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828195    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 01:40:30.830649 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828197    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 01:40:30.830649 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828200    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 01:40:30.830649 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828203    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 01:40:30.830649 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828206    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 01:40:30.830649 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828210    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 01:40:30.830649 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828214    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 01:40:30.830649 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828219    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 01:40:30.830649 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828222    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 01:40:30.830649 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828224    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 01:40:30.830649 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828227    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 01:40:30.830649 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828229    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 01:40:30.830649 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828232    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 01:40:30.830649 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828234    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 01:40:30.831133 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828237    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 01:40:30.831133 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828239    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 01:40:30.831133 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828242    2577 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 01:40:30.831133 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828244    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 01:40:30.831133 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828247    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 01:40:30.831133 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828249    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 01:40:30.831133 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828252    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 01:40:30.831133 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828254    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 01:40:30.831133 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828257    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 01:40:30.831133 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828262    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 01:40:30.831133 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828264    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 01:40:30.831133 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828267    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 01:40:30.831133 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828270    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 01:40:30.831133 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828272    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 01:40:30.831133 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828275    2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 01:40:30.831133 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828277    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 01:40:30.831133 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828281    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 01:40:30.831133 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828283    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 01:40:30.831133 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828286    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 01:40:30.831621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828290    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 01:40:30.831621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828293    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 01:40:30.831621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828296    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 01:40:30.831621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828299    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 01:40:30.831621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828302    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 01:40:30.831621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828305    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 01:40:30.831621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828308    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 01:40:30.831621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828310    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 01:40:30.831621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828313    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 01:40:30.831621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828316    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 01:40:30.831621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828318    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 01:40:30.831621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828321    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 01:40:30.831621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828324    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 01:40:30.831621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828326    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 01:40:30.831621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828329    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 01:40:30.831621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828331    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 01:40:30.831621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828334    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 01:40:30.831621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828336    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 01:40:30.831621 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828339    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 01:40:30.832077 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828341    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 01:40:30.832077 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:30.828344    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 01:40:30.832077 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.828349    2577 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 03 01:40:30.832077 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.829255    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 03 01:40:30.836715 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.836699    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 03 01:40:30.838115 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.838103    2577 server.go:1019] "Starting client certificate rotation"
Jun 03 01:40:30.838238 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.838219    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 03 01:40:30.838273 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.838257    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 03 01:40:30.869432 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.869408    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 03 01:40:30.871295 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.871272    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 03 01:40:30.888006 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.887975    2577 log.go:25] "Validated CRI v1 runtime API"
Jun 03 01:40:30.895257 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.895234    2577 log.go:25] "Validated CRI v1 image API"
Jun 03 01:40:30.897748 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.897724    2577 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 03 01:40:30.898179 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.898162    2577 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 03 01:40:30.903624 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.903598    2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c0e7cd0d-bd5a-493f-a6ca-916b35e37fb1:/dev/nvme0n1p3 cbe5423e-d6c6-4240-9f2c-fd6f91a954ad:/dev/nvme0n1p4]
Jun 03 01:40:30.903702 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.903623    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 03 01:40:30.908097 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.907980    2577 manager.go:217] Machine: {Timestamp:2026-06-03 01:40:30.907445559 +0000 UTC m=+0.471841360 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100439 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fbed8739d40d0e6651cc8ce404ae4 SystemUUID:ec2fbed8-739d-40d0-e665-1cc8ce404ae4 BootID:980fd9e7-9bd9-43a7-bb15-1a6b27de4dba Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:97:db:de:6c:e7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:97:db:de:6c:e7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:e4:25:6c:35:08 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 03 01:40:30.909821 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.909807    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 03 01:40:30.909960 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.909946    2577 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 03 01:40:30.911905 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.911880    2577 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 03 01:40:30.912058 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.911907    2577 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-62.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 03 01:40:30.912107 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.912067    2577 topology_manager.go:138] "Creating topology manager with none policy"
Jun 03 01:40:30.912107 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.912076    2577 container_manager_linux.go:306] "Creating device plugin manager"
Jun 03 01:40:30.912107 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.912083    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 03 01:40:30.913019 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.913007    2577 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 03 01:40:30.915190 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.915176    2577 state_mem.go:36] "Initialized new in-memory state store"
Jun 03 01:40:30.915311 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.915302    2577 server.go:1267] "Using root directory" path="/var/lib/kubelet"
Jun 03 01:40:30.918210 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.918198    2577 kubelet.go:491] "Attempting to sync node with API server"
Jun 03 01:40:30.918246 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.918220    2577 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 03 01:40:30.918246 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.918237    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 03 01:40:30.918246 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.918247    2577 kubelet.go:397] "Adding apiserver pod source"
Jun 03 01:40:30.918357 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.918265    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 03 01:40:30.919676 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.919663    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 03 01:40:30.919733 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.919683    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 03 01:40:30.923249 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.923228    2577 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1"
Jun 03 01:40:30.925272 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.925254    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ktz8c"
Jun 03 01:40:30.925637 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.925623    2577 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 03 01:40:30.927784 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.927771    2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 03 01:40:30.927827 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.927789    2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 03 01:40:30.927827 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.927796    2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 03 01:40:30.927827 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.927801    2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 03 01:40:30.927827 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.927810    2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 03 01:40:30.927827 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.927817    2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 03 01:40:30.927827 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.927824    2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 03 01:40:30.928001 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.927831    2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 03 01:40:30.928001 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.927839    2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 03 01:40:30.928001 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.927846    2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 03 01:40:30.928001 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.927863    2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 03 01:40:30.928001 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.927869    2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 03 01:40:30.928616 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:30.928597    2577 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-62.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 03 01:40:30.928751 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.928738    2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 03 01:40:30.928794 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.928755    2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 03 01:40:30.928838 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:30.928804    2577 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 03 01:40:30.931894 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.931879    2577 watchdog_linux.go:99] "Systemd watchdog is not enabled"
Jun 03 01:40:30.931981 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.931917    2577 server.go:1295] "Started kubelet"
Jun 03 01:40:30.932092 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.932027    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 03 01:40:30.932145 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.932040    2577 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 03 01:40:30.932145 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.932131    2577 server_v1.go:47] "podresources" method="list" useActivePods=true
Jun 03 01:40:30.932657 ip-10-0-137-62 systemd[1]: Started Kubernetes Kubelet.
Jun 03 01:40:30.935519 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.935496    2577 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 03 01:40:30.935748 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.935732    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ktz8c"
Jun 03 01:40:30.937249 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.937232    2577 server.go:317] "Adding debug handlers to kubelet server"
Jun 03 01:40:30.943594 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.943562    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 03 01:40:30.943702 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.943576    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 03 01:40:30.943702 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.943674    2577 volume_manager.go:295] "The desired_state_of_world populator starts"
Jun 03 01:40:30.943702 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.943687    2577 volume_manager.go:297] "Starting Kubelet Volume Manager"
Jun 03 01:40:30.943895 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.943740    2577 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
Jun 03 01:40:30.944029 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.944015    2577 reconstruct.go:97] "Volume reconstruction finished"
Jun 03 01:40:30.944074 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.944031    2577 reconciler.go:26] "Reconciler: start to sync state"
Jun 03 01:40:30.944452 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.944436    2577 factory.go:55] Registering systemd factory
Jun 03 01:40:30.944523 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:30.944491    2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Jun 03 01:40:30.944523 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.944504    2577 factory.go:223] Registration of the systemd container factory successfully
Jun 03 01:40:30.944729 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.944716    2577 factory.go:153] Registering CRI-O factory
Jun 03 01:40:30.944790 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.944732    2577 factory.go:223] Registration of the crio container factory successfully
Jun 03 01:40:30.944849 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.944837    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 03 01:40:30.944898 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.944867    2577 factory.go:103] Registering Raw factory
Jun 03 01:40:30.944898 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.944897    2577 manager.go:1196] Started watching for new ooms in manager
Jun 03 01:40:30.945312 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.945297    2577 manager.go:319] Starting recovery of all containers
Jun 03 01:40:30.945612 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:30.945558    2577 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 03 01:40:30.946850 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.946828    2577 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 01:40:30.950248 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:30.950223    2577 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-62.ec2.internal\" not found" node="ip-10-0-137-62.ec2.internal"
Jun 03 01:40:30.950332 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.950287    2577 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-62.ec2.internal" not found
Jun 03 01:40:30.954638 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.954622    2577 manager.go:324] Recovery completed
Jun 03 01:40:30.958608 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.958594    2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 01:40:30.960491 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.960473    2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 01:40:30.960544 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.960505    2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 01:40:30.960544 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.960516    2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Jun 03 01:40:30.961028 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.961012    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 03 01:40:30.961113 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.961028    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 03 01:40:30.961113 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.961058    2577 state_mem.go:36] "Initialized new in-memory state store"
Jun 03 01:40:30.965012 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.964996    2577 policy_none.go:49] "None policy: Start"
Jun 03 01:40:30.965094 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.965016    2577 memory_manager.go:186] "Starting memorymanager" policy="None"
Jun 03 01:40:30.965094 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.965029    2577 state_mem.go:35] "Initializing new in-memory state store"
Jun 03 01:40:30.967248 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:30.967226    2577 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-62.ec2.internal" not found
Jun 03 01:40:31.023184 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.011479    2577 manager.go:341] "Starting Device Plugin manager"
Jun 03 01:40:31.023184 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:31.011511    2577 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 03 01:40:31.023184 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.011521    2577 server.go:85] "Starting device plugin registration server"
Jun 03 01:40:31.023184 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.011833    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 03 01:40:31.023184 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.011847    2577 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 03 01:40:31.023184 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.011941    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 03 01:40:31.023184 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.012055    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 03 01:40:31.023184 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.012063    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 03 01:40:31.023184 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:31.012551    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 03 01:40:31.023184 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:31.012610    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-62.ec2.internal\" not found"
Jun 03 01:40:31.027666 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.027643    2577 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-62.ec2.internal" not found
Jun 03 01:40:31.072471 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.072385    2577 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
Jun 03 01:40:31.073566 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.073552    2577 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
Jun 03 01:40:31.073680 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.073589    2577 status_manager.go:230] "Starting to sync pod status with apiserver"
Jun 03 01:40:31.073680 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.073612    2577 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 03 01:40:31.073680 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.073621    2577 kubelet.go:2451] "Starting kubelet main sync loop"
Jun 03 01:40:31.073680 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:31.073659    2577 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 03 01:40:31.079242 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.079219    2577 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 01:40:31.112297 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.112267    2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 01:40:31.113440 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.113417    2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 01:40:31.113545 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.113449    2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 01:40:31.113545 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.113460    2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Jun 03 01:40:31.113545 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.113491    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-62.ec2.internal"
Jun 03 01:40:31.124857 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.124838    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-62.ec2.internal"
Jun 03 01:40:31.124934 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:31.124866    2577 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-62.ec2.internal\": node \"ip-10-0-137-62.ec2.internal\" not found"
Jun 03 01:40:31.142622 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:31.142575    2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Jun 03 01:40:31.173886 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.173842    2577 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"]
Jun 03 01:40:31.173977 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.173940    2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 01:40:31.174906 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.174890    2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 01:40:31.174992 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.174924    2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 01:40:31.174992 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.174938    2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Jun 03 01:40:31.176014 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.175998    2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 01:40:31.176144 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.176130    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Jun 03 01:40:31.176186 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.176159    2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 01:40:31.176682 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.176666    2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 01:40:31.176761 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.176693    2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 01:40:31.176761 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.176704    2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Jun 03 01:40:31.176861 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.176777    2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 01:40:31.176861 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.176807    2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 01:40:31.176861 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.176822    2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Jun 03 01:40:31.177818 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.177802    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"
Jun 03 01:40:31.177893 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.177830    2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 01:40:31.178455 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.178441    2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 01:40:31.178509 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.178460    2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 01:40:31.178509 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.178471    2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Jun 03 01:40:31.200427 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:31.200401    2577 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-62.ec2.internal\" not found" node="ip-10-0-137-62.ec2.internal"
Jun 03 01:40:31.205168 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:31.205150    2577 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-62.ec2.internal\" not found" node="ip-10-0-137-62.ec2.internal"
Jun 03 01:40:31.243328 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:31.243301    2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Jun 03 01:40:31.245549 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.245533    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3803111852fe7b3fb1e052a82492729c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal\" (UID: \"3803111852fe7b3fb1e052a82492729c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Jun 03 01:40:31.245614 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.245557    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3803111852fe7b3fb1e052a82492729c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal\" (UID: \"3803111852fe7b3fb1e052a82492729c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Jun 03 01:40:31.245614 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.245577    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b352523aa1133bdddd102a34c42e047b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-62.ec2.internal\" (UID: \"b352523aa1133bdddd102a34c42e047b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"
Jun 03 01:40:31.343793 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:31.343729    2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Jun 03 01:40:31.345985 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.345962    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b352523aa1133bdddd102a34c42e047b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-62.ec2.internal\" (UID: \"b352523aa1133bdddd102a34c42e047b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"
Jun 03 01:40:31.346033 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.345995    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3803111852fe7b3fb1e052a82492729c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal\" (UID: \"3803111852fe7b3fb1e052a82492729c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Jun 03 01:40:31.346033 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.346014    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3803111852fe7b3fb1e052a82492729c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal\" (UID: \"3803111852fe7b3fb1e052a82492729c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Jun 03 01:40:31.346093 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.346057    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b352523aa1133bdddd102a34c42e047b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-62.ec2.internal\" (UID: \"b352523aa1133bdddd102a34c42e047b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"
Jun 03 01:40:31.346125 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.346105    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3803111852fe7b3fb1e052a82492729c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal\" (UID: \"3803111852fe7b3fb1e052a82492729c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Jun 03 01:40:31.346159 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.346124    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3803111852fe7b3fb1e052a82492729c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal\" (UID: \"3803111852fe7b3fb1e052a82492729c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Jun 03 01:40:31.444454 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:31.444404    2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Jun 03 01:40:31.502741 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.502713    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Jun 03 01:40:31.508562 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.508543    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"
Jun 03 01:40:31.545194 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:31.545162    2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Jun 03 01:40:31.645628 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:31.645598    2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Jun 03 01:40:31.746041 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:31.745995    2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Jun 03 01:40:31.837489 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.837440    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 03 01:40:31.838178 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.837675    2577 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 03 01:40:31.838178 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.837675    2577 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 03 01:40:31.846789 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:31.846763    2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Jun 03 01:40:31.880553 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.880525    2577 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 01:40:31.919364 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.919261    2577 apiserver.go:52] "Watching apiserver"
Jun 03 01:40:31.929022 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.928993    2577 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 03 01:40:31.930348 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.930327    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj","openshift-multus/multus-gmwmw","openshift-multus/network-metrics-daemon-zwwq7","openshift-network-operator/iptables-alerter-bdxf9","openshift-cluster-node-tuning-operator/tuned-b268x","openshift-dns/node-resolver-j6knj","openshift-image-registry/node-ca-kq6lz","openshift-multus/multus-additional-cni-plugins-cd5c9","openshift-network-diagnostics/network-check-target-hcml4","openshift-ovn-kubernetes/ovnkube-node-qtd96","kube-system/konnectivity-agent-9p5l6"]
Jun 03 01:40:31.932934 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.932904    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj"
Jun 03 01:40:31.935434 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.935411    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 03 01:40:31.935536 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.935516    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6nbmn\""
Jun 03 01:40:31.935536 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.935524    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 03 01:40:31.935672 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.935571    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 03 01:40:31.935863 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.935849    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:31.937832 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.937807    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 03 01:40:31.937929 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.937850    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 03 01:40:31.937988 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.937981    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qjpvl\""
Jun 03 01:40:31.938040 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.937984    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 03 01:40:31.938089 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.938060    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:40:31.938128 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.938117    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 03 01:40:31.938160 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:31.938145    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwwq7" podUID="212f3e8b-a98d-4191-a9b8-b42694d05b21"
Jun 03 01:40:31.938240 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.938217    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 01:35:30 +0000 UTC" deadline="2027-11-25 18:00:33.313009602 +0000 UTC"
Jun 03 01:40:31.938278 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.938240    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12976h20m1.374771728s"
Jun 03 01:40:31.940311 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.940294    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bdxf9"
Jun 03 01:40:31.942310 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.942291    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:31.942576 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.942554    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 03 01:40:31.942723 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.942706    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 03 01:40:31.942770 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.942735    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tqcnl\""
Jun 03 01:40:31.943958 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.943941    2577 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Jun 03 01:40:31.944033 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.943958    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 03 01:40:31.944279 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.944258    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j6knj"
Jun 03 01:40:31.944386 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.944298    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 03 01:40:31.944386 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.944325    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4nwjk\""
Jun 03 01:40:31.944490 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.944406    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 03 01:40:31.944524 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.944499    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 03 01:40:31.946336 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.946318    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 03 01:40:31.946429 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.946386    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kq6lz"
Jun 03 01:40:31.946661 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.946596    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 03 01:40:31.947217 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.947201    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hv2mw\""
Jun 03 01:40:31.948261 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.948240    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 03 01:40:31.948340 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.948318    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vpv4k\""
Jun 03 01:40:31.948403 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.948376    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:31.948708 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.948691    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 03 01:40:31.948767 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.948755    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 03 01:40:31.949092 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949056    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs\") pod \"network-metrics-daemon-zwwq7\" (UID: \"212f3e8b-a98d-4191-a9b8-b42694d05b21\") " pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:40:31.949092 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949084    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8739a591-8c31-4586-94c5-12095870e6b0-host-slash\") pod \"iptables-alerter-bdxf9\" (UID: \"8739a591-8c31-4586-94c5-12095870e6b0\") " pod="openshift-network-operator/iptables-alerter-bdxf9"
Jun 03 01:40:31.949226 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949101    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-etc-sysconfig\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:31.949226 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949123    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-sys\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:31.949226 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949150    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-lib-modules\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:31.949226 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949173    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8152c872-c23d-4010-8ec1-2c288385de45-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qw7cj\" (UID: \"8152c872-c23d-4010-8ec1-2c288385de45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj"
Jun 03 01:40:31.949226 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949209    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-os-release\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:31.949465 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949238    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-host-run-netns\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:31.949465 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949268    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-etc-modprobe-d\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:31.949465 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949287    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-etc-kubernetes\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:31.949465 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949327    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-host\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:31.949465 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949358    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fd36a345-5628-409d-9024-eed1daad505b-hosts-file\") pod \"node-resolver-j6knj\" (UID: \"fd36a345-5628-409d-9024-eed1daad505b\") " pod="openshift-dns/node-resolver-j6knj"
Jun 03 01:40:31.949465 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949384    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl2qz\" (UniqueName: \"kubernetes.io/projected/fd36a345-5628-409d-9024-eed1daad505b-kube-api-access-tl2qz\") pod \"node-resolver-j6knj\" (UID: \"fd36a345-5628-409d-9024-eed1daad505b\") " pod="openshift-dns/node-resolver-j6knj"
Jun 03 01:40:31.949465 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949411    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwtbh\" (UniqueName: \"kubernetes.io/projected/8152c872-c23d-4010-8ec1-2c288385de45-kube-api-access-qwtbh\") pod \"aws-ebs-csi-driver-node-qw7cj\" (UID: \"8152c872-c23d-4010-8ec1-2c288385de45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj"
Jun 03 01:40:31.949465 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949434    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-host-var-lib-kubelet\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:31.949465 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949460    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z887p\" (UniqueName: \"kubernetes.io/projected/8739a591-8c31-4586-94c5-12095870e6b0-kube-api-access-z887p\") pod \"iptables-alerter-bdxf9\" (UID: \"8739a591-8c31-4586-94c5-12095870e6b0\") " pod="openshift-network-operator/iptables-alerter-bdxf9"
Jun 03 01:40:31.949970 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949491    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-etc-systemd\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:31.949970 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949515    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp2fr\" (UniqueName: \"kubernetes.io/projected/2cb78b80-9f75-43bc-8da9-120411d117ab-kube-api-access-jp2fr\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:31.949970 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949559    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8152c872-c23d-4010-8ec1-2c288385de45-sys-fs\") pod \"aws-ebs-csi-driver-node-qw7cj\" (UID: \"8152c872-c23d-4010-8ec1-2c288385de45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj"
Jun 03 01:40:31.949970 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949652    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30eae78c-3802-46f5-a21a-c3f9fd825044-cni-binary-copy\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:31.949970 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949693    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-multus-conf-dir\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:31.949970 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949735    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-host-run-multus-certs\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:31.949970 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949760    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-etc-kubernetes\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:31.949970 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949791    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cb78b80-9f75-43bc-8da9-120411d117ab-tmp\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:31.949970 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949813    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8152c872-c23d-4010-8ec1-2c288385de45-device-dir\") pod \"aws-ebs-csi-driver-node-qw7cj\" (UID: \"8152c872-c23d-4010-8ec1-2c288385de45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj"
Jun 03 01:40:31.949970 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949836    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-multus-cni-dir\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:31.949970 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949859    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-cnibin\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:31.949970 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949883    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-multus-socket-dir-parent\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:31.949970 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949907    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-etc-sysctl-d\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:31.949970 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949929    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-run\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:31.949970 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949964    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8152c872-c23d-4010-8ec1-2c288385de45-registration-dir\") pod \"aws-ebs-csi-driver-node-qw7cj\" (UID: \"8152c872-c23d-4010-8ec1-2c288385de45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj"
Jun 03 01:40:31.950566 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.949991    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-host-var-lib-cni-bin\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:31.950566 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.950009    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-host-var-lib-cni-multus\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:31.950566 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.950030    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-hostroot\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:31.950566 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.950064    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rr2x\" (UniqueName: \"kubernetes.io/projected/30eae78c-3802-46f5-a21a-c3f9fd825044-kube-api-access-8rr2x\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:31.950566 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.950093    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4sqg\" (UniqueName: \"kubernetes.io/projected/212f3e8b-a98d-4191-a9b8-b42694d05b21-kube-api-access-x4sqg\") pod \"network-metrics-daemon-zwwq7\" (UID: \"212f3e8b-a98d-4191-a9b8-b42694d05b21\") " pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:40:31.950566 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.950148    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2cb78b80-9f75-43bc-8da9-120411d117ab-etc-tuned\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:31.950566 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.950187    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd36a345-5628-409d-9024-eed1daad505b-tmp-dir\") pod \"node-resolver-j6knj\" (UID: \"fd36a345-5628-409d-9024-eed1daad505b\") " pod="openshift-dns/node-resolver-j6knj"
Jun 03 01:40:31.950566 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.950209    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8152c872-c23d-4010-8ec1-2c288385de45-etc-selinux\") pod \"aws-ebs-csi-driver-node-qw7cj\" (UID: \"8152c872-c23d-4010-8ec1-2c288385de45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj"
Jun 03 01:40:31.950566 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.950242    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-system-cni-dir\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:31.950566 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.950284    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8739a591-8c31-4586-94c5-12095870e6b0-iptables-alerter-script\") pod \"iptables-alerter-bdxf9\" (UID: \"8739a591-8c31-4586-94c5-12095870e6b0\") " pod="openshift-network-operator/iptables-alerter-bdxf9"
Jun 03 01:40:31.950566 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.950307    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-etc-sysctl-conf\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:31.950566 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.950331    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-var-lib-kubelet\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:31.950566 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.950369    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8152c872-c23d-4010-8ec1-2c288385de45-socket-dir\") pod \"aws-ebs-csi-driver-node-qw7cj\" (UID: \"8152c872-c23d-4010-8ec1-2c288385de45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj"
Jun 03 01:40:31.950566 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.950403    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-host-run-k8s-cni-cncf-io\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:31.950566 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.950431    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/30eae78c-3802-46f5-a21a-c3f9fd825044-multus-daemon-config\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:31.951180 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.950646    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8dvff\""
Jun 03 01:40:31.951180 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.950667    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:40:31.951180 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.950695    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 03 01:40:31.951180 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:31.950734    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcml4" podUID="0843251b-e289-4bda-abcc-d9d49b1d2d00"
Jun 03 01:40:31.951180 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.950918    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 03 01:40:31.953433 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.953406    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:31.954551 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.954536    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 03 01:40:31.954639 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.954613    2577 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"
Jun 03 01:40:31.955590 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.955556    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 03 01:40:31.955722 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.955697    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 03 01:40:31.955767 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.955758    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4b4gr\""
Jun 03 01:40:31.955825 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.955811    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 03 01:40:31.955874 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.955826    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 03 01:40:31.955874 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.955835    2577 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 03 01:40:31.958087 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.956210    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"]
Jun 03 01:40:31.958087 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.956233    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 03 01:40:31.958087 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.956312    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9p5l6"
Jun 03 01:40:31.958087 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.956664    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 03 01:40:31.958976 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.958958    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 03 01:40:31.959179 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.959163    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 03 01:40:31.959256 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.959164    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rq42d\""
Jun 03 01:40:31.960853 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.960834    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 03 01:40:31.961077 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.961062    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"]
Jun 03 01:40:31.974853 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.974829    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cqwrb"
Jun 03 01:40:31.982170 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:31.982141    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cqwrb"
Jun 03 01:40:32.026168 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.026139    2577 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 01:40:32.030161 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:32.030136    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3803111852fe7b3fb1e052a82492729c.slice/crio-03f0b19d30aca17eb04a18c3e21cd8a34e2ea91b458f9dab00ec8050107bbda6 WatchSource:0}: Error finding container 03f0b19d30aca17eb04a18c3e21cd8a34e2ea91b458f9dab00ec8050107bbda6: Status 404 returned error can't find the container with id 03f0b19d30aca17eb04a18c3e21cd8a34e2ea91b458f9dab00ec8050107bbda6
Jun 03 01:40:32.030500 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:32.030479    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb352523aa1133bdddd102a34c42e047b.slice/crio-2f4bbc2055b88011c0615e2b6efcdf30a08f388dc2bcbb7678750ca953a56651 WatchSource:0}: Error finding container 2f4bbc2055b88011c0615e2b6efcdf30a08f388dc2bcbb7678750ca953a56651: Status 404 returned error can't find the container with id 2f4bbc2055b88011c0615e2b6efcdf30a08f388dc2bcbb7678750ca953a56651
Jun 03 01:40:32.036123 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.036106    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 01:40:32.044541 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.044520    2577 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
Jun 03 01:40:32.051102 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.050876    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-host-var-lib-cni-multus\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.051102 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.050930    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15-cnibin\") pod \"multus-additional-cni-plugins-cd5c9\" (UID: \"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15\") " pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:32.051102 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.050956    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cd5c9\" (UID: \"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15\") " pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:32.051102 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051000    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15-cni-binary-copy\") pod \"multus-additional-cni-plugins-cd5c9\" (UID: \"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15\") " pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:32.051102 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051024    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8152c872-c23d-4010-8ec1-2c288385de45-etc-selinux\") pod \"aws-ebs-csi-driver-node-qw7cj\" (UID: \"8152c872-c23d-4010-8ec1-2c288385de45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj"
Jun 03 01:40:32.051102 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051047    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-system-cni-dir\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.051102 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051084    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-run-systemd\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.051102 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051106    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-log-socket\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.051707 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051156    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-var-lib-kubelet\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.051707 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051180    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8152c872-c23d-4010-8ec1-2c288385de45-socket-dir\") pod \"aws-ebs-csi-driver-node-qw7cj\" (UID: \"8152c872-c23d-4010-8ec1-2c288385de45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj"
Jun 03 01:40:32.051707 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051204    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-host-run-k8s-cni-cncf-io\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.051707 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051249    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-systemd-units\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.051707 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051283    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-host-run-netns\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.051707 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051342    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-host-cni-bin\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.051707 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051367    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwvrb\" (UniqueName: \"kubernetes.io/projected/6dd7eb65-6fd1-4d72-a705-68df80e3c9f9-kube-api-access-cwvrb\") pod \"node-ca-kq6lz\" (UID: \"6dd7eb65-6fd1-4d72-a705-68df80e3c9f9\") " pod="openshift-image-registry/node-ca-kq6lz"
Jun 03 01:40:32.051707 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051414    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs\") pod \"network-metrics-daemon-zwwq7\" (UID: \"212f3e8b-a98d-4191-a9b8-b42694d05b21\") " pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:40:32.051707 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051442    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-os-release\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.051707 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051487    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15-os-release\") pod \"multus-additional-cni-plugins-cd5c9\" (UID: \"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15\") " pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:32.051707 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051512    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-host-kubelet\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.051707 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051553    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b49da4f9-9aed-4820-9908-ced2843a97f6-ovnkube-config\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.051707 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051606    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b49da4f9-9aed-4820-9908-ced2843a97f6-env-overrides\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.051707 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051633    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-multus-conf-dir\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.051707 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051656    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-host-run-multus-certs\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.051707 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051678    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8152c872-c23d-4010-8ec1-2c288385de45-socket-dir\") pod \"aws-ebs-csi-driver-node-qw7cj\" (UID: \"8152c872-c23d-4010-8ec1-2c288385de45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj"
Jun 03 01:40:32.052441 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051721    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-etc-kubernetes\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.052441 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051765    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-etc-kubernetes\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.052441 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051782    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8152c872-c23d-4010-8ec1-2c288385de45-etc-selinux\") pod \"aws-ebs-csi-driver-node-qw7cj\" (UID: \"8152c872-c23d-4010-8ec1-2c288385de45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj"
Jun 03 01:40:32.052441 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051792    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-host\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.052441 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051838    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fd36a345-5628-409d-9024-eed1daad505b-hosts-file\") pod \"node-resolver-j6knj\" (UID: \"fd36a345-5628-409d-9024-eed1daad505b\") " pod="openshift-dns/node-resolver-j6knj"
Jun 03 01:40:32.052441 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051836    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-system-cni-dir\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.052441 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051869    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.052441 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051915    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-var-lib-kubelet\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.052441 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051894    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b49da4f9-9aed-4820-9908-ced2843a97f6-ovnkube-script-lib\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.052441 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.051957    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-etc-systemd\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.052441 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052008    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp2fr\" (UniqueName: \"kubernetes.io/projected/2cb78b80-9f75-43bc-8da9-120411d117ab-kube-api-access-jp2fr\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.052441 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052034    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8152c872-c23d-4010-8ec1-2c288385de45-sys-fs\") pod \"aws-ebs-csi-driver-node-qw7cj\" (UID: \"8152c872-c23d-4010-8ec1-2c288385de45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj"
Jun 03 01:40:32.052441 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052080    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cd5c9\" (UID: \"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15\") " pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:32.052441 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052096    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-host-run-k8s-cni-cncf-io\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.052441 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052135    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-var-lib-openvswitch\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.052441 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:32.052243    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:40:32.052441 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052347    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-os-release\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.052441 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052404    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-host-var-lib-cni-multus\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.053220 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052393    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fd36a345-5628-409d-9024-eed1daad505b-hosts-file\") pod \"node-resolver-j6knj\" (UID: \"fd36a345-5628-409d-9024-eed1daad505b\") " pod="openshift-dns/node-resolver-j6knj"
Jun 03 01:40:32.053220 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052439    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-etc-kubernetes\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.053220 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052489    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-multus-conf-dir\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.053220 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052499    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-etc-kubernetes\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.053220 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052523    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-node-log\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.053220 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052554    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-etc-systemd\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.053220 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052616    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8152c872-c23d-4010-8ec1-2c288385de45-sys-fs\") pod \"aws-ebs-csi-driver-node-qw7cj\" (UID: \"8152c872-c23d-4010-8ec1-2c288385de45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj"
Jun 03 01:40:32.053220 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052626    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-host\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.053220 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:32.052647    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs podName:212f3e8b-a98d-4191-a9b8-b42694d05b21 nodeName:}" failed. No retries permitted until 2026-06-03 01:40:32.552622042 +0000 UTC m=+2.117017839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs") pod "network-metrics-daemon-zwwq7" (UID: "212f3e8b-a98d-4191-a9b8-b42694d05b21") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:40:32.053220 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052665    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-multus-cni-dir\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.053220 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052672    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-host-run-multus-certs\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.053220 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052553    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-multus-cni-dir\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.053220 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052721    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-cnibin\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.053220 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052746    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-multus-socket-dir-parent\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.053220 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052790    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83550fed-8052-46ad-b704-1a9b1b977d04-konnectivity-ca\") pod \"konnectivity-agent-9p5l6\" (UID: \"83550fed-8052-46ad-b704-1a9b1b977d04\") " pod="kube-system/konnectivity-agent-9p5l6"
Jun 03 01:40:32.053220 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052840    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-run\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.053220 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052866    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8152c872-c23d-4010-8ec1-2c288385de45-registration-dir\") pod \"aws-ebs-csi-driver-node-qw7cj\" (UID: \"8152c872-c23d-4010-8ec1-2c288385de45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj"
Jun 03 01:40:32.054068 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052878    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-multus-socket-dir-parent\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.054068 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052939    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-run\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.054068 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052947    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-cnibin\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.054068 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.052985    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8152c872-c23d-4010-8ec1-2c288385de45-registration-dir\") pod \"aws-ebs-csi-driver-node-qw7cj\" (UID: \"8152c872-c23d-4010-8ec1-2c288385de45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj"
Jun 03 01:40:32.054068 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.053064    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-hostroot\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.054068 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.053085    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-hostroot\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.054068 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.053102    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15-system-cni-dir\") pod \"multus-additional-cni-plugins-cd5c9\" (UID: \"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15\") " pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:32.054068 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.053164    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcjn4\" (UniqueName: \"kubernetes.io/projected/b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15-kube-api-access-wcjn4\") pod \"multus-additional-cni-plugins-cd5c9\" (UID: \"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15\") " pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:32.054068 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.053249    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-host-cni-netd\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.054068 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.053290    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8rr2x\" (UniqueName: \"kubernetes.io/projected/30eae78c-3802-46f5-a21a-c3f9fd825044-kube-api-access-8rr2x\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.054068 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.053316    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6dd7eb65-6fd1-4d72-a705-68df80e3c9f9-serviceca\") pod \"node-ca-kq6lz\" (UID: \"6dd7eb65-6fd1-4d72-a705-68df80e3c9f9\") " pod="openshift-image-registry/node-ca-kq6lz"
Jun 03 01:40:32.054068 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.053345    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x4sqg\" (UniqueName: \"kubernetes.io/projected/212f3e8b-a98d-4191-a9b8-b42694d05b21-kube-api-access-x4sqg\") pod \"network-metrics-daemon-zwwq7\" (UID: \"212f3e8b-a98d-4191-a9b8-b42694d05b21\") " pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:40:32.054068 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.053372    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2cb78b80-9f75-43bc-8da9-120411d117ab-etc-tuned\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.054068 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.053398    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd36a345-5628-409d-9024-eed1daad505b-tmp-dir\") pod \"node-resolver-j6knj\" (UID: \"fd36a345-5628-409d-9024-eed1daad505b\") " pod="openshift-dns/node-resolver-j6knj"
Jun 03 01:40:32.054068 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.053428    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cd5c9\" (UID: \"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15\") " pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:32.054068 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.053462    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.054068 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.053523    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knf5k\" (UniqueName: \"kubernetes.io/projected/b49da4f9-9aed-4820-9908-ced2843a97f6-kube-api-access-knf5k\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.054700 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.053549    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8739a591-8c31-4586-94c5-12095870e6b0-iptables-alerter-script\") pod \"iptables-alerter-bdxf9\" (UID: \"8739a591-8c31-4586-94c5-12095870e6b0\") " pod="openshift-network-operator/iptables-alerter-bdxf9"
Jun 03 01:40:32.054700 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.053575    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-etc-sysctl-conf\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.054700 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.053747    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-etc-sysctl-conf\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.054700 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.053775    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd36a345-5628-409d-9024-eed1daad505b-tmp-dir\") pod \"node-resolver-j6knj\" (UID: \"fd36a345-5628-409d-9024-eed1daad505b\") " pod="openshift-dns/node-resolver-j6knj"
Jun 03 01:40:32.054700 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.053806    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 03 01:40:32.054700 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.054083    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8739a591-8c31-4586-94c5-12095870e6b0-iptables-alerter-script\") pod \"iptables-alerter-bdxf9\" (UID: \"8739a591-8c31-4586-94c5-12095870e6b0\") " pod="openshift-network-operator/iptables-alerter-bdxf9"
Jun 03 01:40:32.054700 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.054095    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/30eae78c-3802-46f5-a21a-c3f9fd825044-multus-daemon-config\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.054700 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.054127    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-run-openvswitch\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.054700 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.054152    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6dd7eb65-6fd1-4d72-a705-68df80e3c9f9-host\") pod \"node-ca-kq6lz\" (UID: \"6dd7eb65-6fd1-4d72-a705-68df80e3c9f9\") " pod="openshift-image-registry/node-ca-kq6lz"
Jun 03 01:40:32.054700 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.054179    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8739a591-8c31-4586-94c5-12095870e6b0-host-slash\") pod \"iptables-alerter-bdxf9\" (UID: \"8739a591-8c31-4586-94c5-12095870e6b0\") " pod="openshift-network-operator/iptables-alerter-bdxf9"
Jun 03 01:40:32.054700 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.054204    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-etc-sysconfig\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.054700 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.054569    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-sys\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.054700 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.054625    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-lib-modules\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.054700 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.054655    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8152c872-c23d-4010-8ec1-2c288385de45-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qw7cj\" (UID: \"8152c872-c23d-4010-8ec1-2c288385de45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj"
Jun 03 01:40:32.054700 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.054695    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-host-run-netns\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.055408 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.054719    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-etc-modprobe-d\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.055408 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.054746    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tl2qz\" (UniqueName: \"kubernetes.io/projected/fd36a345-5628-409d-9024-eed1daad505b-kube-api-access-tl2qz\") pod \"node-resolver-j6knj\" (UID: \"fd36a345-5628-409d-9024-eed1daad505b\") " pod="openshift-dns/node-resolver-j6knj"
Jun 03 01:40:32.055408 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.054778    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwtbh\" (UniqueName: \"kubernetes.io/projected/8152c872-c23d-4010-8ec1-2c288385de45-kube-api-access-qwtbh\") pod \"aws-ebs-csi-driver-node-qw7cj\" (UID: \"8152c872-c23d-4010-8ec1-2c288385de45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj"
Jun 03 01:40:32.055408 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.054811    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-host-var-lib-kubelet\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.055408 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.054848    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-run-ovn\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.055408 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.054854    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8739a591-8c31-4586-94c5-12095870e6b0-host-slash\") pod \"iptables-alerter-bdxf9\" (UID: \"8739a591-8c31-4586-94c5-12095870e6b0\") " pod="openshift-network-operator/iptables-alerter-bdxf9"
Jun 03 01:40:32.055408 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.054877    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z887p\" (UniqueName: \"kubernetes.io/projected/8739a591-8c31-4586-94c5-12095870e6b0-kube-api-access-z887p\") pod \"iptables-alerter-bdxf9\" (UID: \"8739a591-8c31-4586-94c5-12095870e6b0\") " pod="openshift-network-operator/iptables-alerter-bdxf9"
Jun 03 01:40:32.055408 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.054909    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30eae78c-3802-46f5-a21a-c3f9fd825044-cni-binary-copy\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.055408 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.054924    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-etc-sysconfig\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.055408 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.054942    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7ddt\" (UniqueName: \"kubernetes.io/projected/0843251b-e289-4bda-abcc-d9d49b1d2d00-kube-api-access-k7ddt\") pod \"network-check-target-hcml4\" (UID: \"0843251b-e289-4bda-abcc-d9d49b1d2d00\") " pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:40:32.055408 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.054982    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-etc-openvswitch\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.055408 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.055012    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b49da4f9-9aed-4820-9908-ced2843a97f6-ovn-node-metrics-cert\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.055408 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.055040    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cb78b80-9f75-43bc-8da9-120411d117ab-tmp\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.055408 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.055103    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8152c872-c23d-4010-8ec1-2c288385de45-device-dir\") pod \"aws-ebs-csi-driver-node-qw7cj\" (UID: \"8152c872-c23d-4010-8ec1-2c288385de45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj"
Jun 03 01:40:32.055408 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.055172    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8152c872-c23d-4010-8ec1-2c288385de45-device-dir\") pod \"aws-ebs-csi-driver-node-qw7cj\" (UID: \"8152c872-c23d-4010-8ec1-2c288385de45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj"
Jun 03 01:40:32.055408 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.055270    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/30eae78c-3802-46f5-a21a-c3f9fd825044-multus-daemon-config\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.055408 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.055355    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-host-var-lib-kubelet\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.056179 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.055416    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-sys\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.056179 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.055524    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-lib-modules\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.056179 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.055607    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8152c872-c23d-4010-8ec1-2c288385de45-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qw7cj\" (UID: \"8152c872-c23d-4010-8ec1-2c288385de45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj"
Jun 03 01:40:32.056179 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.055661    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-host-run-netns\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.056179 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.055761    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-etc-modprobe-d\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.056399 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.056263    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30eae78c-3802-46f5-a21a-c3f9fd825044-cni-binary-copy\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.056399 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.056284    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83550fed-8052-46ad-b704-1a9b1b977d04-agent-certs\") pod \"konnectivity-agent-9p5l6\" (UID: \"83550fed-8052-46ad-b704-1a9b1b977d04\") " pod="kube-system/konnectivity-agent-9p5l6"
Jun 03 01:40:32.056755 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.056727    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-host-slash\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.056868 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.056791    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-etc-sysctl-d\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.056868 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.056833    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-host-var-lib-cni-bin\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.056976 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.056939    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30eae78c-3802-46f5-a21a-c3f9fd825044-host-var-lib-cni-bin\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.057022 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.056986    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2cb78b80-9f75-43bc-8da9-120411d117ab-etc-sysctl-d\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.058398 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.057458    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2cb78b80-9f75-43bc-8da9-120411d117ab-etc-tuned\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.058854 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.058840    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cb78b80-9f75-43bc-8da9-120411d117ab-tmp\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.062616 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.062569    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp2fr\" (UniqueName: \"kubernetes.io/projected/2cb78b80-9f75-43bc-8da9-120411d117ab-kube-api-access-jp2fr\") pod \"tuned-b268x\" (UID: \"2cb78b80-9f75-43bc-8da9-120411d117ab\") " pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.063469 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.063437    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwtbh\" (UniqueName: \"kubernetes.io/projected/8152c872-c23d-4010-8ec1-2c288385de45-kube-api-access-qwtbh\") pod \"aws-ebs-csi-driver-node-qw7cj\" (UID: \"8152c872-c23d-4010-8ec1-2c288385de45\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj"
Jun 03 01:40:32.063966 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.063945    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rr2x\" (UniqueName: \"kubernetes.io/projected/30eae78c-3802-46f5-a21a-c3f9fd825044-kube-api-access-8rr2x\") pod \"multus-gmwmw\" (UID: \"30eae78c-3802-46f5-a21a-c3f9fd825044\") " pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.064070 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.064052    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z887p\" (UniqueName: \"kubernetes.io/projected/8739a591-8c31-4586-94c5-12095870e6b0-kube-api-access-z887p\") pod \"iptables-alerter-bdxf9\" (UID: \"8739a591-8c31-4586-94c5-12095870e6b0\") " pod="openshift-network-operator/iptables-alerter-bdxf9"
Jun 03 01:40:32.064198 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.064181    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl2qz\" (UniqueName: \"kubernetes.io/projected/fd36a345-5628-409d-9024-eed1daad505b-kube-api-access-tl2qz\") pod \"node-resolver-j6knj\" (UID: \"fd36a345-5628-409d-9024-eed1daad505b\") " pod="openshift-dns/node-resolver-j6knj"
Jun 03 01:40:32.064254 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.064221    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4sqg\" (UniqueName: \"kubernetes.io/projected/212f3e8b-a98d-4191-a9b8-b42694d05b21-kube-api-access-x4sqg\") pod \"network-metrics-daemon-zwwq7\" (UID: \"212f3e8b-a98d-4191-a9b8-b42694d05b21\") " pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:40:32.077970 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.077916    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal" event={"ID":"b352523aa1133bdddd102a34c42e047b","Type":"ContainerStarted","Data":"2f4bbc2055b88011c0615e2b6efcdf30a08f388dc2bcbb7678750ca953a56651"}
Jun 03 01:40:32.078719 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.078688    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal" event={"ID":"3803111852fe7b3fb1e052a82492729c","Type":"ContainerStarted","Data":"03f0b19d30aca17eb04a18c3e21cd8a34e2ea91b458f9dab00ec8050107bbda6"}
Jun 03 01:40:32.157982 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.157951    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-run-systemd\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.157982 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.157984    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-log-socket\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.158163 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158008    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-systemd-units\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.158163 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158049    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-systemd-units\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.158163 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158057    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-run-systemd\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.158163 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158066    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-log-socket\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.158163 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158081    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-host-run-netns\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.158163 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158098    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-host-cni-bin\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.158163 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158117    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cwvrb\" (UniqueName: \"kubernetes.io/projected/6dd7eb65-6fd1-4d72-a705-68df80e3c9f9-kube-api-access-cwvrb\") pod \"node-ca-kq6lz\" (UID: \"6dd7eb65-6fd1-4d72-a705-68df80e3c9f9\") " pod="openshift-image-registry/node-ca-kq6lz"
Jun 03 01:40:32.158163 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158129    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-host-run-netns\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.158163 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158145    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15-os-release\") pod \"multus-additional-cni-plugins-cd5c9\" (UID: \"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15\") " pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:32.158163 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158164    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-host-cni-bin\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.158493 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158190    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-host-kubelet\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.158493 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158167    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-host-kubelet\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.158493 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158213    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15-os-release\") pod \"multus-additional-cni-plugins-cd5c9\" (UID: \"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15\") " pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:32.158493 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158219    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b49da4f9-9aed-4820-9908-ced2843a97f6-ovnkube-config\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.158493 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158234    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b49da4f9-9aed-4820-9908-ced2843a97f6-env-overrides\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.158493 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158253    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.158493 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158271    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b49da4f9-9aed-4820-9908-ced2843a97f6-ovnkube-script-lib\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.158493 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158288    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cd5c9\" (UID: \"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15\") " pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:32.158493 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158317    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.158493 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158407    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-var-lib-openvswitch\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.158493 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158440    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-node-log\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.158493 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158472    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83550fed-8052-46ad-b704-1a9b1b977d04-konnectivity-ca\") pod \"konnectivity-agent-9p5l6\" (UID: \"83550fed-8052-46ad-b704-1a9b1b977d04\") " pod="kube-system/konnectivity-agent-9p5l6"
Jun 03 01:40:32.159088 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158503    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15-system-cni-dir\") pod \"multus-additional-cni-plugins-cd5c9\" (UID: \"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15\") " pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:32.159088 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158523    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-var-lib-openvswitch\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.159088 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158537    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-node-log\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.159088 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158531    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wcjn4\" (UniqueName: \"kubernetes.io/projected/b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15-kube-api-access-wcjn4\") pod \"multus-additional-cni-plugins-cd5c9\" (UID: \"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15\") " pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:32.159088 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158601    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-host-cni-netd\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.159088 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158633    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6dd7eb65-6fd1-4d72-a705-68df80e3c9f9-serviceca\") pod \"node-ca-kq6lz\" (UID: \"6dd7eb65-6fd1-4d72-a705-68df80e3c9f9\") " pod="openshift-image-registry/node-ca-kq6lz"
Jun 03 01:40:32.159088 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158664    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cd5c9\" (UID: \"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15\") " pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:32.159088 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158696    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.159088 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158723    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-knf5k\" (UniqueName: \"kubernetes.io/projected/b49da4f9-9aed-4820-9908-ced2843a97f6-kube-api-access-knf5k\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.159088 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158754    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-run-openvswitch\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.159088 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158778    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6dd7eb65-6fd1-4d72-a705-68df80e3c9f9-host\") pod \"node-ca-kq6lz\" (UID: \"6dd7eb65-6fd1-4d72-a705-68df80e3c9f9\") " pod="openshift-image-registry/node-ca-kq6lz"
Jun 03 01:40:32.159088 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158814    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-run-ovn\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.159088 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158841    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7ddt\" (UniqueName: \"kubernetes.io/projected/0843251b-e289-4bda-abcc-d9d49b1d2d00-kube-api-access-k7ddt\") pod \"network-check-target-hcml4\" (UID: \"0843251b-e289-4bda-abcc-d9d49b1d2d00\") " pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:40:32.159088 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158847    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15-system-cni-dir\") pod \"multus-additional-cni-plugins-cd5c9\" (UID: \"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15\") " pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:32.159088 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158855    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b49da4f9-9aed-4820-9908-ced2843a97f6-env-overrides\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.159088 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158865    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-etc-openvswitch\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.159088 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158893    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b49da4f9-9aed-4820-9908-ced2843a97f6-ovn-node-metrics-cert\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.159772 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158918    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cd5c9\" (UID: \"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15\") " pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:32.159772 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158921    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83550fed-8052-46ad-b704-1a9b1b977d04-agent-certs\") pod \"konnectivity-agent-9p5l6\" (UID: \"83550fed-8052-46ad-b704-1a9b1b977d04\") " pod="kube-system/konnectivity-agent-9p5l6"
Jun 03 01:40:32.159772 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158966    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-host-slash\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.159772 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158977    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b49da4f9-9aed-4820-9908-ced2843a97f6-ovnkube-script-lib\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.159772 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.158999    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15-cnibin\") pod \"multus-additional-cni-plugins-cd5c9\" (UID: \"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15\") " pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:32.159772 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.159009    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b49da4f9-9aed-4820-9908-ced2843a97f6-ovnkube-config\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.159772 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.159026    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cd5c9\" (UID: \"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15\") " pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:32.159772 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.159055    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83550fed-8052-46ad-b704-1a9b1b977d04-konnectivity-ca\") pod \"konnectivity-agent-9p5l6\" (UID: \"83550fed-8052-46ad-b704-1a9b1b977d04\") " pod="kube-system/konnectivity-agent-9p5l6"
Jun 03 01:40:32.159772 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.159064    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-host-slash\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.159772 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.159055    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15-cni-binary-copy\") pod \"multus-additional-cni-plugins-cd5c9\" (UID: \"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15\") " pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:32.159772 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.159138    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-etc-openvswitch\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.159772 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.159172    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15-cnibin\") pod \"multus-additional-cni-plugins-cd5c9\" (UID: \"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15\") " pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:32.159772 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.159191    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.159772 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.159205    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-run-ovn\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.159772 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.159235    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6dd7eb65-6fd1-4d72-a705-68df80e3c9f9-host\") pod \"node-ca-kq6lz\" (UID: \"6dd7eb65-6fd1-4d72-a705-68df80e3c9f9\") " pod="openshift-image-registry/node-ca-kq6lz"
Jun 03 01:40:32.159772 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.159276    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-host-cni-netd\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.159772 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.159306    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cd5c9\" (UID: \"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15\") " pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:32.160338 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.159312    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b49da4f9-9aed-4820-9908-ced2843a97f6-run-openvswitch\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.160338 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.159357    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cd5c9\" (UID: \"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15\") " pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:32.160338 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.159469    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6dd7eb65-6fd1-4d72-a705-68df80e3c9f9-serviceca\") pod \"node-ca-kq6lz\" (UID: \"6dd7eb65-6fd1-4d72-a705-68df80e3c9f9\") " pod="openshift-image-registry/node-ca-kq6lz"
Jun 03 01:40:32.160338 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.159484    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15-cni-binary-copy\") pod \"multus-additional-cni-plugins-cd5c9\" (UID: \"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15\") " pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:32.161102 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.161083    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b49da4f9-9aed-4820-9908-ced2843a97f6-ovn-node-metrics-cert\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.161102 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.161093    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83550fed-8052-46ad-b704-1a9b1b977d04-agent-certs\") pod \"konnectivity-agent-9p5l6\" (UID: \"83550fed-8052-46ad-b704-1a9b1b977d04\") " pod="kube-system/konnectivity-agent-9p5l6"
Jun 03 01:40:32.164139 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:32.164123    2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 01:40:32.164139 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:32.164140    2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 01:40:32.164250 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:32.164150    2577 projected.go:194] Error preparing data for projected volume kube-api-access-k7ddt for pod openshift-network-diagnostics/network-check-target-hcml4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:40:32.164250 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:32.164205    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0843251b-e289-4bda-abcc-d9d49b1d2d00-kube-api-access-k7ddt podName:0843251b-e289-4bda-abcc-d9d49b1d2d00 nodeName:}" failed. No retries permitted until 2026-06-03 01:40:32.664191315 +0000 UTC m=+2.228587107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-k7ddt" (UniqueName: "kubernetes.io/projected/0843251b-e289-4bda-abcc-d9d49b1d2d00-kube-api-access-k7ddt") pod "network-check-target-hcml4" (UID: "0843251b-e289-4bda-abcc-d9d49b1d2d00") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:40:32.166012 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.165990    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwvrb\" (UniqueName: \"kubernetes.io/projected/6dd7eb65-6fd1-4d72-a705-68df80e3c9f9-kube-api-access-cwvrb\") pod \"node-ca-kq6lz\" (UID: \"6dd7eb65-6fd1-4d72-a705-68df80e3c9f9\") " pod="openshift-image-registry/node-ca-kq6lz"
Jun 03 01:40:32.166165 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.166147    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcjn4\" (UniqueName: \"kubernetes.io/projected/b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15-kube-api-access-wcjn4\") pod \"multus-additional-cni-plugins-cd5c9\" (UID: \"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15\") " pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:32.166630 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.166614    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knf5k\" (UniqueName: \"kubernetes.io/projected/b49da4f9-9aed-4820-9908-ced2843a97f6-kube-api-access-knf5k\") pod \"ovnkube-node-qtd96\" (UID: \"b49da4f9-9aed-4820-9908-ced2843a97f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.262551 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.262471    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj"
Jun 03 01:40:32.268395 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:32.268369    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8152c872_c23d_4010_8ec1_2c288385de45.slice/crio-3fc646cfd89d18b34053ae840bd5ac04747a52f208c003dbef158d22f4a7667b WatchSource:0}: Error finding container 3fc646cfd89d18b34053ae840bd5ac04747a52f208c003dbef158d22f4a7667b: Status 404 returned error can't find the container with id 3fc646cfd89d18b34053ae840bd5ac04747a52f208c003dbef158d22f4a7667b
Jun 03 01:40:32.280326 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.280303    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gmwmw"
Jun 03 01:40:32.286713 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:32.286682    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30eae78c_3802_46f5_a21a_c3f9fd825044.slice/crio-05df2df28fbf193a4222ad6412f23a4ad3565d83ee5f1959a79601ff2cb03b13 WatchSource:0}: Error finding container 05df2df28fbf193a4222ad6412f23a4ad3565d83ee5f1959a79601ff2cb03b13: Status 404 returned error can't find the container with id 05df2df28fbf193a4222ad6412f23a4ad3565d83ee5f1959a79601ff2cb03b13
Jun 03 01:40:32.299340 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.299313    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bdxf9"
Jun 03 01:40:32.305788 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:32.305760    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8739a591_8c31_4586_94c5_12095870e6b0.slice/crio-cdd23d5265f2d527e2611e6e244132fcd71e6e00e74424e421e75d89d4d8b3d8 WatchSource:0}: Error finding container cdd23d5265f2d527e2611e6e244132fcd71e6e00e74424e421e75d89d4d8b3d8: Status 404 returned error can't find the container with id cdd23d5265f2d527e2611e6e244132fcd71e6e00e74424e421e75d89d4d8b3d8
Jun 03 01:40:32.309171 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.309153    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b268x"
Jun 03 01:40:32.315479 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:32.315443    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cb78b80_9f75_43bc_8da9_120411d117ab.slice/crio-9a56e420534169afb6f3f986fbfb381abe67454e8c89fb596e45e17c2d28460b WatchSource:0}: Error finding container 9a56e420534169afb6f3f986fbfb381abe67454e8c89fb596e45e17c2d28460b: Status 404 returned error can't find the container with id 9a56e420534169afb6f3f986fbfb381abe67454e8c89fb596e45e17c2d28460b
Jun 03 01:40:32.331661 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.331635    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j6knj"
Jun 03 01:40:32.336449 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.336424    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kq6lz"
Jun 03 01:40:32.337952 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:32.337926    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd36a345_5628_409d_9024_eed1daad505b.slice/crio-1c82997bb76a4009f4d7f455675b932263852e462a0853ea0a7c808af9623ab4 WatchSource:0}: Error finding container 1c82997bb76a4009f4d7f455675b932263852e462a0853ea0a7c808af9623ab4: Status 404 returned error can't find the container with id 1c82997bb76a4009f4d7f455675b932263852e462a0853ea0a7c808af9623ab4
Jun 03 01:40:32.342276 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.342254    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cd5c9"
Jun 03 01:40:32.342815 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:32.342787    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dd7eb65_6fd1_4d72_a705_68df80e3c9f9.slice/crio-7457b2009b4c63b8ec4dc05297ab7075673a3ae13796820ce1d52344553d505e WatchSource:0}: Error finding container 7457b2009b4c63b8ec4dc05297ab7075673a3ae13796820ce1d52344553d505e: Status 404 returned error can't find the container with id 7457b2009b4c63b8ec4dc05297ab7075673a3ae13796820ce1d52344553d505e
Jun 03 01:40:32.349077 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:32.349041    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0c5a9eb_af1c_4e6a_aaf0_a322ced7df15.slice/crio-99e75183bb396de0dd0655990b41b16848237215caf940d48bdf3d9639b755e5 WatchSource:0}: Error finding container 99e75183bb396de0dd0655990b41b16848237215caf940d48bdf3d9639b755e5: Status 404 returned error can't find the container with id 99e75183bb396de0dd0655990b41b16848237215caf940d48bdf3d9639b755e5
Jun 03 01:40:32.349868 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.349853    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:32.356846 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.356827    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9p5l6"
Jun 03 01:40:32.358983 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:32.357923    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb49da4f9_9aed_4820_9908_ced2843a97f6.slice/crio-5d221ab0f2a9742ef883c92cf6a8441fa2d3ec284b172f2c50b3140e53a31703 WatchSource:0}: Error finding container 5d221ab0f2a9742ef883c92cf6a8441fa2d3ec284b172f2c50b3140e53a31703: Status 404 returned error can't find the container with id 5d221ab0f2a9742ef883c92cf6a8441fa2d3ec284b172f2c50b3140e53a31703
Jun 03 01:40:32.366048 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:40:32.366018    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83550fed_8052_46ad_b704_1a9b1b977d04.slice/crio-111bd6d499321d5116f95d16d89666b36946b2fedc530e48ae2f602ecd922923 WatchSource:0}: Error finding container 111bd6d499321d5116f95d16d89666b36946b2fedc530e48ae2f602ecd922923: Status 404 returned error can't find the container with id 111bd6d499321d5116f95d16d89666b36946b2fedc530e48ae2f602ecd922923
Jun 03 01:40:32.561214 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.561129    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs\") pod \"network-metrics-daemon-zwwq7\" (UID: \"212f3e8b-a98d-4191-a9b8-b42694d05b21\") " pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:40:32.561413 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:32.561310    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:40:32.561413 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:32.561377    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs podName:212f3e8b-a98d-4191-a9b8-b42694d05b21 nodeName:}" failed. No retries permitted until 2026-06-03 01:40:33.561359049 +0000 UTC m=+3.125754843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs") pod "network-metrics-daemon-zwwq7" (UID: "212f3e8b-a98d-4191-a9b8-b42694d05b21") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:40:32.765618 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.763048    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7ddt\" (UniqueName: \"kubernetes.io/projected/0843251b-e289-4bda-abcc-d9d49b1d2d00-kube-api-access-k7ddt\") pod \"network-check-target-hcml4\" (UID: \"0843251b-e289-4bda-abcc-d9d49b1d2d00\") " pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:40:32.765618 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:32.763232    2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 01:40:32.765618 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:32.763252    2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 01:40:32.765618 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:32.763267    2577 projected.go:194] Error preparing data for projected volume kube-api-access-k7ddt for pod openshift-network-diagnostics/network-check-target-hcml4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:40:32.765618 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:32.763322    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0843251b-e289-4bda-abcc-d9d49b1d2d00-kube-api-access-k7ddt podName:0843251b-e289-4bda-abcc-d9d49b1d2d00 nodeName:}" failed. No retries permitted until 2026-06-03 01:40:33.763304104 +0000 UTC m=+3.327699898 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-k7ddt" (UniqueName: "kubernetes.io/projected/0843251b-e289-4bda-abcc-d9d49b1d2d00-kube-api-access-k7ddt") pod "network-check-target-hcml4" (UID: "0843251b-e289-4bda-abcc-d9d49b1d2d00") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:40:32.983540 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.983496    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 01:35:31 +0000 UTC" deadline="2028-02-28 06:46:03.89959884 +0000 UTC"
Jun 03 01:40:32.983540 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:32.983537    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15245h5m30.916067085s"
Jun 03 01:40:33.099796 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:33.099731    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b268x" event={"ID":"2cb78b80-9f75-43bc-8da9-120411d117ab","Type":"ContainerStarted","Data":"9a56e420534169afb6f3f986fbfb381abe67454e8c89fb596e45e17c2d28460b"}
Jun 03 01:40:33.126356 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:33.126315    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bdxf9" event={"ID":"8739a591-8c31-4586-94c5-12095870e6b0","Type":"ContainerStarted","Data":"cdd23d5265f2d527e2611e6e244132fcd71e6e00e74424e421e75d89d4d8b3d8"}
Jun 03 01:40:33.145165 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:33.145125    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gmwmw" event={"ID":"30eae78c-3802-46f5-a21a-c3f9fd825044","Type":"ContainerStarted","Data":"05df2df28fbf193a4222ad6412f23a4ad3565d83ee5f1959a79601ff2cb03b13"}
Jun 03 01:40:33.152703 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:33.152665    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj" event={"ID":"8152c872-c23d-4010-8ec1-2c288385de45","Type":"ContainerStarted","Data":"3fc646cfd89d18b34053ae840bd5ac04747a52f208c003dbef158d22f4a7667b"}
Jun 03 01:40:33.153024 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:33.153000    2577 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 01:40:33.166203 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:33.166150    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9p5l6" event={"ID":"83550fed-8052-46ad-b704-1a9b1b977d04","Type":"ContainerStarted","Data":"111bd6d499321d5116f95d16d89666b36946b2fedc530e48ae2f602ecd922923"}
Jun 03 01:40:33.181352 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:33.181313    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd5c9" event={"ID":"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15","Type":"ContainerStarted","Data":"99e75183bb396de0dd0655990b41b16848237215caf940d48bdf3d9639b755e5"}
Jun 03 01:40:33.185765 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:33.185716    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j6knj" event={"ID":"fd36a345-5628-409d-9024-eed1daad505b","Type":"ContainerStarted","Data":"1c82997bb76a4009f4d7f455675b932263852e462a0853ea0a7c808af9623ab4"}
Jun 03 01:40:33.194254 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:33.194216    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtd96" event={"ID":"b49da4f9-9aed-4820-9908-ced2843a97f6","Type":"ContainerStarted","Data":"5d221ab0f2a9742ef883c92cf6a8441fa2d3ec284b172f2c50b3140e53a31703"}
Jun 03 01:40:33.201942 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:33.201906    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kq6lz" event={"ID":"6dd7eb65-6fd1-4d72-a705-68df80e3c9f9","Type":"ContainerStarted","Data":"7457b2009b4c63b8ec4dc05297ab7075673a3ae13796820ce1d52344553d505e"}
Jun 03 01:40:33.265230 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:33.264880    2577 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 01:40:33.569416 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:33.569282    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs\") pod \"network-metrics-daemon-zwwq7\" (UID: \"212f3e8b-a98d-4191-a9b8-b42694d05b21\") " pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:40:33.569600 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:33.569420    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:40:33.569600 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:33.569493    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs podName:212f3e8b-a98d-4191-a9b8-b42694d05b21 nodeName:}" failed. No retries permitted until 2026-06-03 01:40:35.569463624 +0000 UTC m=+5.133859419 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs") pod "network-metrics-daemon-zwwq7" (UID: "212f3e8b-a98d-4191-a9b8-b42694d05b21") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:40:33.770656 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:33.770617    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7ddt\" (UniqueName: \"kubernetes.io/projected/0843251b-e289-4bda-abcc-d9d49b1d2d00-kube-api-access-k7ddt\") pod \"network-check-target-hcml4\" (UID: \"0843251b-e289-4bda-abcc-d9d49b1d2d00\") " pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:40:33.770847 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:33.770783    2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 01:40:33.770847 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:33.770802    2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 01:40:33.770847 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:33.770816    2577 projected.go:194] Error preparing data for projected volume kube-api-access-k7ddt for pod openshift-network-diagnostics/network-check-target-hcml4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:40:33.771011 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:33.770882    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0843251b-e289-4bda-abcc-d9d49b1d2d00-kube-api-access-k7ddt podName:0843251b-e289-4bda-abcc-d9d49b1d2d00 nodeName:}" failed. No retries permitted until 2026-06-03 01:40:35.770862496 +0000 UTC m=+5.335258293 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-k7ddt" (UniqueName: "kubernetes.io/projected/0843251b-e289-4bda-abcc-d9d49b1d2d00-kube-api-access-k7ddt") pod "network-check-target-hcml4" (UID: "0843251b-e289-4bda-abcc-d9d49b1d2d00") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:40:33.983969 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:33.983912    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 01:35:31 +0000 UTC" deadline="2028-01-14 13:13:08.850240362 +0000 UTC"
Jun 03 01:40:33.983969 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:33.983957    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14171h32m34.866287681s"
Jun 03 01:40:34.074511 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:34.074475    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:40:34.074699 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:34.074635    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwwq7" podUID="212f3e8b-a98d-4191-a9b8-b42694d05b21"
Jun 03 01:40:34.075076 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:34.075056    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:40:34.075169 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:34.075151    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcml4" podUID="0843251b-e289-4bda-abcc-d9d49b1d2d00"
Jun 03 01:40:35.590434 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:35.589807    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs\") pod \"network-metrics-daemon-zwwq7\" (UID: \"212f3e8b-a98d-4191-a9b8-b42694d05b21\") " pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:40:35.590434 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:35.589972    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:40:35.590434 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:35.590041    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs podName:212f3e8b-a98d-4191-a9b8-b42694d05b21 nodeName:}" failed. No retries permitted until 2026-06-03 01:40:39.590017036 +0000 UTC m=+9.154412826 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs") pod "network-metrics-daemon-zwwq7" (UID: "212f3e8b-a98d-4191-a9b8-b42694d05b21") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:40:35.791696 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:35.791656    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7ddt\" (UniqueName: \"kubernetes.io/projected/0843251b-e289-4bda-abcc-d9d49b1d2d00-kube-api-access-k7ddt\") pod \"network-check-target-hcml4\" (UID: \"0843251b-e289-4bda-abcc-d9d49b1d2d00\") " pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:40:35.791883 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:35.791846    2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 01:40:35.791883 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:35.791874    2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 01:40:35.792046 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:35.791888    2577 projected.go:194] Error preparing data for projected volume kube-api-access-k7ddt for pod openshift-network-diagnostics/network-check-target-hcml4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:40:35.792046 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:35.791955    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0843251b-e289-4bda-abcc-d9d49b1d2d00-kube-api-access-k7ddt podName:0843251b-e289-4bda-abcc-d9d49b1d2d00 nodeName:}" failed. No retries permitted until 2026-06-03 01:40:39.791934227 +0000 UTC m=+9.356330035 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-k7ddt" (UniqueName: "kubernetes.io/projected/0843251b-e289-4bda-abcc-d9d49b1d2d00-kube-api-access-k7ddt") pod "network-check-target-hcml4" (UID: "0843251b-e289-4bda-abcc-d9d49b1d2d00") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:40:36.074206 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:36.074169    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:40:36.074402 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:36.074306    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcml4" podUID="0843251b-e289-4bda-abcc-d9d49b1d2d00"
Jun 03 01:40:36.074728 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:36.074177    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:40:36.074847 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:36.074829    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwwq7" podUID="212f3e8b-a98d-4191-a9b8-b42694d05b21"
Jun 03 01:40:38.074494 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:38.074453    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:40:38.074930 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:38.074624    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwwq7" podUID="212f3e8b-a98d-4191-a9b8-b42694d05b21"
Jun 03 01:40:38.075082 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:38.075063    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:40:38.075178 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:38.075159    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcml4" podUID="0843251b-e289-4bda-abcc-d9d49b1d2d00"
Jun 03 01:40:39.625309 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:39.625233    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs\") pod \"network-metrics-daemon-zwwq7\" (UID: \"212f3e8b-a98d-4191-a9b8-b42694d05b21\") " pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:40:39.625777 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:39.625429    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:40:39.625777 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:39.625523    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs podName:212f3e8b-a98d-4191-a9b8-b42694d05b21 nodeName:}" failed. No retries permitted until 2026-06-03 01:40:47.625503268 +0000 UTC m=+17.189899058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs") pod "network-metrics-daemon-zwwq7" (UID: "212f3e8b-a98d-4191-a9b8-b42694d05b21") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:40:39.826512 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:39.826465    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7ddt\" (UniqueName: \"kubernetes.io/projected/0843251b-e289-4bda-abcc-d9d49b1d2d00-kube-api-access-k7ddt\") pod \"network-check-target-hcml4\" (UID: \"0843251b-e289-4bda-abcc-d9d49b1d2d00\") " pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:40:39.826692 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:39.826668    2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 01:40:39.826692 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:39.826690    2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 01:40:39.826857 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:39.826705    2577 projected.go:194] Error preparing data for projected volume kube-api-access-k7ddt for pod openshift-network-diagnostics/network-check-target-hcml4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:40:39.826857 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:39.826794    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0843251b-e289-4bda-abcc-d9d49b1d2d00-kube-api-access-k7ddt podName:0843251b-e289-4bda-abcc-d9d49b1d2d00 nodeName:}" failed. No retries permitted until 2026-06-03 01:40:47.826775282 +0000 UTC m=+17.391171072 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-k7ddt" (UniqueName: "kubernetes.io/projected/0843251b-e289-4bda-abcc-d9d49b1d2d00-kube-api-access-k7ddt") pod "network-check-target-hcml4" (UID: "0843251b-e289-4bda-abcc-d9d49b1d2d00") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:40:40.074769 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:40.074674    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:40:40.074931 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:40.074693    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:40:40.074931 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:40.074794    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwwq7" podUID="212f3e8b-a98d-4191-a9b8-b42694d05b21"
Jun 03 01:40:40.075051 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:40.074947    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcml4" podUID="0843251b-e289-4bda-abcc-d9d49b1d2d00"
Jun 03 01:40:42.074551 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:42.074363    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:40:42.074987 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:42.074364    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:40:42.074987 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:42.074644    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcml4" podUID="0843251b-e289-4bda-abcc-d9d49b1d2d00"
Jun 03 01:40:42.074987 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:42.074713    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwwq7" podUID="212f3e8b-a98d-4191-a9b8-b42694d05b21"
Jun 03 01:40:44.073961 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:44.073924    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:40:44.074384 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:44.073924    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:40:44.074384 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:44.074062    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwwq7" podUID="212f3e8b-a98d-4191-a9b8-b42694d05b21"
Jun 03 01:40:44.074384 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:44.074098    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcml4" podUID="0843251b-e289-4bda-abcc-d9d49b1d2d00"
Jun 03 01:40:46.074141 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:46.074103    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:40:46.074549 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:46.074103    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:40:46.074549 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:46.074240    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwwq7" podUID="212f3e8b-a98d-4191-a9b8-b42694d05b21"
Jun 03 01:40:46.074549 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:46.074313    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcml4" podUID="0843251b-e289-4bda-abcc-d9d49b1d2d00"
Jun 03 01:40:47.684827 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:47.684778    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs\") pod \"network-metrics-daemon-zwwq7\" (UID: \"212f3e8b-a98d-4191-a9b8-b42694d05b21\") " pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:40:47.685284 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:47.684922    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:40:47.685284 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:47.684990    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs podName:212f3e8b-a98d-4191-a9b8-b42694d05b21 nodeName:}" failed. No retries permitted until 2026-06-03 01:41:03.684971413 +0000 UTC m=+33.249367203 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs") pod "network-metrics-daemon-zwwq7" (UID: "212f3e8b-a98d-4191-a9b8-b42694d05b21") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:40:47.885595 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:47.885556    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7ddt\" (UniqueName: \"kubernetes.io/projected/0843251b-e289-4bda-abcc-d9d49b1d2d00-kube-api-access-k7ddt\") pod \"network-check-target-hcml4\" (UID: \"0843251b-e289-4bda-abcc-d9d49b1d2d00\") " pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:40:47.885769 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:47.885745    2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 01:40:47.885827 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:47.885770    2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 01:40:47.885827 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:47.885783    2577 projected.go:194] Error preparing data for projected volume kube-api-access-k7ddt for pod openshift-network-diagnostics/network-check-target-hcml4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:40:47.885912 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:47.885848    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0843251b-e289-4bda-abcc-d9d49b1d2d00-kube-api-access-k7ddt podName:0843251b-e289-4bda-abcc-d9d49b1d2d00 nodeName:}" failed. No retries permitted until 2026-06-03 01:41:03.885828653 +0000 UTC m=+33.450224445 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-k7ddt" (UniqueName: "kubernetes.io/projected/0843251b-e289-4bda-abcc-d9d49b1d2d00-kube-api-access-k7ddt") pod "network-check-target-hcml4" (UID: "0843251b-e289-4bda-abcc-d9d49b1d2d00") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:40:48.073965 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:48.073929    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:40:48.074146 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:48.073929    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:40:48.074146 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:48.074068    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwwq7" podUID="212f3e8b-a98d-4191-a9b8-b42694d05b21"
Jun 03 01:40:48.074146 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:48.074121    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcml4" podUID="0843251b-e289-4bda-abcc-d9d49b1d2d00"
Jun 03 01:40:50.074275 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:50.074238    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:40:50.074759 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:50.074238    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:40:50.074759 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:50.074354    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwwq7" podUID="212f3e8b-a98d-4191-a9b8-b42694d05b21"
Jun 03 01:40:50.074759 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:50.074439    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcml4" podUID="0843251b-e289-4bda-abcc-d9d49b1d2d00"
Jun 03 01:40:52.074458 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:52.074437    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:40:52.074774 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:52.074457    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:40:52.074774 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:52.074545    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcml4" podUID="0843251b-e289-4bda-abcc-d9d49b1d2d00"
Jun 03 01:40:52.074774 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:52.074708    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwwq7" podUID="212f3e8b-a98d-4191-a9b8-b42694d05b21"
Jun 03 01:40:52.260412 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:52.260375    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtd96" event={"ID":"b49da4f9-9aed-4820-9908-ced2843a97f6","Type":"ContainerStarted","Data":"12b3362af5496dd28f3dc1ec8a0ede251cd0f6b7b7589c7363d92fd9eedccc75"}
Jun 03 01:40:52.263604 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:52.263484    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b268x" event={"ID":"2cb78b80-9f75-43bc-8da9-120411d117ab","Type":"ContainerStarted","Data":"20bc5bbd887cce19a3758948ea1b6c7deeeb7bdf3e11651f97e9a0d0b85f489e"}
Jun 03 01:40:52.269900 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:52.269867    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal" event={"ID":"b352523aa1133bdddd102a34c42e047b","Type":"ContainerStarted","Data":"132ea42486943cc13b4fc5885a2d4560123ad60b7773ea7521eb15bf423aa8e1"}
Jun 03 01:40:52.279411 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:52.279307    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-b268x" podStartSLOduration=1.596731384 podStartE2EDuration="21.279290258s" podCreationTimestamp="2026-06-03 01:40:31 +0000 UTC" firstStartedPulling="2026-06-03 01:40:32.317400087 +0000 UTC m=+1.881795879" lastFinishedPulling="2026-06-03 01:40:51.999958961 +0000 UTC m=+21.564354753" observedRunningTime="2026-06-03 01:40:52.278870725 +0000 UTC m=+21.843266535" watchObservedRunningTime="2026-06-03 01:40:52.279290258 +0000 UTC m=+21.843686069"
Jun 03 01:40:53.275537 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:53.275323    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj" event={"ID":"8152c872-c23d-4010-8ec1-2c288385de45","Type":"ContainerStarted","Data":"2dec21619621f0d05f1d0f25d2f5f1ef778cc10cfbb087897584f7bdc27bf18a"}
Jun 03 01:40:53.276694 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:53.276662    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9p5l6" event={"ID":"83550fed-8052-46ad-b704-1a9b1b977d04","Type":"ContainerStarted","Data":"763dc01a948146642a818303cc7c44a8e6a8a77a90ddff0b35c9a5729a04fe7c"}
Jun 03 01:40:53.278033 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:53.278003    2577 generic.go:358] "Generic (PLEG): container finished" podID="b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15" containerID="12405895bb66f7d69a4a6484bce56c8e0dd6ae9cccdb313fda8c3a4f259c7d3b" exitCode=0
Jun 03 01:40:53.278143 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:53.278068    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd5c9" event={"ID":"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15","Type":"ContainerDied","Data":"12405895bb66f7d69a4a6484bce56c8e0dd6ae9cccdb313fda8c3a4f259c7d3b"}
Jun 03 01:40:53.282297 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:53.282268    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j6knj" event={"ID":"fd36a345-5628-409d-9024-eed1daad505b","Type":"ContainerStarted","Data":"3ec04002ea6fde01817785f2087378ab63ae2ef12999025148f655ff8d3729bd"}
Jun 03 01:40:53.283817 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:53.283796    2577 generic.go:358] "Generic (PLEG): container finished" podID="3803111852fe7b3fb1e052a82492729c" containerID="5a5ff7f8731ef6a723800b309202238d594f77b300145a0da06ac6b60db70151" exitCode=0
Jun 03 01:40:53.283910 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:53.283860    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal" event={"ID":"3803111852fe7b3fb1e052a82492729c","Type":"ContainerDied","Data":"5a5ff7f8731ef6a723800b309202238d594f77b300145a0da06ac6b60db70151"}
Jun 03 01:40:53.286290 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:53.286269    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/ovn-acl-logging/0.log"
Jun 03 01:40:53.286655 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:53.286636    2577 generic.go:358] "Generic (PLEG): container finished" podID="b49da4f9-9aed-4820-9908-ced2843a97f6" containerID="21dd72d38f9abecabae84ff5f3fe245046c964bfd140b108eab0da31587b07b1" exitCode=1
Jun 03 01:40:53.286735 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:53.286692    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtd96" event={"ID":"b49da4f9-9aed-4820-9908-ced2843a97f6","Type":"ContainerStarted","Data":"61bf440560b1d47ec1e80e0b1d39249d65a3523b80e6b812b4e0b05e8b895588"}
Jun 03 01:40:53.286735 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:53.286725    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtd96" event={"ID":"b49da4f9-9aed-4820-9908-ced2843a97f6","Type":"ContainerStarted","Data":"f05ad5a0044dd864162dd6a99c19230e108027b974712f128c66039d12539aea"}
Jun 03 01:40:53.286843 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:53.286740    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtd96" event={"ID":"b49da4f9-9aed-4820-9908-ced2843a97f6","Type":"ContainerStarted","Data":"2fad649fff3cd934b4981cb69648db688420759b2f6e12e4294e205e4b07d1d7"}
Jun 03 01:40:53.286843 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:53.286754    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtd96" event={"ID":"b49da4f9-9aed-4820-9908-ced2843a97f6","Type":"ContainerStarted","Data":"ab50356ef72012036982591f3ff9d060684be385d7d51f5d9007c4687bfd02bb"}
Jun 03 01:40:53.286843 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:53.286766    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtd96" event={"ID":"b49da4f9-9aed-4820-9908-ced2843a97f6","Type":"ContainerDied","Data":"21dd72d38f9abecabae84ff5f3fe245046c964bfd140b108eab0da31587b07b1"}
Jun 03 01:40:53.288384 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:53.288355    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kq6lz" event={"ID":"6dd7eb65-6fd1-4d72-a705-68df80e3c9f9","Type":"ContainerStarted","Data":"b668d37fe8edfa59d8e4a72ef7b1f1f61b1a33f2e738fac349af6084b35e8777"}
Jun 03 01:40:53.289602 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:53.289559    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gmwmw" event={"ID":"30eae78c-3802-46f5-a21a-c3f9fd825044","Type":"ContainerStarted","Data":"a75d88fbf7f71feeba0c5fe6ce71e5ff19dda45ea96192c593e2068e55ee3edd"}
Jun 03 01:40:53.293065 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:53.293019    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9p5l6" podStartSLOduration=2.662987122 podStartE2EDuration="22.293004209s" podCreationTimestamp="2026-06-03 01:40:31 +0000 UTC" firstStartedPulling="2026-06-03 01:40:32.367897533 +0000 UTC m=+1.932293322" lastFinishedPulling="2026-06-03 01:40:51.997914614 +0000 UTC m=+21.562310409" observedRunningTime="2026-06-03 01:40:53.292321606 +0000 UTC m=+22.856717423" watchObservedRunningTime="2026-06-03 01:40:53.293004209 +0000 UTC m=+22.857400022"
Jun 03 01:40:53.293418 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:53.293388    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal" podStartSLOduration=22.29338032 podStartE2EDuration="22.29338032s" podCreationTimestamp="2026-06-03 01:40:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:40:52.292440308 +0000 UTC m=+21.856836115" watchObservedRunningTime="2026-06-03 01:40:53.29338032 +0000 UTC m=+22.857776132"
Jun 03 01:40:53.319603 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:53.319523    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-j6knj" podStartSLOduration=2.6614708030000003 podStartE2EDuration="22.319505157s" podCreationTimestamp="2026-06-03 01:40:31 +0000 UTC" firstStartedPulling="2026-06-03 01:40:32.339903784 +0000 UTC m=+1.904299573" lastFinishedPulling="2026-06-03 01:40:51.997938132 +0000 UTC m=+21.562333927" observedRunningTime="2026-06-03 01:40:53.305981547 +0000 UTC m=+22.870377363" watchObservedRunningTime="2026-06-03 01:40:53.319505157 +0000 UTC m=+22.883900972"
Jun 03 01:40:53.336234 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:53.336184    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-gmwmw" podStartSLOduration=2.454908337 podStartE2EDuration="22.336166458s" podCreationTimestamp="2026-06-03 01:40:31 +0000 UTC" firstStartedPulling="2026-06-03 01:40:32.288164839 +0000 UTC m=+1.852560630" lastFinishedPulling="2026-06-03 01:40:52.169422949 +0000 UTC m=+21.733818751" observedRunningTime="2026-06-03 01:40:53.33557439 +0000 UTC m=+22.899970204" watchObservedRunningTime="2026-06-03 01:40:53.336166458 +0000 UTC m=+22.900562271"
Jun 03 01:40:53.350303 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:53.350265    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kq6lz" podStartSLOduration=10.926791132 podStartE2EDuration="22.350249334s" podCreationTimestamp="2026-06-03 01:40:31 +0000 UTC" firstStartedPulling="2026-06-03 01:40:32.345681353 +0000 UTC m=+1.910077142" lastFinishedPulling="2026-06-03 01:40:43.769139542 +0000 UTC m=+13.333535344" observedRunningTime="2026-06-03 01:40:53.350002168 +0000 UTC m=+22.914397979" watchObservedRunningTime="2026-06-03 01:40:53.350249334 +0000 UTC m=+22.914645144"
Jun 03 01:40:53.387003 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:53.386977    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 03 01:40:54.023922 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:54.023732    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T01:40:53.386998548Z","UUID":"630651e7-683c-42aa-ba40-770fb3dec968","Handler":null,"Name":"","Endpoint":""}
Jun 03 01:40:54.025506 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:54.025482    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 03 01:40:54.025641 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:54.025514    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 03 01:40:54.073901 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:54.073867    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:40:54.074073 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:54.073867    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:40:54.074073 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:54.073984    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcml4" podUID="0843251b-e289-4bda-abcc-d9d49b1d2d00"
Jun 03 01:40:54.074219 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:54.074102    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwwq7" podUID="212f3e8b-a98d-4191-a9b8-b42694d05b21"
Jun 03 01:40:54.293473 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:54.293415    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal" event={"ID":"3803111852fe7b3fb1e052a82492729c","Type":"ContainerStarted","Data":"3ad870f200c834a92b97bc26efccda2c558cf3d7bf6bc88784342146e71bd967"}
Jun 03 01:40:54.296033 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:54.296004    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bdxf9" event={"ID":"8739a591-8c31-4586-94c5-12095870e6b0","Type":"ContainerStarted","Data":"e95e1f81537d77d8e11379903f56ddfe6dc6e5c25001928970b4dc6da945830f"}
Jun 03 01:40:54.301977 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:54.301940    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj" event={"ID":"8152c872-c23d-4010-8ec1-2c288385de45","Type":"ContainerStarted","Data":"2f9ee00e8ec94a9c16e2ace1a06d0183aa2a56850e7423d82866b58a761ba631"}
Jun 03 01:40:54.308728 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:54.308678    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal" podStartSLOduration=23.308661845 podStartE2EDuration="23.308661845s" podCreationTimestamp="2026-06-03 01:40:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:40:54.308571647 +0000 UTC m=+23.872967461" watchObservedRunningTime="2026-06-03 01:40:54.308661845 +0000 UTC m=+23.873057656"
Jun 03 01:40:54.324203 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:54.324140    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bdxf9" podStartSLOduration=3.633240463 podStartE2EDuration="23.324120745s" podCreationTimestamp="2026-06-03 01:40:31 +0000 UTC" firstStartedPulling="2026-06-03 01:40:32.307107181 +0000 UTC m=+1.871502970" lastFinishedPulling="2026-06-03 01:40:51.997987457 +0000 UTC m=+21.562383252" observedRunningTime="2026-06-03 01:40:54.323999943 +0000 UTC m=+23.888395753" watchObservedRunningTime="2026-06-03 01:40:54.324120745 +0000 UTC m=+23.888516559"
Jun 03 01:40:55.306798 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:55.306616    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/ovn-acl-logging/0.log"
Jun 03 01:40:55.307206 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:55.307170    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtd96" event={"ID":"b49da4f9-9aed-4820-9908-ced2843a97f6","Type":"ContainerStarted","Data":"352355fa6c22f47a08751dde1e9fa13e8b150b65308422fc09b6d535d8abab75"}
Jun 03 01:40:55.309156 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:55.309127    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj" event={"ID":"8152c872-c23d-4010-8ec1-2c288385de45","Type":"ContainerStarted","Data":"402ef201c8469cc7c488114715ab34ad56e987dd60ff0d29bbd46f50867bbd82"}
Jun 03 01:40:55.325107 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:55.325057    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw7cj" podStartSLOduration=2.377268145 podStartE2EDuration="24.32504128s" podCreationTimestamp="2026-06-03 01:40:31 +0000 UTC" firstStartedPulling="2026-06-03 01:40:32.270101792 +0000 UTC m=+1.834497581" lastFinishedPulling="2026-06-03 01:40:54.217874917 +0000 UTC m=+23.782270716" observedRunningTime="2026-06-03 01:40:55.324525987 +0000 UTC m=+24.888921798" watchObservedRunningTime="2026-06-03 01:40:55.32504128 +0000 UTC m=+24.889437091"
Jun 03 01:40:56.074663 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:56.074621    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:40:56.075054 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:56.074621    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:40:56.075054 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:56.074755    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwwq7" podUID="212f3e8b-a98d-4191-a9b8-b42694d05b21"
Jun 03 01:40:56.075054 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:56.074853    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcml4" podUID="0843251b-e289-4bda-abcc-d9d49b1d2d00"
Jun 03 01:40:57.964161 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:57.963903    2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9p5l6"
Jun 03 01:40:57.964913 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:57.964635    2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9p5l6"
Jun 03 01:40:58.074445 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:58.074404    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:40:58.074627 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:58.074404    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:40:58.074627 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:58.074525    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcml4" podUID="0843251b-e289-4bda-abcc-d9d49b1d2d00"
Jun 03 01:40:58.074627 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:58.074611    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwwq7" podUID="212f3e8b-a98d-4191-a9b8-b42694d05b21"
Jun 03 01:40:58.316428 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:58.316394    2577 generic.go:358] "Generic (PLEG): container finished" podID="b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15" containerID="4c4f5ab0e963798f558f8e09279f93f99e1ea6c66cb4e510010632211c16cc6a" exitCode=0
Jun 03 01:40:58.316574 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:58.316472    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd5c9" event={"ID":"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15","Type":"ContainerDied","Data":"4c4f5ab0e963798f558f8e09279f93f99e1ea6c66cb4e510010632211c16cc6a"}
Jun 03 01:40:58.319738 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:58.319720    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/ovn-acl-logging/0.log"
Jun 03 01:40:58.320122 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:58.320092    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtd96" event={"ID":"b49da4f9-9aed-4820-9908-ced2843a97f6","Type":"ContainerStarted","Data":"db4274a9b5d85413c5c0503f699717499e709657506a5d5fb76b4963e66444a8"}
Jun 03 01:40:58.320298 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:58.320284    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9p5l6"
Jun 03 01:40:58.320598 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:58.320558    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:58.320687 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:58.320671    2577 scope.go:117] "RemoveContainer" containerID="21dd72d38f9abecabae84ff5f3fe245046c964bfd140b108eab0da31587b07b1"
Jun 03 01:40:58.320790 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:58.320774    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9p5l6"
Jun 03 01:40:58.336542 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:58.336519    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:59.324141 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:59.323946    2577 generic.go:358] "Generic (PLEG): container finished" podID="b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15" containerID="4058ac74403dae7a989db5e0c37be58887eacb92dcec107bd707eec949e75f10" exitCode=0
Jun 03 01:40:59.324560 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:59.324085    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd5c9" event={"ID":"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15","Type":"ContainerDied","Data":"4058ac74403dae7a989db5e0c37be58887eacb92dcec107bd707eec949e75f10"}
Jun 03 01:40:59.328697 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:59.328675    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/ovn-acl-logging/0.log"
Jun 03 01:40:59.329122 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:59.329090    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qtd96" event={"ID":"b49da4f9-9aed-4820-9908-ced2843a97f6","Type":"ContainerStarted","Data":"75837d51a17498703ce0a3991bc4f457d60e75d0c5e8df541ace1d1aabcbb43f"}
Jun 03 01:40:59.329315 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:59.329296    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:59.329478 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:59.329322    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:59.346130 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:59.346104    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:40:59.368708 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:59.368655    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qtd96" podStartSLOduration=8.687552923 podStartE2EDuration="28.368641782s" podCreationTimestamp="2026-06-03 01:40:31 +0000 UTC" firstStartedPulling="2026-06-03 01:40:32.360677589 +0000 UTC m=+1.925073393" lastFinishedPulling="2026-06-03 01:40:52.041766451 +0000 UTC m=+21.606162252" observedRunningTime="2026-06-03 01:40:59.367986683 +0000 UTC m=+28.932382493" watchObservedRunningTime="2026-06-03 01:40:59.368641782 +0000 UTC m=+28.933037593"
Jun 03 01:40:59.515469 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:59.515418    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hcml4"]
Jun 03 01:40:59.515636 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:59.515577    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:40:59.515727 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:59.515705    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcml4" podUID="0843251b-e289-4bda-abcc-d9d49b1d2d00"
Jun 03 01:40:59.516147 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:59.516128    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zwwq7"]
Jun 03 01:40:59.516245 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:40:59.516232    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:40:59.516339 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:40:59.516322    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwwq7" podUID="212f3e8b-a98d-4191-a9b8-b42694d05b21"
Jun 03 01:41:00.333236 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:00.333142    2577 generic.go:358] "Generic (PLEG): container finished" podID="b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15" containerID="d3af1814f076be87d20db8ce945507f899243e290b6bcacf90eb0054e0aff596" exitCode=0
Jun 03 01:41:00.333765 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:00.333224    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd5c9" event={"ID":"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15","Type":"ContainerDied","Data":"d3af1814f076be87d20db8ce945507f899243e290b6bcacf90eb0054e0aff596"}
Jun 03 01:41:01.075863 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:01.075822    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:41:01.076016 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:01.075949    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcml4" podUID="0843251b-e289-4bda-abcc-d9d49b1d2d00"
Jun 03 01:41:01.076016 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:01.075998    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:41:01.076148 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:01.076127    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwwq7" podUID="212f3e8b-a98d-4191-a9b8-b42694d05b21"
Jun 03 01:41:03.076791 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:03.076717    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:41:03.077382 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:03.076717    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:41:03.077382 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:03.076820    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zwwq7" podUID="212f3e8b-a98d-4191-a9b8-b42694d05b21"
Jun 03 01:41:03.077382 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:03.076904    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcml4" podUID="0843251b-e289-4bda-abcc-d9d49b1d2d00"
Jun 03 01:41:03.703268 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:03.703219    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs\") pod \"network-metrics-daemon-zwwq7\" (UID: \"212f3e8b-a98d-4191-a9b8-b42694d05b21\") " pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:41:03.703480 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:03.703369    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:41:03.703480 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:03.703454    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs podName:212f3e8b-a98d-4191-a9b8-b42694d05b21 nodeName:}" failed. No retries permitted until 2026-06-03 01:41:35.703431399 +0000 UTC m=+65.267827200 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs") pod "network-metrics-daemon-zwwq7" (UID: "212f3e8b-a98d-4191-a9b8-b42694d05b21") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:41:03.905002 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:03.904959    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7ddt\" (UniqueName: \"kubernetes.io/projected/0843251b-e289-4bda-abcc-d9d49b1d2d00-kube-api-access-k7ddt\") pod \"network-check-target-hcml4\" (UID: \"0843251b-e289-4bda-abcc-d9d49b1d2d00\") " pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:41:03.905187 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:03.905148    2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 01:41:03.905187 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:03.905173    2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 01:41:03.905187 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:03.905186    2577 projected.go:194] Error preparing data for projected volume kube-api-access-k7ddt for pod openshift-network-diagnostics/network-check-target-hcml4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:41:03.905331 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:03.905256    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0843251b-e289-4bda-abcc-d9d49b1d2d00-kube-api-access-k7ddt podName:0843251b-e289-4bda-abcc-d9d49b1d2d00 nodeName:}" failed. No retries permitted until 2026-06-03 01:41:35.905235589 +0000 UTC m=+65.469631380 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-k7ddt" (UniqueName: "kubernetes.io/projected/0843251b-e289-4bda-abcc-d9d49b1d2d00-kube-api-access-k7ddt") pod "network-check-target-hcml4" (UID: "0843251b-e289-4bda-abcc-d9d49b1d2d00") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:41:04.707548 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:04.707521    2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeReady"
Jun 03 01:41:04.707986 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:04.707675    2577 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
Jun 03 01:41:04.746943 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:04.746904    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zthbg"]
Jun 03 01:41:04.771029 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:04.770994    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-96vwc"]
Jun 03 01:41:04.771215 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:04.771184    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zthbg"
Jun 03 01:41:04.773630 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:04.773602    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 03 01:41:04.773630 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:04.773622    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2xcbn\""
Jun 03 01:41:04.773830 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:04.773730    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 03 01:41:04.786931 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:04.786899    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zthbg"]
Jun 03 01:41:04.787087 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:04.787042    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-96vwc"]
Jun 03 01:41:04.787152 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:04.787085    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-96vwc"
Jun 03 01:41:04.790255 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:04.790229    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 03 01:41:04.790880 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:04.790857    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tsbnv\""
Jun 03 01:41:04.791001 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:04.790916    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 03 01:41:04.791001 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:04.790925    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 03 01:41:04.913817 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:04.913717    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3864081-3019-44a7-8958-5075918ca6b3-tmp-dir\") pod \"dns-default-zthbg\" (UID: \"b3864081-3019-44a7-8958-5075918ca6b3\") " pod="openshift-dns/dns-default-zthbg"
Jun 03 01:41:04.913817 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:04.913771    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b3864081-3019-44a7-8958-5075918ca6b3-config-volume\") pod \"dns-default-zthbg\" (UID: \"b3864081-3019-44a7-8958-5075918ca6b3\") " pod="openshift-dns/dns-default-zthbg"
Jun 03 01:41:04.913817 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:04.913796    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cp9g\" (UniqueName: \"kubernetes.io/projected/b3864081-3019-44a7-8958-5075918ca6b3-kube-api-access-9cp9g\") pod \"dns-default-zthbg\" (UID: \"b3864081-3019-44a7-8958-5075918ca6b3\") " pod="openshift-dns/dns-default-zthbg"
Jun 03 01:41:04.914069 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:04.913876    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv84t\" (UniqueName: \"kubernetes.io/projected/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-kube-api-access-vv84t\") pod \"ingress-canary-96vwc\" (UID: \"ab8c3cff-b7cf-4b1e-bc43-a690f753ec12\") " pod="openshift-ingress-canary/ingress-canary-96vwc"
Jun 03 01:41:04.914069 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:04.913920    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls\") pod \"dns-default-zthbg\" (UID: \"b3864081-3019-44a7-8958-5075918ca6b3\") " pod="openshift-dns/dns-default-zthbg"
Jun 03 01:41:04.914069 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:04.913958    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert\") pod \"ingress-canary-96vwc\" (UID: \"ab8c3cff-b7cf-4b1e-bc43-a690f753ec12\") " pod="openshift-ingress-canary/ingress-canary-96vwc"
Jun 03 01:41:05.014829 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:05.014792    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b3864081-3019-44a7-8958-5075918ca6b3-config-volume\") pod \"dns-default-zthbg\" (UID: \"b3864081-3019-44a7-8958-5075918ca6b3\") " pod="openshift-dns/dns-default-zthbg"
Jun 03 01:41:05.014829 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:05.014837    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9cp9g\" (UniqueName: \"kubernetes.io/projected/b3864081-3019-44a7-8958-5075918ca6b3-kube-api-access-9cp9g\") pod \"dns-default-zthbg\" (UID: \"b3864081-3019-44a7-8958-5075918ca6b3\") " pod="openshift-dns/dns-default-zthbg"
Jun 03 01:41:05.015091 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:05.014887    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vv84t\" (UniqueName: \"kubernetes.io/projected/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-kube-api-access-vv84t\") pod \"ingress-canary-96vwc\" (UID: \"ab8c3cff-b7cf-4b1e-bc43-a690f753ec12\") " pod="openshift-ingress-canary/ingress-canary-96vwc"
Jun 03 01:41:05.015091 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:05.014913    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls\") pod \"dns-default-zthbg\" (UID: \"b3864081-3019-44a7-8958-5075918ca6b3\") " pod="openshift-dns/dns-default-zthbg"
Jun 03 01:41:05.015091 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:05.014944    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert\") pod \"ingress-canary-96vwc\" (UID: \"ab8c3cff-b7cf-4b1e-bc43-a690f753ec12\") " pod="openshift-ingress-canary/ingress-canary-96vwc"
Jun 03 01:41:05.015091 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:05.015031    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3864081-3019-44a7-8958-5075918ca6b3-tmp-dir\") pod \"dns-default-zthbg\" (UID: \"b3864081-3019-44a7-8958-5075918ca6b3\") " pod="openshift-dns/dns-default-zthbg"
Jun 03 01:41:05.015294 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:05.015200    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 01:41:05.015294 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:05.015278    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls podName:b3864081-3019-44a7-8958-5075918ca6b3 nodeName:}" failed. No retries permitted until 2026-06-03 01:41:05.515258759 +0000 UTC m=+35.079654551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls") pod "dns-default-zthbg" (UID: "b3864081-3019-44a7-8958-5075918ca6b3") : secret "dns-default-metrics-tls" not found
Jun 03 01:41:05.015403 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:05.015337    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3864081-3019-44a7-8958-5075918ca6b3-tmp-dir\") pod \"dns-default-zthbg\" (UID: \"b3864081-3019-44a7-8958-5075918ca6b3\") " pod="openshift-dns/dns-default-zthbg"
Jun 03 01:41:05.015403 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:05.015382    2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 01:41:05.015478 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:05.015446    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert podName:ab8c3cff-b7cf-4b1e-bc43-a690f753ec12 nodeName:}" failed. No retries permitted until 2026-06-03 01:41:05.515430675 +0000 UTC m=+35.079826469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert") pod "ingress-canary-96vwc" (UID: "ab8c3cff-b7cf-4b1e-bc43-a690f753ec12") : secret "canary-serving-cert" not found
Jun 03 01:41:05.015478 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:05.015462    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b3864081-3019-44a7-8958-5075918ca6b3-config-volume\") pod \"dns-default-zthbg\" (UID: \"b3864081-3019-44a7-8958-5075918ca6b3\") " pod="openshift-dns/dns-default-zthbg"
Jun 03 01:41:05.025931 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:05.025734    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv84t\" (UniqueName: \"kubernetes.io/projected/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-kube-api-access-vv84t\") pod \"ingress-canary-96vwc\" (UID: \"ab8c3cff-b7cf-4b1e-bc43-a690f753ec12\") " pod="openshift-ingress-canary/ingress-canary-96vwc"
Jun 03 01:41:05.025931 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:05.025923    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cp9g\" (UniqueName: \"kubernetes.io/projected/b3864081-3019-44a7-8958-5075918ca6b3-kube-api-access-9cp9g\") pod \"dns-default-zthbg\" (UID: \"b3864081-3019-44a7-8958-5075918ca6b3\") " pod="openshift-dns/dns-default-zthbg"
Jun 03 01:41:05.077865 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:05.077832    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:41:05.078048 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:05.077832    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:41:05.080783 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:05.080747    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 03 01:41:05.080783 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:05.080767    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hpsd7\""
Jun 03 01:41:05.080783 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:05.080774    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 03 01:41:05.080783 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:05.080787    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sx8gm\""
Jun 03 01:41:05.081090 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:05.080785    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 03 01:41:05.518496 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:05.518457    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls\") pod \"dns-default-zthbg\" (UID: \"b3864081-3019-44a7-8958-5075918ca6b3\") " pod="openshift-dns/dns-default-zthbg"
Jun 03 01:41:05.518705 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:05.518511    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert\") pod \"ingress-canary-96vwc\" (UID: \"ab8c3cff-b7cf-4b1e-bc43-a690f753ec12\") " pod="openshift-ingress-canary/ingress-canary-96vwc"
Jun 03 01:41:05.518705 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:05.518620    2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 01:41:05.518705 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:05.518625    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 01:41:05.518705 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:05.518676    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert podName:ab8c3cff-b7cf-4b1e-bc43-a690f753ec12 nodeName:}" failed. No retries permitted until 2026-06-03 01:41:06.518657533 +0000 UTC m=+36.083053323 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert") pod "ingress-canary-96vwc" (UID: "ab8c3cff-b7cf-4b1e-bc43-a690f753ec12") : secret "canary-serving-cert" not found
Jun 03 01:41:05.518705 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:05.518695    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls podName:b3864081-3019-44a7-8958-5075918ca6b3 nodeName:}" failed. No retries permitted until 2026-06-03 01:41:06.518686009 +0000 UTC m=+36.083081798 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls") pod "dns-default-zthbg" (UID: "b3864081-3019-44a7-8958-5075918ca6b3") : secret "dns-default-metrics-tls" not found
Jun 03 01:41:06.526216 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:06.526176    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls\") pod \"dns-default-zthbg\" (UID: \"b3864081-3019-44a7-8958-5075918ca6b3\") " pod="openshift-dns/dns-default-zthbg"
Jun 03 01:41:06.526684 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:06.526237    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert\") pod \"ingress-canary-96vwc\" (UID: \"ab8c3cff-b7cf-4b1e-bc43-a690f753ec12\") " pod="openshift-ingress-canary/ingress-canary-96vwc"
Jun 03 01:41:06.526684 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:06.526335    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 01:41:06.526684 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:06.526363    2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 01:41:06.526684 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:06.526432    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls podName:b3864081-3019-44a7-8958-5075918ca6b3 nodeName:}" failed. No retries permitted until 2026-06-03 01:41:08.526408342 +0000 UTC m=+38.090804135 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls") pod "dns-default-zthbg" (UID: "b3864081-3019-44a7-8958-5075918ca6b3") : secret "dns-default-metrics-tls" not found
Jun 03 01:41:06.526684 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:06.526457    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert podName:ab8c3cff-b7cf-4b1e-bc43-a690f753ec12 nodeName:}" failed. No retries permitted until 2026-06-03 01:41:08.526446547 +0000 UTC m=+38.090842342 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert") pod "ingress-canary-96vwc" (UID: "ab8c3cff-b7cf-4b1e-bc43-a690f753ec12") : secret "canary-serving-cert" not found
Jun 03 01:41:07.348992 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:07.348954    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd5c9" event={"ID":"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15","Type":"ContainerStarted","Data":"0b8505509cd41bab6dc2ab79575ddba1025ce7cfbbec42eef5ae1113dd9eb62e"}
Jun 03 01:41:08.353294 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:08.353260    2577 generic.go:358] "Generic (PLEG): container finished" podID="b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15" containerID="0b8505509cd41bab6dc2ab79575ddba1025ce7cfbbec42eef5ae1113dd9eb62e" exitCode=0
Jun 03 01:41:08.353294 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:08.353305    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd5c9" event={"ID":"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15","Type":"ContainerDied","Data":"0b8505509cd41bab6dc2ab79575ddba1025ce7cfbbec42eef5ae1113dd9eb62e"}
Jun 03 01:41:08.539100 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:08.539056    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls\") pod \"dns-default-zthbg\" (UID: \"b3864081-3019-44a7-8958-5075918ca6b3\") " pod="openshift-dns/dns-default-zthbg"
Jun 03 01:41:08.539234 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:08.539119    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert\") pod \"ingress-canary-96vwc\" (UID: \"ab8c3cff-b7cf-4b1e-bc43-a690f753ec12\") " pod="openshift-ingress-canary/ingress-canary-96vwc"
Jun 03 01:41:08.539234 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:08.539200    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 01:41:08.539347 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:08.539262    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls podName:b3864081-3019-44a7-8958-5075918ca6b3 nodeName:}" failed. No retries permitted until 2026-06-03 01:41:12.539246496 +0000 UTC m=+42.103642291 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls") pod "dns-default-zthbg" (UID: "b3864081-3019-44a7-8958-5075918ca6b3") : secret "dns-default-metrics-tls" not found
Jun 03 01:41:08.539347 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:08.539274    2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 01:41:08.539435 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:08.539353    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert podName:ab8c3cff-b7cf-4b1e-bc43-a690f753ec12 nodeName:}" failed. No retries permitted until 2026-06-03 01:41:12.539334621 +0000 UTC m=+42.103730426 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert") pod "ingress-canary-96vwc" (UID: "ab8c3cff-b7cf-4b1e-bc43-a690f753ec12") : secret "canary-serving-cert" not found
Jun 03 01:41:09.358445 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:09.358352    2577 generic.go:358] "Generic (PLEG): container finished" podID="b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15" containerID="b9f647af940ee55b6f495b62fa026ff2eb54e7cd8dae4b0a9d15bb30c398f166" exitCode=0
Jun 03 01:41:09.358445 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:09.358428    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd5c9" event={"ID":"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15","Type":"ContainerDied","Data":"b9f647af940ee55b6f495b62fa026ff2eb54e7cd8dae4b0a9d15bb30c398f166"}
Jun 03 01:41:10.365619 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:10.365570    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd5c9" event={"ID":"b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15","Type":"ContainerStarted","Data":"2f21225ee1075e8a7921065e39d38163a493fe9d7e5436d134c70a67bcf52310"}
Jun 03 01:41:10.386922 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:10.386869    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cd5c9" podStartSLOduration=4.527191086 podStartE2EDuration="39.386857017s" podCreationTimestamp="2026-06-03 01:40:31 +0000 UTC" firstStartedPulling="2026-06-03 01:40:32.350970047 +0000 UTC m=+1.915365837" lastFinishedPulling="2026-06-03 01:41:07.210635976 +0000 UTC m=+36.775031768" observedRunningTime="2026-06-03 01:41:10.385692647 +0000 UTC m=+39.950088458" watchObservedRunningTime="2026-06-03 01:41:10.386857017 +0000 UTC m=+39.951252819"
Jun 03 01:41:12.570430 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:12.570387    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls\") pod \"dns-default-zthbg\" (UID: \"b3864081-3019-44a7-8958-5075918ca6b3\") " pod="openshift-dns/dns-default-zthbg"
Jun 03 01:41:12.570430 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:12.570440    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert\") pod \"ingress-canary-96vwc\" (UID: \"ab8c3cff-b7cf-4b1e-bc43-a690f753ec12\") " pod="openshift-ingress-canary/ingress-canary-96vwc"
Jun 03 01:41:12.570881 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:12.570558    2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 01:41:12.570881 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:12.570634    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert podName:ab8c3cff-b7cf-4b1e-bc43-a690f753ec12 nodeName:}" failed. No retries permitted until 2026-06-03 01:41:20.570619174 +0000 UTC m=+50.135014972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert") pod "ingress-canary-96vwc" (UID: "ab8c3cff-b7cf-4b1e-bc43-a690f753ec12") : secret "canary-serving-cert" not found
Jun 03 01:41:12.570881 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:12.570558    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 01:41:12.570881 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:12.570706    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls podName:b3864081-3019-44a7-8958-5075918ca6b3 nodeName:}" failed. No retries permitted until 2026-06-03 01:41:20.570695191 +0000 UTC m=+50.135090994 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls") pod "dns-default-zthbg" (UID: "b3864081-3019-44a7-8958-5075918ca6b3") : secret "dns-default-metrics-tls" not found
Jun 03 01:41:20.626118 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:20.626077    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls\") pod \"dns-default-zthbg\" (UID: \"b3864081-3019-44a7-8958-5075918ca6b3\") " pod="openshift-dns/dns-default-zthbg"
Jun 03 01:41:20.626628 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:20.626131    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert\") pod \"ingress-canary-96vwc\" (UID: \"ab8c3cff-b7cf-4b1e-bc43-a690f753ec12\") " pod="openshift-ingress-canary/ingress-canary-96vwc"
Jun 03 01:41:20.626628 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:20.626237    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 01:41:20.626628 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:20.626260    2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 01:41:20.626628 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:20.626312    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls podName:b3864081-3019-44a7-8958-5075918ca6b3 nodeName:}" failed. No retries permitted until 2026-06-03 01:41:36.626292716 +0000 UTC m=+66.190688505 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls") pod "dns-default-zthbg" (UID: "b3864081-3019-44a7-8958-5075918ca6b3") : secret "dns-default-metrics-tls" not found
Jun 03 01:41:20.626628 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:20.626327    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert podName:ab8c3cff-b7cf-4b1e-bc43-a690f753ec12 nodeName:}" failed. No retries permitted until 2026-06-03 01:41:36.626320967 +0000 UTC m=+66.190716755 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert") pod "ingress-canary-96vwc" (UID: "ab8c3cff-b7cf-4b1e-bc43-a690f753ec12") : secret "canary-serving-cert" not found
Jun 03 01:41:31.345504 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:31.345475    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qtd96"
Jun 03 01:41:35.727150 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:35.727108    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs\") pod \"network-metrics-daemon-zwwq7\" (UID: \"212f3e8b-a98d-4191-a9b8-b42694d05b21\") " pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:41:35.729837 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:35.729813    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 03 01:41:35.737649 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:35.737620    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 03 01:41:35.737776 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:35.737696    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs podName:212f3e8b-a98d-4191-a9b8-b42694d05b21 nodeName:}" failed. No retries permitted until 2026-06-03 01:42:39.737677124 +0000 UTC m=+129.302072918 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs") pod "network-metrics-daemon-zwwq7" (UID: "212f3e8b-a98d-4191-a9b8-b42694d05b21") : secret "metrics-daemon-secret" not found
Jun 03 01:41:35.928696 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:35.928657    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7ddt\" (UniqueName: \"kubernetes.io/projected/0843251b-e289-4bda-abcc-d9d49b1d2d00-kube-api-access-k7ddt\") pod \"network-check-target-hcml4\" (UID: \"0843251b-e289-4bda-abcc-d9d49b1d2d00\") " pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:41:35.931446 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:35.931425    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 03 01:41:35.941306 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:35.941283    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 03 01:41:35.953309 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:35.953286    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7ddt\" (UniqueName: \"kubernetes.io/projected/0843251b-e289-4bda-abcc-d9d49b1d2d00-kube-api-access-k7ddt\") pod \"network-check-target-hcml4\" (UID: \"0843251b-e289-4bda-abcc-d9d49b1d2d00\") " pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:41:35.991683 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:35.991603    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hpsd7\""
Jun 03 01:41:35.999732 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:35.999710    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:41:36.128760 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:36.128699    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hcml4"]
Jun 03 01:41:36.132697 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:41:36.132657    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0843251b_e289_4bda_abcc_d9d49b1d2d00.slice/crio-089863944baff0b6e0b81cee1ec11c20e516c9cee0f3d90b3744086b47ac0173 WatchSource:0}: Error finding container 089863944baff0b6e0b81cee1ec11c20e516c9cee0f3d90b3744086b47ac0173: Status 404 returned error can't find the container with id 089863944baff0b6e0b81cee1ec11c20e516c9cee0f3d90b3744086b47ac0173
Jun 03 01:41:36.412772 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:36.412738    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hcml4" event={"ID":"0843251b-e289-4bda-abcc-d9d49b1d2d00","Type":"ContainerStarted","Data":"089863944baff0b6e0b81cee1ec11c20e516c9cee0f3d90b3744086b47ac0173"}
Jun 03 01:41:36.633060 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:36.633012    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls\") pod \"dns-default-zthbg\" (UID: \"b3864081-3019-44a7-8958-5075918ca6b3\") " pod="openshift-dns/dns-default-zthbg"
Jun 03 01:41:36.633225 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:36.633067    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert\") pod \"ingress-canary-96vwc\" (UID: \"ab8c3cff-b7cf-4b1e-bc43-a690f753ec12\") " pod="openshift-ingress-canary/ingress-canary-96vwc"
Jun 03 01:41:36.633225 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:36.633163    2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 01:41:36.633323 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:36.633230    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert podName:ab8c3cff-b7cf-4b1e-bc43-a690f753ec12 nodeName:}" failed. No retries permitted until 2026-06-03 01:42:08.633209652 +0000 UTC m=+98.197605447 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert") pod "ingress-canary-96vwc" (UID: "ab8c3cff-b7cf-4b1e-bc43-a690f753ec12") : secret "canary-serving-cert" not found
Jun 03 01:41:36.633323 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:36.633163    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 01:41:36.633323 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:41:36.633318    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls podName:b3864081-3019-44a7-8958-5075918ca6b3 nodeName:}" failed. No retries permitted until 2026-06-03 01:42:08.633297579 +0000 UTC m=+98.197693377 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls") pod "dns-default-zthbg" (UID: "b3864081-3019-44a7-8958-5075918ca6b3") : secret "dns-default-metrics-tls" not found
Jun 03 01:41:39.420317 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:39.420219    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hcml4" event={"ID":"0843251b-e289-4bda-abcc-d9d49b1d2d00","Type":"ContainerStarted","Data":"876cdf4bb57ea66a537fe90a35b32fd6d7068c072f27dca9ea78672502fc773f"}
Jun 03 01:41:39.420783 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:39.420332    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:41:39.438224 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:41:39.438173    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hcml4" podStartSLOduration=65.407740636 podStartE2EDuration="1m8.438157742s" podCreationTimestamp="2026-06-03 01:40:31 +0000 UTC" firstStartedPulling="2026-06-03 01:41:36.13643712 +0000 UTC m=+65.700832922" lastFinishedPulling="2026-06-03 01:41:39.166854229 +0000 UTC m=+68.731250028" observedRunningTime="2026-06-03 01:41:39.43786517 +0000 UTC m=+69.002260980" watchObservedRunningTime="2026-06-03 01:41:39.438157742 +0000 UTC m=+69.002553553"
Jun 03 01:42:02.848827 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.848691    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xhlkz"]
Jun 03 01:42:02.852923 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.852901    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xhlkz"
Jun 03 01:42:02.856261 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.856237    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jun 03 01:42:02.857370 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.857345    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 03 01:42:02.857519 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.857468    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fxlpj\""
Jun 03 01:42:02.857519 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.857510    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jun 03 01:42:02.857679 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.857662    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 03 01:42:02.858317 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.858289    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xhlkz"]
Jun 03 01:42:02.907509 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.907475    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-xhlkz\" (UID: \"5c6f2ce1-e70c-4c86-84e1-f2f8e7004148\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xhlkz"
Jun 03 01:42:02.907509 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.907516    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qt9z\" (UniqueName: \"kubernetes.io/projected/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-kube-api-access-6qt9z\") pod \"cluster-monitoring-operator-69b6cbdb88-xhlkz\" (UID: \"5c6f2ce1-e70c-4c86-84e1-f2f8e7004148\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xhlkz"
Jun 03 01:42:02.907750 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.907633    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-xhlkz\" (UID: \"5c6f2ce1-e70c-4c86-84e1-f2f8e7004148\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xhlkz"
Jun 03 01:42:02.949752 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.949718    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-9j24t"]
Jun 03 01:42:02.952499 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.952475    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-9j24t"
Jun 03 01:42:02.952787 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.952731    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6fd64f4d5f-4qdl5"]
Jun 03 01:42:02.954636 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.954608    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jun 03 01:42:02.954863 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.954847    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 03 01:42:02.954948 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.954883    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jun 03 01:42:02.955004 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.954966    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-9twsn\""
Jun 03 01:42:02.955181 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.955165    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 03 01:42:02.955510 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.955491    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:02.957908 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.957888    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jun 03 01:42:02.957908 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.957903    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jun 03 01:42:02.958050 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.957889    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lqjw6\""
Jun 03 01:42:02.958050 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.957904    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 03 01:42:02.958050 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.957951    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jun 03 01:42:02.958050 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.957904    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jun 03 01:42:02.958050 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.957981    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 03 01:42:02.960510 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.960492    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jun 03 01:42:02.962603 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.962562    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-9j24t"]
Jun 03 01:42:02.966030 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:02.966008    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6fd64f4d5f-4qdl5"]
Jun 03 01:42:03.008841 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.008808    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-metrics-certs\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:03.009017 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.008857    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-xhlkz\" (UID: \"5c6f2ce1-e70c-4c86-84e1-f2f8e7004148\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xhlkz"
Jun 03 01:42:03.009017 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.008877    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d7dc8e7f-6638-40fb-9c54-6cc4902c5938-snapshots\") pod \"insights-operator-788bf58df5-9j24t\" (UID: \"d7dc8e7f-6638-40fb-9c54-6cc4902c5938\") " pod="openshift-insights/insights-operator-788bf58df5-9j24t"
Jun 03 01:42:03.009017 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.008893    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7dc8e7f-6638-40fb-9c54-6cc4902c5938-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-9j24t\" (UID: \"d7dc8e7f-6638-40fb-9c54-6cc4902c5938\") " pod="openshift-insights/insights-operator-788bf58df5-9j24t"
Jun 03 01:42:03.009017 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.008954    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7dc8e7f-6638-40fb-9c54-6cc4902c5938-service-ca-bundle\") pod \"insights-operator-788bf58df5-9j24t\" (UID: \"d7dc8e7f-6638-40fb-9c54-6cc4902c5938\") " pod="openshift-insights/insights-operator-788bf58df5-9j24t"
Jun 03 01:42:03.009017 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.009010    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c463f7df-73f3-4c28-906a-c62846ca8a4b-service-ca-bundle\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:03.009257 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:03.009029    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 01:42:03.009257 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.009042    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-default-certificate\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:03.009257 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.009067    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-stats-auth\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:03.009257 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.009102    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-xhlkz\" (UID: \"5c6f2ce1-e70c-4c86-84e1-f2f8e7004148\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xhlkz"
Jun 03 01:42:03.009257 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:03.009120    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-cluster-monitoring-operator-tls podName:5c6f2ce1-e70c-4c86-84e1-f2f8e7004148 nodeName:}" failed. No retries permitted until 2026-06-03 01:42:03.509095248 +0000 UTC m=+93.073491037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-xhlkz" (UID: "5c6f2ce1-e70c-4c86-84e1-f2f8e7004148") : secret "cluster-monitoring-operator-tls" not found
Jun 03 01:42:03.009257 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.009162    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbkdp\" (UniqueName: \"kubernetes.io/projected/c463f7df-73f3-4c28-906a-c62846ca8a4b-kube-api-access-xbkdp\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:03.009257 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.009198    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7dc8e7f-6638-40fb-9c54-6cc4902c5938-serving-cert\") pod \"insights-operator-788bf58df5-9j24t\" (UID: \"d7dc8e7f-6638-40fb-9c54-6cc4902c5938\") " pod="openshift-insights/insights-operator-788bf58df5-9j24t"
Jun 03 01:42:03.009510 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.009275    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdlff\" (UniqueName: \"kubernetes.io/projected/d7dc8e7f-6638-40fb-9c54-6cc4902c5938-kube-api-access-jdlff\") pod \"insights-operator-788bf58df5-9j24t\" (UID: \"d7dc8e7f-6638-40fb-9c54-6cc4902c5938\") " pod="openshift-insights/insights-operator-788bf58df5-9j24t"
Jun 03 01:42:03.009510 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.009319    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6qt9z\" (UniqueName: \"kubernetes.io/projected/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-kube-api-access-6qt9z\") pod \"cluster-monitoring-operator-69b6cbdb88-xhlkz\" (UID: \"5c6f2ce1-e70c-4c86-84e1-f2f8e7004148\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xhlkz"
Jun 03 01:42:03.009510 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.009480    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7dc8e7f-6638-40fb-9c54-6cc4902c5938-tmp\") pod \"insights-operator-788bf58df5-9j24t\" (UID: \"d7dc8e7f-6638-40fb-9c54-6cc4902c5938\") " pod="openshift-insights/insights-operator-788bf58df5-9j24t"
Jun 03 01:42:03.009963 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.009942    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-xhlkz\" (UID: \"5c6f2ce1-e70c-4c86-84e1-f2f8e7004148\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xhlkz"
Jun 03 01:42:03.019093 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.019068    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qt9z\" (UniqueName: \"kubernetes.io/projected/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-kube-api-access-6qt9z\") pod \"cluster-monitoring-operator-69b6cbdb88-xhlkz\" (UID: \"5c6f2ce1-e70c-4c86-84e1-f2f8e7004148\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xhlkz"
Jun 03 01:42:03.110298 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.110197    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-metrics-certs\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:03.110298 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.110263    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d7dc8e7f-6638-40fb-9c54-6cc4902c5938-snapshots\") pod \"insights-operator-788bf58df5-9j24t\" (UID: \"d7dc8e7f-6638-40fb-9c54-6cc4902c5938\") " pod="openshift-insights/insights-operator-788bf58df5-9j24t"
Jun 03 01:42:03.110298 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.110286    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7dc8e7f-6638-40fb-9c54-6cc4902c5938-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-9j24t\" (UID: \"d7dc8e7f-6638-40fb-9c54-6cc4902c5938\") " pod="openshift-insights/insights-operator-788bf58df5-9j24t"
Jun 03 01:42:03.110571 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.110310    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7dc8e7f-6638-40fb-9c54-6cc4902c5938-service-ca-bundle\") pod \"insights-operator-788bf58df5-9j24t\" (UID: \"d7dc8e7f-6638-40fb-9c54-6cc4902c5938\") " pod="openshift-insights/insights-operator-788bf58df5-9j24t"
Jun 03 01:42:03.110571 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.110336    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c463f7df-73f3-4c28-906a-c62846ca8a4b-service-ca-bundle\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:03.110571 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:03.110354    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 03 01:42:03.110571 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:03.110458    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-metrics-certs podName:c463f7df-73f3-4c28-906a-c62846ca8a4b nodeName:}" failed. No retries permitted until 2026-06-03 01:42:03.610434781 +0000 UTC m=+93.174830600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-metrics-certs") pod "router-default-6fd64f4d5f-4qdl5" (UID: "c463f7df-73f3-4c28-906a-c62846ca8a4b") : secret "router-metrics-certs-default" not found
Jun 03 01:42:03.110571 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.110360    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-default-certificate\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:03.110571 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:03.110484    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c463f7df-73f3-4c28-906a-c62846ca8a4b-service-ca-bundle podName:c463f7df-73f3-4c28-906a-c62846ca8a4b nodeName:}" failed. No retries permitted until 2026-06-03 01:42:03.610467067 +0000 UTC m=+93.174862871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c463f7df-73f3-4c28-906a-c62846ca8a4b-service-ca-bundle") pod "router-default-6fd64f4d5f-4qdl5" (UID: "c463f7df-73f3-4c28-906a-c62846ca8a4b") : configmap references non-existent config key: service-ca.crt
Jun 03 01:42:03.110571 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.110519    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-stats-auth\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:03.110571 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.110554    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbkdp\" (UniqueName: \"kubernetes.io/projected/c463f7df-73f3-4c28-906a-c62846ca8a4b-kube-api-access-xbkdp\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:03.110571 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.110572    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7dc8e7f-6638-40fb-9c54-6cc4902c5938-serving-cert\") pod \"insights-operator-788bf58df5-9j24t\" (UID: \"d7dc8e7f-6638-40fb-9c54-6cc4902c5938\") " pod="openshift-insights/insights-operator-788bf58df5-9j24t"
Jun 03 01:42:03.111041 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.110621    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jdlff\" (UniqueName: \"kubernetes.io/projected/d7dc8e7f-6638-40fb-9c54-6cc4902c5938-kube-api-access-jdlff\") pod \"insights-operator-788bf58df5-9j24t\" (UID: \"d7dc8e7f-6638-40fb-9c54-6cc4902c5938\") " pod="openshift-insights/insights-operator-788bf58df5-9j24t"
Jun 03 01:42:03.111041 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.110679    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7dc8e7f-6638-40fb-9c54-6cc4902c5938-tmp\") pod \"insights-operator-788bf58df5-9j24t\" (UID: \"d7dc8e7f-6638-40fb-9c54-6cc4902c5938\") " pod="openshift-insights/insights-operator-788bf58df5-9j24t"
Jun 03 01:42:03.111142 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.111067    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7dc8e7f-6638-40fb-9c54-6cc4902c5938-service-ca-bundle\") pod \"insights-operator-788bf58df5-9j24t\" (UID: \"d7dc8e7f-6638-40fb-9c54-6cc4902c5938\") " pod="openshift-insights/insights-operator-788bf58df5-9j24t"
Jun 03 01:42:03.111383 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.111361    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d7dc8e7f-6638-40fb-9c54-6cc4902c5938-snapshots\") pod \"insights-operator-788bf58df5-9j24t\" (UID: \"d7dc8e7f-6638-40fb-9c54-6cc4902c5938\") " pod="openshift-insights/insights-operator-788bf58df5-9j24t"
Jun 03 01:42:03.111460 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.111380    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7dc8e7f-6638-40fb-9c54-6cc4902c5938-tmp\") pod \"insights-operator-788bf58df5-9j24t\" (UID: \"d7dc8e7f-6638-40fb-9c54-6cc4902c5938\") " pod="openshift-insights/insights-operator-788bf58df5-9j24t"
Jun 03 01:42:03.111460 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.111441    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7dc8e7f-6638-40fb-9c54-6cc4902c5938-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-9j24t\" (UID: \"d7dc8e7f-6638-40fb-9c54-6cc4902c5938\") " pod="openshift-insights/insights-operator-788bf58df5-9j24t"
Jun 03 01:42:03.112918 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.112888    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-default-certificate\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:03.113032 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.112919    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7dc8e7f-6638-40fb-9c54-6cc4902c5938-serving-cert\") pod \"insights-operator-788bf58df5-9j24t\" (UID: \"d7dc8e7f-6638-40fb-9c54-6cc4902c5938\") " pod="openshift-insights/insights-operator-788bf58df5-9j24t"
Jun 03 01:42:03.113032 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.113000    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-stats-auth\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:03.118733 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.118707    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdlff\" (UniqueName: \"kubernetes.io/projected/d7dc8e7f-6638-40fb-9c54-6cc4902c5938-kube-api-access-jdlff\") pod \"insights-operator-788bf58df5-9j24t\" (UID: \"d7dc8e7f-6638-40fb-9c54-6cc4902c5938\") " pod="openshift-insights/insights-operator-788bf58df5-9j24t"
Jun 03 01:42:03.118872 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.118837    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbkdp\" (UniqueName: \"kubernetes.io/projected/c463f7df-73f3-4c28-906a-c62846ca8a4b-kube-api-access-xbkdp\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:03.263643 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.263574    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-9j24t"
Jun 03 01:42:03.404280 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.404218    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-9j24t"]
Jun 03 01:42:03.407746 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:42:03.407715    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7dc8e7f_6638_40fb_9c54_6cc4902c5938.slice/crio-26a487bc76a19c1680e89707d0979cf085931f2482cfba0a4dd932d24ff705af WatchSource:0}: Error finding container 26a487bc76a19c1680e89707d0979cf085931f2482cfba0a4dd932d24ff705af: Status 404 returned error can't find the container with id 26a487bc76a19c1680e89707d0979cf085931f2482cfba0a4dd932d24ff705af
Jun 03 01:42:03.464013 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.463974    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-9j24t" event={"ID":"d7dc8e7f-6638-40fb-9c54-6cc4902c5938","Type":"ContainerStarted","Data":"26a487bc76a19c1680e89707d0979cf085931f2482cfba0a4dd932d24ff705af"}
Jun 03 01:42:03.519091 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.519054    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-xhlkz\" (UID: \"5c6f2ce1-e70c-4c86-84e1-f2f8e7004148\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xhlkz"
Jun 03 01:42:03.519226 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:03.519207    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 01:42:03.519287 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:03.519277    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-cluster-monitoring-operator-tls podName:5c6f2ce1-e70c-4c86-84e1-f2f8e7004148 nodeName:}" failed. No retries permitted until 2026-06-03 01:42:04.519260253 +0000 UTC m=+94.083656046 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-xhlkz" (UID: "5c6f2ce1-e70c-4c86-84e1-f2f8e7004148") : secret "cluster-monitoring-operator-tls" not found
Jun 03 01:42:03.620217 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.620174    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-metrics-certs\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:03.620371 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:03.620259    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c463f7df-73f3-4c28-906a-c62846ca8a4b-service-ca-bundle\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:03.620371 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:03.620330    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 03 01:42:03.620489 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:03.620403    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-metrics-certs podName:c463f7df-73f3-4c28-906a-c62846ca8a4b nodeName:}" failed. No retries permitted until 2026-06-03 01:42:04.620384822 +0000 UTC m=+94.184780622 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-metrics-certs") pod "router-default-6fd64f4d5f-4qdl5" (UID: "c463f7df-73f3-4c28-906a-c62846ca8a4b") : secret "router-metrics-certs-default" not found
Jun 03 01:42:03.620489 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:03.620420    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c463f7df-73f3-4c28-906a-c62846ca8a4b-service-ca-bundle podName:c463f7df-73f3-4c28-906a-c62846ca8a4b nodeName:}" failed. No retries permitted until 2026-06-03 01:42:04.620412399 +0000 UTC m=+94.184808191 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c463f7df-73f3-4c28-906a-c62846ca8a4b-service-ca-bundle") pod "router-default-6fd64f4d5f-4qdl5" (UID: "c463f7df-73f3-4c28-906a-c62846ca8a4b") : configmap references non-existent config key: service-ca.crt
Jun 03 01:42:04.528830 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:04.528789    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-xhlkz\" (UID: \"5c6f2ce1-e70c-4c86-84e1-f2f8e7004148\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xhlkz"
Jun 03 01:42:04.529281 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:04.528944    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 01:42:04.529281 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:04.529014    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-cluster-monitoring-operator-tls podName:5c6f2ce1-e70c-4c86-84e1-f2f8e7004148 nodeName:}" failed. No retries permitted until 2026-06-03 01:42:06.528997429 +0000 UTC m=+96.093393218 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-xhlkz" (UID: "5c6f2ce1-e70c-4c86-84e1-f2f8e7004148") : secret "cluster-monitoring-operator-tls" not found
Jun 03 01:42:04.629360 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:04.629317    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-metrics-certs\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:04.629547 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:04.629418    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c463f7df-73f3-4c28-906a-c62846ca8a4b-service-ca-bundle\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:04.629547 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:04.629470    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 03 01:42:04.629687 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:04.629555    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-metrics-certs podName:c463f7df-73f3-4c28-906a-c62846ca8a4b nodeName:}" failed. No retries permitted until 2026-06-03 01:42:06.629533562 +0000 UTC m=+96.193929353 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-metrics-certs") pod "router-default-6fd64f4d5f-4qdl5" (UID: "c463f7df-73f3-4c28-906a-c62846ca8a4b") : secret "router-metrics-certs-default" not found
Jun 03 01:42:04.629687 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:04.629608    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c463f7df-73f3-4c28-906a-c62846ca8a4b-service-ca-bundle podName:c463f7df-73f3-4c28-906a-c62846ca8a4b nodeName:}" failed. No retries permitted until 2026-06-03 01:42:06.629566041 +0000 UTC m=+96.193961838 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c463f7df-73f3-4c28-906a-c62846ca8a4b-service-ca-bundle") pod "router-default-6fd64f4d5f-4qdl5" (UID: "c463f7df-73f3-4c28-906a-c62846ca8a4b") : configmap references non-existent config key: service-ca.crt
Jun 03 01:42:05.469482 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:05.469390    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-9j24t" event={"ID":"d7dc8e7f-6638-40fb-9c54-6cc4902c5938","Type":"ContainerStarted","Data":"43ddbfccfd04b6f5788a7ed48f09fec3d0c4f70c4eb3160fbf4cf29d791a0e36"}
Jun 03 01:42:05.492979 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:05.492930    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-9j24t" podStartSLOduration=1.7661578740000001 podStartE2EDuration="3.492914234s" podCreationTimestamp="2026-06-03 01:42:02 +0000 UTC" firstStartedPulling="2026-06-03 01:42:03.409381905 +0000 UTC m=+92.973777694" lastFinishedPulling="2026-06-03 01:42:05.136138262 +0000 UTC m=+94.700534054" observedRunningTime="2026-06-03 01:42:05.492392925 +0000 UTC m=+95.056788737" watchObservedRunningTime="2026-06-03 01:42:05.492914234 +0000 UTC m=+95.057310044"
Jun 03 01:42:06.545138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:06.545081    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-xhlkz\" (UID: \"5c6f2ce1-e70c-4c86-84e1-f2f8e7004148\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xhlkz"
Jun 03 01:42:06.545616 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:06.545221    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 01:42:06.545616 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:06.545289    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-cluster-monitoring-operator-tls podName:5c6f2ce1-e70c-4c86-84e1-f2f8e7004148 nodeName:}" failed. No retries permitted until 2026-06-03 01:42:10.545273029 +0000 UTC m=+100.109668818 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-xhlkz" (UID: "5c6f2ce1-e70c-4c86-84e1-f2f8e7004148") : secret "cluster-monitoring-operator-tls" not found
Jun 03 01:42:06.646066 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:06.646021    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-metrics-certs\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:06.646320 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:06.646084    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c463f7df-73f3-4c28-906a-c62846ca8a4b-service-ca-bundle\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:06.646320 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:06.646194    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c463f7df-73f3-4c28-906a-c62846ca8a4b-service-ca-bundle podName:c463f7df-73f3-4c28-906a-c62846ca8a4b nodeName:}" failed. No retries permitted until 2026-06-03 01:42:10.646179758 +0000 UTC m=+100.210575553 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c463f7df-73f3-4c28-906a-c62846ca8a4b-service-ca-bundle") pod "router-default-6fd64f4d5f-4qdl5" (UID: "c463f7df-73f3-4c28-906a-c62846ca8a4b") : configmap references non-existent config key: service-ca.crt
Jun 03 01:42:06.646320 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:06.646199    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 03 01:42:06.646320 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:06.646264    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-metrics-certs podName:c463f7df-73f3-4c28-906a-c62846ca8a4b nodeName:}" failed. No retries permitted until 2026-06-03 01:42:10.646245186 +0000 UTC m=+100.210640981 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-metrics-certs") pod "router-default-6fd64f4d5f-4qdl5" (UID: "c463f7df-73f3-4c28-906a-c62846ca8a4b") : secret "router-metrics-certs-default" not found
Jun 03 01:42:08.171064 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:08.171032    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j6knj_fd36a345-5628-409d-9024-eed1daad505b/dns-node-resolver/0.log"
Jun 03 01:42:08.661869 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:08.661836    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert\") pod \"ingress-canary-96vwc\" (UID: \"ab8c3cff-b7cf-4b1e-bc43-a690f753ec12\") " pod="openshift-ingress-canary/ingress-canary-96vwc"
Jun 03 01:42:08.662049 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:08.661926    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls\") pod \"dns-default-zthbg\" (UID: \"b3864081-3019-44a7-8958-5075918ca6b3\") " pod="openshift-dns/dns-default-zthbg"
Jun 03 01:42:08.662049 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:08.661991    2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 01:42:08.662049 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:08.662003    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 01:42:08.662140 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:08.662056    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert podName:ab8c3cff-b7cf-4b1e-bc43-a690f753ec12 nodeName:}" failed. No retries permitted until 2026-06-03 01:43:12.662040209 +0000 UTC m=+162.226435998 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert") pod "ingress-canary-96vwc" (UID: "ab8c3cff-b7cf-4b1e-bc43-a690f753ec12") : secret "canary-serving-cert" not found
Jun 03 01:42:08.662140 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:08.662071    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls podName:b3864081-3019-44a7-8958-5075918ca6b3 nodeName:}" failed. No retries permitted until 2026-06-03 01:43:12.662065017 +0000 UTC m=+162.226460806 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls") pod "dns-default-zthbg" (UID: "b3864081-3019-44a7-8958-5075918ca6b3") : secret "dns-default-metrics-tls" not found
Jun 03 01:42:08.770827 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:08.770800    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kq6lz_6dd7eb65-6fd1-4d72-a705-68df80e3c9f9/node-ca/0.log"
Jun 03 01:42:10.425309 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:10.425278    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hcml4"
Jun 03 01:42:10.579523 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:10.579482    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-xhlkz\" (UID: \"5c6f2ce1-e70c-4c86-84e1-f2f8e7004148\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xhlkz"
Jun 03 01:42:10.579725 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:10.579644    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 01:42:10.579774 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:10.579725    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-cluster-monitoring-operator-tls podName:5c6f2ce1-e70c-4c86-84e1-f2f8e7004148 nodeName:}" failed. No retries permitted until 2026-06-03 01:42:18.579709725 +0000 UTC m=+108.144105513 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-xhlkz" (UID: "5c6f2ce1-e70c-4c86-84e1-f2f8e7004148") : secret "cluster-monitoring-operator-tls" not found
Jun 03 01:42:10.680665 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:10.680556    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-metrics-certs\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:10.680665 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:10.680634    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c463f7df-73f3-4c28-906a-c62846ca8a4b-service-ca-bundle\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:10.680837 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:10.680724    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 03 01:42:10.680837 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:10.680740    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c463f7df-73f3-4c28-906a-c62846ca8a4b-service-ca-bundle podName:c463f7df-73f3-4c28-906a-c62846ca8a4b nodeName:}" failed. No retries permitted until 2026-06-03 01:42:18.680726551 +0000 UTC m=+108.245122341 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c463f7df-73f3-4c28-906a-c62846ca8a4b-service-ca-bundle") pod "router-default-6fd64f4d5f-4qdl5" (UID: "c463f7df-73f3-4c28-906a-c62846ca8a4b") : configmap references non-existent config key: service-ca.crt
Jun 03 01:42:10.680837 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:10.680810    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-metrics-certs podName:c463f7df-73f3-4c28-906a-c62846ca8a4b nodeName:}" failed. No retries permitted until 2026-06-03 01:42:18.68078987 +0000 UTC m=+108.245185665 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-metrics-certs") pod "router-default-6fd64f4d5f-4qdl5" (UID: "c463f7df-73f3-4c28-906a-c62846ca8a4b") : secret "router-metrics-certs-default" not found
Jun 03 01:42:12.858022 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:12.857982    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-g8fbr"]
Jun 03 01:42:12.860294 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:12.860277    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-g8fbr"
Jun 03 01:42:12.862771 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:12.862749    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jun 03 01:42:12.862905 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:12.862804    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jun 03 01:42:12.862905 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:12.862866    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jun 03 01:42:12.863830 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:12.863807    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bx99c\""
Jun 03 01:42:12.869052 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:12.869023    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-g8fbr"]
Jun 03 01:42:12.898241 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:12.898197    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm487\" (UniqueName: \"kubernetes.io/projected/2188b699-1852-402e-8979-bfa4c6e2669c-kube-api-access-tm487\") pod \"cluster-samples-operator-755bbf9bfb-g8fbr\" (UID: \"2188b699-1852-402e-8979-bfa4c6e2669c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-g8fbr"
Jun 03 01:42:12.898241 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:12.898245    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2188b699-1852-402e-8979-bfa4c6e2669c-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-g8fbr\" (UID: \"2188b699-1852-402e-8979-bfa4c6e2669c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-g8fbr"
Jun 03 01:42:12.954663 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:12.954626    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-hz9sm"]
Jun 03 01:42:12.956905 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:12.956888    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-hz9sm"
Jun 03 01:42:12.959485 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:12.959462    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-mbd27\""
Jun 03 01:42:12.959629 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:12.959561    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jun 03 01:42:12.959755 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:12.959733    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jun 03 01:42:12.959755 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:12.959752    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jun 03 01:42:12.959939 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:12.959765    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jun 03 01:42:12.967483 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:12.967458    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-hz9sm"]
Jun 03 01:42:12.998781 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:12.998747    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tm487\" (UniqueName: \"kubernetes.io/projected/2188b699-1852-402e-8979-bfa4c6e2669c-kube-api-access-tm487\") pod \"cluster-samples-operator-755bbf9bfb-g8fbr\" (UID: \"2188b699-1852-402e-8979-bfa4c6e2669c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-g8fbr"
Jun 03 01:42:12.998781 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:12.998782    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9660d554-801a-4129-b6f1-d316e2ba79a5-config\") pod \"service-ca-operator-69877444c-hz9sm\" (UID: \"9660d554-801a-4129-b6f1-d316e2ba79a5\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-hz9sm"
Jun 03 01:42:12.999030 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:12.998808    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2188b699-1852-402e-8979-bfa4c6e2669c-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-g8fbr\" (UID: \"2188b699-1852-402e-8979-bfa4c6e2669c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-g8fbr"
Jun 03 01:42:12.999030 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:12.998833    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9660d554-801a-4129-b6f1-d316e2ba79a5-serving-cert\") pod \"service-ca-operator-69877444c-hz9sm\" (UID: \"9660d554-801a-4129-b6f1-d316e2ba79a5\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-hz9sm"
Jun 03 01:42:12.999030 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:12.998895    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4trh\" (UniqueName: \"kubernetes.io/projected/9660d554-801a-4129-b6f1-d316e2ba79a5-kube-api-access-p4trh\") pod \"service-ca-operator-69877444c-hz9sm\" (UID: \"9660d554-801a-4129-b6f1-d316e2ba79a5\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-hz9sm"
Jun 03 01:42:12.999030 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:12.998928    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 03 01:42:12.999030 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:12.999005    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2188b699-1852-402e-8979-bfa4c6e2669c-samples-operator-tls podName:2188b699-1852-402e-8979-bfa4c6e2669c nodeName:}" failed. No retries permitted until 2026-06-03 01:42:13.498981628 +0000 UTC m=+103.063377419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2188b699-1852-402e-8979-bfa4c6e2669c-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-g8fbr" (UID: "2188b699-1852-402e-8979-bfa4c6e2669c") : secret "samples-operator-tls" not found
Jun 03 01:42:13.007486 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:13.007458    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm487\" (UniqueName: \"kubernetes.io/projected/2188b699-1852-402e-8979-bfa4c6e2669c-kube-api-access-tm487\") pod \"cluster-samples-operator-755bbf9bfb-g8fbr\" (UID: \"2188b699-1852-402e-8979-bfa4c6e2669c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-g8fbr"
Jun 03 01:42:13.099988 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:13.099945    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9660d554-801a-4129-b6f1-d316e2ba79a5-config\") pod \"service-ca-operator-69877444c-hz9sm\" (UID: \"9660d554-801a-4129-b6f1-d316e2ba79a5\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-hz9sm"
Jun 03 01:42:13.099988 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:13.099999    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9660d554-801a-4129-b6f1-d316e2ba79a5-serving-cert\") pod \"service-ca-operator-69877444c-hz9sm\" (UID: \"9660d554-801a-4129-b6f1-d316e2ba79a5\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-hz9sm"
Jun 03 01:42:13.100216 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:13.100197    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p4trh\" (UniqueName: \"kubernetes.io/projected/9660d554-801a-4129-b6f1-d316e2ba79a5-kube-api-access-p4trh\") pod \"service-ca-operator-69877444c-hz9sm\" (UID: \"9660d554-801a-4129-b6f1-d316e2ba79a5\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-hz9sm"
Jun 03 01:42:13.100487 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:13.100466    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9660d554-801a-4129-b6f1-d316e2ba79a5-config\") pod \"service-ca-operator-69877444c-hz9sm\" (UID: \"9660d554-801a-4129-b6f1-d316e2ba79a5\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-hz9sm"
Jun 03 01:42:13.102152 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:13.102131    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9660d554-801a-4129-b6f1-d316e2ba79a5-serving-cert\") pod \"service-ca-operator-69877444c-hz9sm\" (UID: \"9660d554-801a-4129-b6f1-d316e2ba79a5\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-hz9sm"
Jun 03 01:42:13.107750 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:13.107730    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4trh\" (UniqueName: \"kubernetes.io/projected/9660d554-801a-4129-b6f1-d316e2ba79a5-kube-api-access-p4trh\") pod \"service-ca-operator-69877444c-hz9sm\" (UID: \"9660d554-801a-4129-b6f1-d316e2ba79a5\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-hz9sm"
Jun 03 01:42:13.266283 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:13.266243    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-hz9sm"
Jun 03 01:42:13.389381 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:13.389345    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-hz9sm"]
Jun 03 01:42:13.392341 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:42:13.392311    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9660d554_801a_4129_b6f1_d316e2ba79a5.slice/crio-b6e39389e2ed0d8dc5a43ca42aa2ef965451b1a31bea9ed8c98bfff923e08f80 WatchSource:0}: Error finding container b6e39389e2ed0d8dc5a43ca42aa2ef965451b1a31bea9ed8c98bfff923e08f80: Status 404 returned error can't find the container with id b6e39389e2ed0d8dc5a43ca42aa2ef965451b1a31bea9ed8c98bfff923e08f80
Jun 03 01:42:13.486140 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:13.486101    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-hz9sm" event={"ID":"9660d554-801a-4129-b6f1-d316e2ba79a5","Type":"ContainerStarted","Data":"b6e39389e2ed0d8dc5a43ca42aa2ef965451b1a31bea9ed8c98bfff923e08f80"}
Jun 03 01:42:13.503767 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:13.503730    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2188b699-1852-402e-8979-bfa4c6e2669c-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-g8fbr\" (UID: \"2188b699-1852-402e-8979-bfa4c6e2669c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-g8fbr"
Jun 03 01:42:13.503987 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:13.503878    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 03 01:42:13.503987 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:13.503942    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2188b699-1852-402e-8979-bfa4c6e2669c-samples-operator-tls podName:2188b699-1852-402e-8979-bfa4c6e2669c nodeName:}" failed. No retries permitted until 2026-06-03 01:42:14.503924539 +0000 UTC m=+104.068320332 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2188b699-1852-402e-8979-bfa4c6e2669c-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-g8fbr" (UID: "2188b699-1852-402e-8979-bfa4c6e2669c") : secret "samples-operator-tls" not found
Jun 03 01:42:14.512309 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:14.512269    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2188b699-1852-402e-8979-bfa4c6e2669c-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-g8fbr\" (UID: \"2188b699-1852-402e-8979-bfa4c6e2669c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-g8fbr"
Jun 03 01:42:14.512851 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:14.512432    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 03 01:42:14.512851 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:14.512502    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2188b699-1852-402e-8979-bfa4c6e2669c-samples-operator-tls podName:2188b699-1852-402e-8979-bfa4c6e2669c nodeName:}" failed. No retries permitted until 2026-06-03 01:42:16.512480611 +0000 UTC m=+106.076876412 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2188b699-1852-402e-8979-bfa4c6e2669c-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-g8fbr" (UID: "2188b699-1852-402e-8979-bfa4c6e2669c") : secret "samples-operator-tls" not found
Jun 03 01:42:15.491328 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:15.491235    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-hz9sm" event={"ID":"9660d554-801a-4129-b6f1-d316e2ba79a5","Type":"ContainerStarted","Data":"06e156d8d5e71ba9b2808675e254803b69b90fd70292c2e1128f1496ddd6a7e3"}
Jun 03 01:42:16.531957 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:16.531910    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2188b699-1852-402e-8979-bfa4c6e2669c-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-g8fbr\" (UID: \"2188b699-1852-402e-8979-bfa4c6e2669c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-g8fbr"
Jun 03 01:42:16.532393 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:16.532064    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 03 01:42:16.532393 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:16.532138    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2188b699-1852-402e-8979-bfa4c6e2669c-samples-operator-tls podName:2188b699-1852-402e-8979-bfa4c6e2669c nodeName:}" failed. No retries permitted until 2026-06-03 01:42:20.532121378 +0000 UTC m=+110.096517168 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2188b699-1852-402e-8979-bfa4c6e2669c-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-g8fbr" (UID: "2188b699-1852-402e-8979-bfa4c6e2669c") : secret "samples-operator-tls" not found
Jun 03 01:42:18.650476 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:18.650431    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-xhlkz\" (UID: \"5c6f2ce1-e70c-4c86-84e1-f2f8e7004148\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xhlkz"
Jun 03 01:42:18.650875 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:18.650602    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 01:42:18.650875 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:18.650669    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-cluster-monitoring-operator-tls podName:5c6f2ce1-e70c-4c86-84e1-f2f8e7004148 nodeName:}" failed. No retries permitted until 2026-06-03 01:42:34.650651454 +0000 UTC m=+124.215047247 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-xhlkz" (UID: "5c6f2ce1-e70c-4c86-84e1-f2f8e7004148") : secret "cluster-monitoring-operator-tls" not found
Jun 03 01:42:18.751791 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:18.751750    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-metrics-certs\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:18.751973 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:18.751816    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c463f7df-73f3-4c28-906a-c62846ca8a4b-service-ca-bundle\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:18.751973 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:18.751907    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 03 01:42:18.751973 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:18.751943    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c463f7df-73f3-4c28-906a-c62846ca8a4b-service-ca-bundle podName:c463f7df-73f3-4c28-906a-c62846ca8a4b nodeName:}" failed. No retries permitted until 2026-06-03 01:42:34.751929263 +0000 UTC m=+124.316325056 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c463f7df-73f3-4c28-906a-c62846ca8a4b-service-ca-bundle") pod "router-default-6fd64f4d5f-4qdl5" (UID: "c463f7df-73f3-4c28-906a-c62846ca8a4b") : configmap references non-existent config key: service-ca.crt
Jun 03 01:42:18.751973 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:18.751964    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-metrics-certs podName:c463f7df-73f3-4c28-906a-c62846ca8a4b nodeName:}" failed. No retries permitted until 2026-06-03 01:42:34.751950735 +0000 UTC m=+124.316346528 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-metrics-certs") pod "router-default-6fd64f4d5f-4qdl5" (UID: "c463f7df-73f3-4c28-906a-c62846ca8a4b") : secret "router-metrics-certs-default" not found
Jun 03 01:42:19.387605 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.387544    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-hz9sm" podStartSLOduration=5.5969252130000005 podStartE2EDuration="7.387528565s" podCreationTimestamp="2026-06-03 01:42:12 +0000 UTC" firstStartedPulling="2026-06-03 01:42:13.393964024 +0000 UTC m=+102.958359816" lastFinishedPulling="2026-06-03 01:42:15.184567379 +0000 UTC m=+104.748963168" observedRunningTime="2026-06-03 01:42:15.505293241 +0000 UTC m=+105.069689051" watchObservedRunningTime="2026-06-03 01:42:19.387528565 +0000 UTC m=+108.951924375"
Jun 03 01:42:19.387820 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.387806    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-p5gtl"]
Jun 03 01:42:19.390786 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.390768    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-p5gtl"
Jun 03 01:42:19.393387 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.393360    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jun 03 01:42:19.393387 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.393382    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jun 03 01:42:19.394376 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.394359    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-dk7kp\""
Jun 03 01:42:19.394563 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.394539    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jun 03 01:42:19.394692 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.394573    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jun 03 01:42:19.398720 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.398700    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-p5gtl"]
Jun 03 01:42:19.414997 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.414963    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kk5kb"]
Jun 03 01:42:19.418005 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.417985    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kk5kb"
Jun 03 01:42:19.420401 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.420377    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 03 01:42:19.420565 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.420550    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jv5mr\""
Jun 03 01:42:19.420565 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.420559    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 03 01:42:19.429068 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.429039    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kk5kb"]
Jun 03 01:42:19.458423 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.458384    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntrb4\" (UniqueName: \"kubernetes.io/projected/84ae0d3d-c023-41ad-bfe3-62456e37525a-kube-api-access-ntrb4\") pod \"service-ca-685df94d57-p5gtl\" (UID: \"84ae0d3d-c023-41ad-bfe3-62456e37525a\") " pod="openshift-service-ca/service-ca-685df94d57-p5gtl"
Jun 03 01:42:19.458625 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.458444    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/84ae0d3d-c023-41ad-bfe3-62456e37525a-signing-key\") pod \"service-ca-685df94d57-p5gtl\" (UID: \"84ae0d3d-c023-41ad-bfe3-62456e37525a\") " pod="openshift-service-ca/service-ca-685df94d57-p5gtl"
Jun 03 01:42:19.458625 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.458462    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/84ae0d3d-c023-41ad-bfe3-62456e37525a-signing-cabundle\") pod \"service-ca-685df94d57-p5gtl\" (UID: \"84ae0d3d-c023-41ad-bfe3-62456e37525a\") " pod="openshift-service-ca/service-ca-685df94d57-p5gtl"
Jun 03 01:42:19.559316 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.559274    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/84ae0d3d-c023-41ad-bfe3-62456e37525a-signing-cabundle\") pod \"service-ca-685df94d57-p5gtl\" (UID: \"84ae0d3d-c023-41ad-bfe3-62456e37525a\") " pod="openshift-service-ca/service-ca-685df94d57-p5gtl"
Jun 03 01:42:19.559316 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.559321    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/84ae0d3d-c023-41ad-bfe3-62456e37525a-signing-key\") pod \"service-ca-685df94d57-p5gtl\" (UID: \"84ae0d3d-c023-41ad-bfe3-62456e37525a\") " pod="openshift-service-ca/service-ca-685df94d57-p5gtl"
Jun 03 01:42:19.559616 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.559347    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84e65c14-6bee-434f-8d99-fc6edab71f18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kk5kb\" (UID: \"84e65c14-6bee-434f-8d99-fc6edab71f18\") " pod="openshift-insights/insights-runtime-extractor-kk5kb"
Jun 03 01:42:19.559616 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.559449    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9rrr\" (UniqueName: \"kubernetes.io/projected/84e65c14-6bee-434f-8d99-fc6edab71f18-kube-api-access-h9rrr\") pod \"insights-runtime-extractor-kk5kb\" (UID: \"84e65c14-6bee-434f-8d99-fc6edab71f18\") " pod="openshift-insights/insights-runtime-extractor-kk5kb"
Jun 03 01:42:19.559616 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.559493    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ntrb4\" (UniqueName: \"kubernetes.io/projected/84ae0d3d-c023-41ad-bfe3-62456e37525a-kube-api-access-ntrb4\") pod \"service-ca-685df94d57-p5gtl\" (UID: \"84ae0d3d-c023-41ad-bfe3-62456e37525a\") " pod="openshift-service-ca/service-ca-685df94d57-p5gtl"
Jun 03 01:42:19.559616 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.559561    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/84e65c14-6bee-434f-8d99-fc6edab71f18-data-volume\") pod \"insights-runtime-extractor-kk5kb\" (UID: \"84e65c14-6bee-434f-8d99-fc6edab71f18\") " pod="openshift-insights/insights-runtime-extractor-kk5kb"
Jun 03 01:42:19.559827 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.559637    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/84e65c14-6bee-434f-8d99-fc6edab71f18-crio-socket\") pod \"insights-runtime-extractor-kk5kb\" (UID: \"84e65c14-6bee-434f-8d99-fc6edab71f18\") " pod="openshift-insights/insights-runtime-extractor-kk5kb"
Jun 03 01:42:19.559827 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.559673    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84e65c14-6bee-434f-8d99-fc6edab71f18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kk5kb\" (UID: \"84e65c14-6bee-434f-8d99-fc6edab71f18\") " pod="openshift-insights/insights-runtime-extractor-kk5kb"
Jun 03 01:42:19.560118 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.560095    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/84ae0d3d-c023-41ad-bfe3-62456e37525a-signing-cabundle\") pod \"service-ca-685df94d57-p5gtl\" (UID: \"84ae0d3d-c023-41ad-bfe3-62456e37525a\") " pod="openshift-service-ca/service-ca-685df94d57-p5gtl"
Jun 03 01:42:19.561756 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.561726    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/84ae0d3d-c023-41ad-bfe3-62456e37525a-signing-key\") pod \"service-ca-685df94d57-p5gtl\" (UID: \"84ae0d3d-c023-41ad-bfe3-62456e37525a\") " pod="openshift-service-ca/service-ca-685df94d57-p5gtl"
Jun 03 01:42:19.567726 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.567704    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntrb4\" (UniqueName: \"kubernetes.io/projected/84ae0d3d-c023-41ad-bfe3-62456e37525a-kube-api-access-ntrb4\") pod \"service-ca-685df94d57-p5gtl\" (UID: \"84ae0d3d-c023-41ad-bfe3-62456e37525a\") " pod="openshift-service-ca/service-ca-685df94d57-p5gtl"
Jun 03 01:42:19.660183 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.660077    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/84e65c14-6bee-434f-8d99-fc6edab71f18-crio-socket\") pod \"insights-runtime-extractor-kk5kb\" (UID: \"84e65c14-6bee-434f-8d99-fc6edab71f18\") " pod="openshift-insights/insights-runtime-extractor-kk5kb"
Jun 03 01:42:19.660183 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.660134    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84e65c14-6bee-434f-8d99-fc6edab71f18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kk5kb\" (UID: \"84e65c14-6bee-434f-8d99-fc6edab71f18\") " pod="openshift-insights/insights-runtime-extractor-kk5kb"
Jun 03 01:42:19.660733 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.660207    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/84e65c14-6bee-434f-8d99-fc6edab71f18-crio-socket\") pod \"insights-runtime-extractor-kk5kb\" (UID: \"84e65c14-6bee-434f-8d99-fc6edab71f18\") " pod="openshift-insights/insights-runtime-extractor-kk5kb"
Jun 03 01:42:19.660733 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.660231    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84e65c14-6bee-434f-8d99-fc6edab71f18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kk5kb\" (UID: \"84e65c14-6bee-434f-8d99-fc6edab71f18\") " pod="openshift-insights/insights-runtime-extractor-kk5kb"
Jun 03 01:42:19.660733 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.660275    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h9rrr\" (UniqueName: \"kubernetes.io/projected/84e65c14-6bee-434f-8d99-fc6edab71f18-kube-api-access-h9rrr\") pod \"insights-runtime-extractor-kk5kb\" (UID: \"84e65c14-6bee-434f-8d99-fc6edab71f18\") " pod="openshift-insights/insights-runtime-extractor-kk5kb"
Jun 03 01:42:19.660733 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:19.660314    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 03 01:42:19.660733 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.660331    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/84e65c14-6bee-434f-8d99-fc6edab71f18-data-volume\") pod \"insights-runtime-extractor-kk5kb\" (UID: \"84e65c14-6bee-434f-8d99-fc6edab71f18\") " pod="openshift-insights/insights-runtime-extractor-kk5kb"
Jun 03 01:42:19.660733 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:19.660383    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84e65c14-6bee-434f-8d99-fc6edab71f18-insights-runtime-extractor-tls podName:84e65c14-6bee-434f-8d99-fc6edab71f18 nodeName:}" failed. No retries permitted until 2026-06-03 01:42:20.160364565 +0000 UTC m=+109.724760371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/84e65c14-6bee-434f-8d99-fc6edab71f18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kk5kb" (UID: "84e65c14-6bee-434f-8d99-fc6edab71f18") : secret "insights-runtime-extractor-tls" not found
Jun 03 01:42:19.660733 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.660654    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/84e65c14-6bee-434f-8d99-fc6edab71f18-data-volume\") pod \"insights-runtime-extractor-kk5kb\" (UID: \"84e65c14-6bee-434f-8d99-fc6edab71f18\") " pod="openshift-insights/insights-runtime-extractor-kk5kb"
Jun 03 01:42:19.661013 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.660845    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84e65c14-6bee-434f-8d99-fc6edab71f18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kk5kb\" (UID: \"84e65c14-6bee-434f-8d99-fc6edab71f18\") " pod="openshift-insights/insights-runtime-extractor-kk5kb"
Jun 03 01:42:19.669135 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.669111    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9rrr\" (UniqueName: \"kubernetes.io/projected/84e65c14-6bee-434f-8d99-fc6edab71f18-kube-api-access-h9rrr\") pod \"insights-runtime-extractor-kk5kb\" (UID: \"84e65c14-6bee-434f-8d99-fc6edab71f18\") " pod="openshift-insights/insights-runtime-extractor-kk5kb"
Jun 03 01:42:19.699672 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.699634    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-p5gtl"
Jun 03 01:42:19.823608 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:19.823555    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-p5gtl"]
Jun 03 01:42:19.826694 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:42:19.826662    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84ae0d3d_c023_41ad_bfe3_62456e37525a.slice/crio-c6248919df1f38f4f6ff41fb2d102c196594de3e9ff7247b903f7bbf9f339bab WatchSource:0}: Error finding container c6248919df1f38f4f6ff41fb2d102c196594de3e9ff7247b903f7bbf9f339bab: Status 404 returned error can't find the container with id c6248919df1f38f4f6ff41fb2d102c196594de3e9ff7247b903f7bbf9f339bab
Jun 03 01:42:20.164812 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:20.164772    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84e65c14-6bee-434f-8d99-fc6edab71f18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kk5kb\" (UID: \"84e65c14-6bee-434f-8d99-fc6edab71f18\") " pod="openshift-insights/insights-runtime-extractor-kk5kb"
Jun 03 01:42:20.165017 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:20.164964    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 03 01:42:20.165093 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:20.165049    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84e65c14-6bee-434f-8d99-fc6edab71f18-insights-runtime-extractor-tls podName:84e65c14-6bee-434f-8d99-fc6edab71f18 nodeName:}" failed. No retries permitted until 2026-06-03 01:42:21.165027606 +0000 UTC m=+110.729423395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/84e65c14-6bee-434f-8d99-fc6edab71f18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kk5kb" (UID: "84e65c14-6bee-434f-8d99-fc6edab71f18") : secret "insights-runtime-extractor-tls" not found
Jun 03 01:42:20.502515 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:20.502427    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-p5gtl" event={"ID":"84ae0d3d-c023-41ad-bfe3-62456e37525a","Type":"ContainerStarted","Data":"7393e24b8c8870d915cc22c8348d5ed8596e153a0bfaccb5cccd66f6c008d341"}
Jun 03 01:42:20.502515 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:20.502465    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-p5gtl" event={"ID":"84ae0d3d-c023-41ad-bfe3-62456e37525a","Type":"ContainerStarted","Data":"c6248919df1f38f4f6ff41fb2d102c196594de3e9ff7247b903f7bbf9f339bab"}
Jun 03 01:42:20.517691 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:20.517640    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-p5gtl" podStartSLOduration=1.51762328 podStartE2EDuration="1.51762328s" podCreationTimestamp="2026-06-03 01:42:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:42:20.516407626 +0000 UTC m=+110.080803441" watchObservedRunningTime="2026-06-03 01:42:20.51762328 +0000 UTC m=+110.082019091"
Jun 03 01:42:20.567186 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:20.567150    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2188b699-1852-402e-8979-bfa4c6e2669c-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-g8fbr\" (UID: \"2188b699-1852-402e-8979-bfa4c6e2669c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-g8fbr"
Jun 03 01:42:20.567476 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:20.567441    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 03 01:42:20.567642 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:20.567519    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2188b699-1852-402e-8979-bfa4c6e2669c-samples-operator-tls podName:2188b699-1852-402e-8979-bfa4c6e2669c nodeName:}" failed. No retries permitted until 2026-06-03 01:42:28.567499623 +0000 UTC m=+118.131895425 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2188b699-1852-402e-8979-bfa4c6e2669c-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-g8fbr" (UID: "2188b699-1852-402e-8979-bfa4c6e2669c") : secret "samples-operator-tls" not found
Jun 03 01:42:21.173383 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:21.173336    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84e65c14-6bee-434f-8d99-fc6edab71f18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kk5kb\" (UID: \"84e65c14-6bee-434f-8d99-fc6edab71f18\") " pod="openshift-insights/insights-runtime-extractor-kk5kb"
Jun 03 01:42:21.173877 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:21.173489    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 03 01:42:21.173877 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:21.173569    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84e65c14-6bee-434f-8d99-fc6edab71f18-insights-runtime-extractor-tls podName:84e65c14-6bee-434f-8d99-fc6edab71f18 nodeName:}" failed. No retries permitted until 2026-06-03 01:42:23.173553244 +0000 UTC m=+112.737949032 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/84e65c14-6bee-434f-8d99-fc6edab71f18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kk5kb" (UID: "84e65c14-6bee-434f-8d99-fc6edab71f18") : secret "insights-runtime-extractor-tls" not found
Jun 03 01:42:23.192297 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:23.192255    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84e65c14-6bee-434f-8d99-fc6edab71f18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kk5kb\" (UID: \"84e65c14-6bee-434f-8d99-fc6edab71f18\") " pod="openshift-insights/insights-runtime-extractor-kk5kb"
Jun 03 01:42:23.192704 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:23.192375    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 03 01:42:23.192704 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:42:23.192430    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84e65c14-6bee-434f-8d99-fc6edab71f18-insights-runtime-extractor-tls podName:84e65c14-6bee-434f-8d99-fc6edab71f18 nodeName:}" failed. No retries permitted until 2026-06-03 01:42:27.192415171 +0000 UTC m=+116.756810960 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/84e65c14-6bee-434f-8d99-fc6edab71f18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kk5kb" (UID: "84e65c14-6bee-434f-8d99-fc6edab71f18") : secret "insights-runtime-extractor-tls" not found
Jun 03 01:42:27.224741 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:27.224702    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84e65c14-6bee-434f-8d99-fc6edab71f18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kk5kb\" (UID: \"84e65c14-6bee-434f-8d99-fc6edab71f18\") " pod="openshift-insights/insights-runtime-extractor-kk5kb"
Jun 03 01:42:27.227076 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:27.227052    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84e65c14-6bee-434f-8d99-fc6edab71f18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kk5kb\" (UID: \"84e65c14-6bee-434f-8d99-fc6edab71f18\") " pod="openshift-insights/insights-runtime-extractor-kk5kb"
Jun 03 01:42:27.526853 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:27.526748    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kk5kb"
Jun 03 01:42:27.657088 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:27.657054    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kk5kb"]
Jun 03 01:42:27.660145 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:42:27.660102    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84e65c14_6bee_434f_8d99_fc6edab71f18.slice/crio-232439b29614d262dae60c886132637f7fce971f3e6f756d3b920493eb2d0b4b WatchSource:0}: Error finding container 232439b29614d262dae60c886132637f7fce971f3e6f756d3b920493eb2d0b4b: Status 404 returned error can't find the container with id 232439b29614d262dae60c886132637f7fce971f3e6f756d3b920493eb2d0b4b
Jun 03 01:42:28.519293 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:28.519256    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kk5kb" event={"ID":"84e65c14-6bee-434f-8d99-fc6edab71f18","Type":"ContainerStarted","Data":"b8bd60801025a1ab06c07506094d4445778ba65daae4fb14e9161c20c9011c9b"}
Jun 03 01:42:28.519293 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:28.519290    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kk5kb" event={"ID":"84e65c14-6bee-434f-8d99-fc6edab71f18","Type":"ContainerStarted","Data":"77bc6df810562a4e2a37d364fd9062412df4ed7f5fc3da94ec8cf30080ff0f2a"}
Jun 03 01:42:28.519293 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:28.519300    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kk5kb" event={"ID":"84e65c14-6bee-434f-8d99-fc6edab71f18","Type":"ContainerStarted","Data":"232439b29614d262dae60c886132637f7fce971f3e6f756d3b920493eb2d0b4b"}
Jun 03 01:42:28.635998 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:28.635956    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2188b699-1852-402e-8979-bfa4c6e2669c-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-g8fbr\" (UID: \"2188b699-1852-402e-8979-bfa4c6e2669c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-g8fbr"
Jun 03 01:42:28.638363 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:28.638335    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2188b699-1852-402e-8979-bfa4c6e2669c-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-g8fbr\" (UID: \"2188b699-1852-402e-8979-bfa4c6e2669c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-g8fbr"
Jun 03 01:42:28.771005 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:28.770966    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-g8fbr"
Jun 03 01:42:28.906502 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:28.906424    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-g8fbr"]
Jun 03 01:42:29.522619 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:29.522566    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-g8fbr" event={"ID":"2188b699-1852-402e-8979-bfa4c6e2669c","Type":"ContainerStarted","Data":"5296d7f666a1dda8f5bc4f84bf417f1d442e6d1acda0dc08bfb0c27783b61fdc"}
Jun 03 01:42:30.530545 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:30.530454    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kk5kb" event={"ID":"84e65c14-6bee-434f-8d99-fc6edab71f18","Type":"ContainerStarted","Data":"3a19f58a315cb189f9aa9efc5124789e17147d2e990eaf5cc4401c5af8260bb5"}
Jun 03 01:42:30.554570 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:30.554516    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kk5kb" podStartSLOduration=9.030045407 podStartE2EDuration="11.554500843s" podCreationTimestamp="2026-06-03 01:42:19 +0000 UTC" firstStartedPulling="2026-06-03 01:42:27.731982086 +0000 UTC m=+117.296377879" lastFinishedPulling="2026-06-03 01:42:30.256437525 +0000 UTC m=+119.820833315" observedRunningTime="2026-06-03 01:42:30.553043014 +0000 UTC m=+120.117438830" watchObservedRunningTime="2026-06-03 01:42:30.554500843 +0000 UTC m=+120.118896717"
Jun 03 01:42:31.535094 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:31.535058    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-g8fbr" event={"ID":"2188b699-1852-402e-8979-bfa4c6e2669c","Type":"ContainerStarted","Data":"ebec4582aeeac5de26902439e30ecee4b88103338b65632fffdc4c2697336a92"}
Jun 03 01:42:31.535094 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:31.535096    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-g8fbr" event={"ID":"2188b699-1852-402e-8979-bfa4c6e2669c","Type":"ContainerStarted","Data":"3bf33672971212944da370d65b08e6f99c671efc865fc7e65eff436e228270b5"}
Jun 03 01:42:31.552973 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:31.552921    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-g8fbr" podStartSLOduration=17.483305547 podStartE2EDuration="19.552906477s" podCreationTimestamp="2026-06-03 01:42:12 +0000 UTC" firstStartedPulling="2026-06-03 01:42:28.962097621 +0000 UTC m=+118.526493410" lastFinishedPulling="2026-06-03 01:42:31.031698549 +0000 UTC m=+120.596094340" observedRunningTime="2026-06-03 01:42:31.552724318 +0000 UTC m=+121.117120131" watchObservedRunningTime="2026-06-03 01:42:31.552906477 +0000 UTC m=+121.117302285"
Jun 03 01:42:34.686206 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:34.686152    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-xhlkz\" (UID: \"5c6f2ce1-e70c-4c86-84e1-f2f8e7004148\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xhlkz"
Jun 03 01:42:34.688664 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:34.688638    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c6f2ce1-e70c-4c86-84e1-f2f8e7004148-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-xhlkz\" (UID: \"5c6f2ce1-e70c-4c86-84e1-f2f8e7004148\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xhlkz"
Jun 03 01:42:34.786815 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:34.786772    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-metrics-certs\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:34.786981 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:34.786856    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c463f7df-73f3-4c28-906a-c62846ca8a4b-service-ca-bundle\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:34.787499 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:34.787478    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c463f7df-73f3-4c28-906a-c62846ca8a4b-service-ca-bundle\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:34.789173 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:34.789142    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c463f7df-73f3-4c28-906a-c62846ca8a4b-metrics-certs\") pod \"router-default-6fd64f4d5f-4qdl5\" (UID: \"c463f7df-73f3-4c28-906a-c62846ca8a4b\") " pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:34.964207 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:34.964119    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fxlpj\""
Jun 03 01:42:34.972894 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:34.972872    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xhlkz"
Jun 03 01:42:35.071243 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:35.071200    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lqjw6\""
Jun 03 01:42:35.079985 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:35.079951    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:35.094031 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:35.094002    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xhlkz"]
Jun 03 01:42:35.098157 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:42:35.098134    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c6f2ce1_e70c_4c86_84e1_f2f8e7004148.slice/crio-a22fe711d35794e4a53012692dabf6f012366cfeeff9d93e4729acf108a4166a WatchSource:0}: Error finding container a22fe711d35794e4a53012692dabf6f012366cfeeff9d93e4729acf108a4166a: Status 404 returned error can't find the container with id a22fe711d35794e4a53012692dabf6f012366cfeeff9d93e4729acf108a4166a
Jun 03 01:42:35.206045 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:35.206011    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6fd64f4d5f-4qdl5"]
Jun 03 01:42:35.208923 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:42:35.208897    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc463f7df_73f3_4c28_906a_c62846ca8a4b.slice/crio-b2b1ca0c1a1703ad3d86bb08fc428ba77a76c11fff5abfbbbf76fa4579da7023 WatchSource:0}: Error finding container b2b1ca0c1a1703ad3d86bb08fc428ba77a76c11fff5abfbbbf76fa4579da7023: Status 404 returned error can't find the container with id b2b1ca0c1a1703ad3d86bb08fc428ba77a76c11fff5abfbbbf76fa4579da7023
Jun 03 01:42:35.546552 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:35.546456    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5" event={"ID":"c463f7df-73f3-4c28-906a-c62846ca8a4b","Type":"ContainerStarted","Data":"cdc4e4d628d78707d325f584375bf966b2cb561ec82e2dbeffbd5a3467b48ec8"}
Jun 03 01:42:35.546552 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:35.546492    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5" event={"ID":"c463f7df-73f3-4c28-906a-c62846ca8a4b","Type":"ContainerStarted","Data":"b2b1ca0c1a1703ad3d86bb08fc428ba77a76c11fff5abfbbbf76fa4579da7023"}
Jun 03 01:42:35.547476 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:35.547452    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xhlkz" event={"ID":"5c6f2ce1-e70c-4c86-84e1-f2f8e7004148","Type":"ContainerStarted","Data":"a22fe711d35794e4a53012692dabf6f012366cfeeff9d93e4729acf108a4166a"}
Jun 03 01:42:35.563906 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:35.563860    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5" podStartSLOduration=33.563845698 podStartE2EDuration="33.563845698s" podCreationTimestamp="2026-06-03 01:42:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:42:35.562657742 +0000 UTC m=+125.127053558" watchObservedRunningTime="2026-06-03 01:42:35.563845698 +0000 UTC m=+125.128241509"
Jun 03 01:42:36.081217 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:36.081181    2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:36.084216 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:36.084186    2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:36.550256 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:36.550212    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:36.551533 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:36.551510    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6fd64f4d5f-4qdl5"
Jun 03 01:42:37.556967 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:37.556925    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xhlkz" event={"ID":"5c6f2ce1-e70c-4c86-84e1-f2f8e7004148","Type":"ContainerStarted","Data":"645cd0b41d7af243110b7aa4a34fcfe0a657a850cc64dd906076942be79e674b"}
Jun 03 01:42:37.571934 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:37.571874    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xhlkz" podStartSLOduration=34.007688924 podStartE2EDuration="35.571856375s" podCreationTimestamp="2026-06-03 01:42:02 +0000 UTC" firstStartedPulling="2026-06-03 01:42:35.100557058 +0000 UTC m=+124.664952847" lastFinishedPulling="2026-06-03 01:42:36.664724506 +0000 UTC m=+126.229120298" observedRunningTime="2026-06-03 01:42:37.571179994 +0000 UTC m=+127.135575815" watchObservedRunningTime="2026-06-03 01:42:37.571856375 +0000 UTC m=+127.136252189"
Jun 03 01:42:39.828725 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:39.828675    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs\") pod \"network-metrics-daemon-zwwq7\" (UID: \"212f3e8b-a98d-4191-a9b8-b42694d05b21\") " pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:42:39.830923 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:39.830903    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/212f3e8b-a98d-4191-a9b8-b42694d05b21-metrics-certs\") pod \"network-metrics-daemon-zwwq7\" (UID: \"212f3e8b-a98d-4191-a9b8-b42694d05b21\") " pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:42:39.898819 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:39.898790    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sx8gm\""
Jun 03 01:42:39.906646 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:39.906623    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zwwq7"
Jun 03 01:42:40.028120 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:40.028086    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zwwq7"]
Jun 03 01:42:40.031928 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:42:40.031902    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod212f3e8b_a98d_4191_a9b8_b42694d05b21.slice/crio-e3d42e6f884d2730a7129b0479c54479cebb1faf1f599d4db05aae4b8ab28988 WatchSource:0}: Error finding container e3d42e6f884d2730a7129b0479c54479cebb1faf1f599d4db05aae4b8ab28988: Status 404 returned error can't find the container with id e3d42e6f884d2730a7129b0479c54479cebb1faf1f599d4db05aae4b8ab28988
Jun 03 01:42:40.565744 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:40.565700    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zwwq7" event={"ID":"212f3e8b-a98d-4191-a9b8-b42694d05b21","Type":"ContainerStarted","Data":"e3d42e6f884d2730a7129b0479c54479cebb1faf1f599d4db05aae4b8ab28988"}
Jun 03 01:42:41.569963 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:41.569919    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zwwq7" event={"ID":"212f3e8b-a98d-4191-a9b8-b42694d05b21","Type":"ContainerStarted","Data":"3981675f36bdb4e7abb6d56d7e0ba7a18050212a188e5ea46a2d30ab73fe82ea"}
Jun 03 01:42:41.569963 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:41.569962    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zwwq7" event={"ID":"212f3e8b-a98d-4191-a9b8-b42694d05b21","Type":"ContainerStarted","Data":"794b3d71100ac0099170fd0e6e3d14d390e3ce34fa45a18ad880cea11f4535ef"}
Jun 03 01:42:41.587466 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:41.587383    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zwwq7" podStartSLOduration=129.567509069 podStartE2EDuration="2m10.587363591s" podCreationTimestamp="2026-06-03 01:40:31 +0000 UTC" firstStartedPulling="2026-06-03 01:42:40.033744547 +0000 UTC m=+129.598140336" lastFinishedPulling="2026-06-03 01:42:41.053599052 +0000 UTC m=+130.617994858" observedRunningTime="2026-06-03 01:42:41.585841184 +0000 UTC m=+131.150236996" watchObservedRunningTime="2026-06-03 01:42:41.587363591 +0000 UTC m=+131.151759403"
Jun 03 01:42:42.053573 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.053528    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c99f595c-zl8vj"]
Jun 03 01:42:42.056717 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.056693    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.059909 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.059884    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 03 01:42:42.059909 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.059893    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7lnrl\""
Jun 03 01:42:42.060087 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.059899    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 03 01:42:42.060724 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.060708    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 03 01:42:42.064199 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.064173    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 03 01:42:42.069736 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.069714    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c99f595c-zl8vj"]
Jun 03 01:42:42.145430 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.145390    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de4faf03-321d-44d3-8f21-6411d381e32e-image-registry-private-configuration\") pod \"image-registry-6c99f595c-zl8vj\" (UID: \"de4faf03-321d-44d3-8f21-6411d381e32e\") " pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.145633 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.145445    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgcxz\" (UniqueName: \"kubernetes.io/projected/de4faf03-321d-44d3-8f21-6411d381e32e-kube-api-access-rgcxz\") pod \"image-registry-6c99f595c-zl8vj\" (UID: \"de4faf03-321d-44d3-8f21-6411d381e32e\") " pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.145633 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.145529    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de4faf03-321d-44d3-8f21-6411d381e32e-registry-tls\") pod \"image-registry-6c99f595c-zl8vj\" (UID: \"de4faf03-321d-44d3-8f21-6411d381e32e\") " pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.145633 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.145565    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de4faf03-321d-44d3-8f21-6411d381e32e-ca-trust-extracted\") pod \"image-registry-6c99f595c-zl8vj\" (UID: \"de4faf03-321d-44d3-8f21-6411d381e32e\") " pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.145633 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.145623    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de4faf03-321d-44d3-8f21-6411d381e32e-trusted-ca\") pod \"image-registry-6c99f595c-zl8vj\" (UID: \"de4faf03-321d-44d3-8f21-6411d381e32e\") " pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.145825 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.145656    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de4faf03-321d-44d3-8f21-6411d381e32e-registry-certificates\") pod \"image-registry-6c99f595c-zl8vj\" (UID: \"de4faf03-321d-44d3-8f21-6411d381e32e\") " pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.145825 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.145686    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de4faf03-321d-44d3-8f21-6411d381e32e-installation-pull-secrets\") pod \"image-registry-6c99f595c-zl8vj\" (UID: \"de4faf03-321d-44d3-8f21-6411d381e32e\") " pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.145825 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.145703    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de4faf03-321d-44d3-8f21-6411d381e32e-bound-sa-token\") pod \"image-registry-6c99f595c-zl8vj\" (UID: \"de4faf03-321d-44d3-8f21-6411d381e32e\") " pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.246338 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.246243    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rgcxz\" (UniqueName: \"kubernetes.io/projected/de4faf03-321d-44d3-8f21-6411d381e32e-kube-api-access-rgcxz\") pod \"image-registry-6c99f595c-zl8vj\" (UID: \"de4faf03-321d-44d3-8f21-6411d381e32e\") " pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.246338 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.246302    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de4faf03-321d-44d3-8f21-6411d381e32e-registry-tls\") pod \"image-registry-6c99f595c-zl8vj\" (UID: \"de4faf03-321d-44d3-8f21-6411d381e32e\") " pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.246338 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.246328    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de4faf03-321d-44d3-8f21-6411d381e32e-ca-trust-extracted\") pod \"image-registry-6c99f595c-zl8vj\" (UID: \"de4faf03-321d-44d3-8f21-6411d381e32e\") " pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.246660 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.246359    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de4faf03-321d-44d3-8f21-6411d381e32e-trusted-ca\") pod \"image-registry-6c99f595c-zl8vj\" (UID: \"de4faf03-321d-44d3-8f21-6411d381e32e\") " pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.246660 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.246393    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de4faf03-321d-44d3-8f21-6411d381e32e-registry-certificates\") pod \"image-registry-6c99f595c-zl8vj\" (UID: \"de4faf03-321d-44d3-8f21-6411d381e32e\") " pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.246660 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.246421    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de4faf03-321d-44d3-8f21-6411d381e32e-installation-pull-secrets\") pod \"image-registry-6c99f595c-zl8vj\" (UID: \"de4faf03-321d-44d3-8f21-6411d381e32e\") " pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.246660 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.246444    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de4faf03-321d-44d3-8f21-6411d381e32e-bound-sa-token\") pod \"image-registry-6c99f595c-zl8vj\" (UID: \"de4faf03-321d-44d3-8f21-6411d381e32e\") " pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.246660 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.246481    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de4faf03-321d-44d3-8f21-6411d381e32e-image-registry-private-configuration\") pod \"image-registry-6c99f595c-zl8vj\" (UID: \"de4faf03-321d-44d3-8f21-6411d381e32e\") " pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.246953 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.246924    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de4faf03-321d-44d3-8f21-6411d381e32e-ca-trust-extracted\") pod \"image-registry-6c99f595c-zl8vj\" (UID: \"de4faf03-321d-44d3-8f21-6411d381e32e\") " pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.247401 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.247381    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de4faf03-321d-44d3-8f21-6411d381e32e-registry-certificates\") pod \"image-registry-6c99f595c-zl8vj\" (UID: \"de4faf03-321d-44d3-8f21-6411d381e32e\") " pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.247778 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.247751    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de4faf03-321d-44d3-8f21-6411d381e32e-trusted-ca\") pod \"image-registry-6c99f595c-zl8vj\" (UID: \"de4faf03-321d-44d3-8f21-6411d381e32e\") " pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.248884 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.248865    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de4faf03-321d-44d3-8f21-6411d381e32e-registry-tls\") pod \"image-registry-6c99f595c-zl8vj\" (UID: \"de4faf03-321d-44d3-8f21-6411d381e32e\") " pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.248976 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.248952    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de4faf03-321d-44d3-8f21-6411d381e32e-image-registry-private-configuration\") pod \"image-registry-6c99f595c-zl8vj\" (UID: \"de4faf03-321d-44d3-8f21-6411d381e32e\") " pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.249150 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.249129    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de4faf03-321d-44d3-8f21-6411d381e32e-installation-pull-secrets\") pod \"image-registry-6c99f595c-zl8vj\" (UID: \"de4faf03-321d-44d3-8f21-6411d381e32e\") " pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.254710 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.254685    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de4faf03-321d-44d3-8f21-6411d381e32e-bound-sa-token\") pod \"image-registry-6c99f595c-zl8vj\" (UID: \"de4faf03-321d-44d3-8f21-6411d381e32e\") " pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.255406 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.255384    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgcxz\" (UniqueName: \"kubernetes.io/projected/de4faf03-321d-44d3-8f21-6411d381e32e-kube-api-access-rgcxz\") pod \"image-registry-6c99f595c-zl8vj\" (UID: \"de4faf03-321d-44d3-8f21-6411d381e32e\") " pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.365790 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.365749    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.497929 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.497840    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c99f595c-zl8vj"]
Jun 03 01:42:42.501137 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:42:42.501108    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde4faf03_321d_44d3_8f21_6411d381e32e.slice/crio-e08ae4e23c1f4a43d393622ba905f0b662db18a0907a7d00414cd2dfda931e96 WatchSource:0}: Error finding container e08ae4e23c1f4a43d393622ba905f0b662db18a0907a7d00414cd2dfda931e96: Status 404 returned error can't find the container with id e08ae4e23c1f4a43d393622ba905f0b662db18a0907a7d00414cd2dfda931e96
Jun 03 01:42:42.575230 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.575197    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c99f595c-zl8vj" event={"ID":"de4faf03-321d-44d3-8f21-6411d381e32e","Type":"ContainerStarted","Data":"9f4f6207fe788a84e9c3128e907b1085686370313ee2a797506eccfe8c33a14d"}
Jun 03 01:42:42.575626 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.575238    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c99f595c-zl8vj" event={"ID":"de4faf03-321d-44d3-8f21-6411d381e32e","Type":"ContainerStarted","Data":"e08ae4e23c1f4a43d393622ba905f0b662db18a0907a7d00414cd2dfda931e96"}
Jun 03 01:42:42.575626 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.575373    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:42:42.596962 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:42.596910    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c99f595c-zl8vj" podStartSLOduration=0.59689616 podStartE2EDuration="596.89616ms" podCreationTimestamp="2026-06-03 01:42:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:42:42.596245699 +0000 UTC m=+132.160641513" watchObservedRunningTime="2026-06-03 01:42:42.59689616 +0000 UTC m=+132.161291970"
Jun 03 01:42:49.586435 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.586394    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bfp6w"]
Jun 03 01:42:49.593551 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.593515    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.596074 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.595786    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 03 01:42:49.596074 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.595811    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 03 01:42:49.596074 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.595840    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 03 01:42:49.596074 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.595925    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 03 01:42:49.596691 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.596676    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f77s6\""
Jun 03 01:42:49.701200 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.701164    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-node-exporter-wtmp\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.701200 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.701205    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z5tv\" (UniqueName: \"kubernetes.io/projected/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-kube-api-access-5z5tv\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.701475 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.701236    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-metrics-client-ca\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.701475 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.701265    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.701475 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.701288    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-node-exporter-textfile\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.701475 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.701303    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-sys\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.701475 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.701321    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-root\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.701475 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.701405    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-node-exporter-accelerators-collector-config\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.701475 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.701466    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-node-exporter-tls\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.802689 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.802652    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.802869 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.802701    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-node-exporter-textfile\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.802869 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.802734    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-sys\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.802869 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.802759    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-root\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.802869 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.802792    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-node-exporter-accelerators-collector-config\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.802869 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.802849    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-node-exporter-tls\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.803122 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.802858    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-sys\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.803122 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.802886    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-node-exporter-wtmp\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.803122 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.802866    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-root\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.803122 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.802919    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5z5tv\" (UniqueName: \"kubernetes.io/projected/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-kube-api-access-5z5tv\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.803122 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.802994    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-metrics-client-ca\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.803122 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.803091    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-node-exporter-wtmp\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.803122 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.803121    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-node-exporter-textfile\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.803646 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.803626    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-metrics-client-ca\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.803696 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.803626    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-node-exporter-accelerators-collector-config\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.805619 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.805597    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.805784 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.805763    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-node-exporter-tls\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.810275 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.810250    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z5tv\" (UniqueName: \"kubernetes.io/projected/e6e67ccc-cb1f-4856-b0d7-049b1a67872e-kube-api-access-5z5tv\") pod \"node-exporter-bfp6w\" (UID: \"e6e67ccc-cb1f-4856-b0d7-049b1a67872e\") " pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.904689 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:49.904650    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bfp6w"
Jun 03 01:42:49.913004 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:42:49.912968    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6e67ccc_cb1f_4856_b0d7_049b1a67872e.slice/crio-fe8d0d728760fdd3a3d4b1a1f1b68982459b2e6de78fb87b70ccad0531ebf245 WatchSource:0}: Error finding container fe8d0d728760fdd3a3d4b1a1f1b68982459b2e6de78fb87b70ccad0531ebf245: Status 404 returned error can't find the container with id fe8d0d728760fdd3a3d4b1a1f1b68982459b2e6de78fb87b70ccad0531ebf245
Jun 03 01:42:50.595601 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.595532    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bfp6w" event={"ID":"e6e67ccc-cb1f-4856-b0d7-049b1a67872e","Type":"ContainerStarted","Data":"fe8d0d728760fdd3a3d4b1a1f1b68982459b2e6de78fb87b70ccad0531ebf245"}
Jun 03 01:42:50.634264 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.634203    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 01:42:50.639833 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.639806    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.642274 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.642105    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 03 01:42:50.642274 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.642142    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5r522\""
Jun 03 01:42:50.642274 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.642154    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 03 01:42:50.642274 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.642206    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 03 01:42:50.642274 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.642105    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 03 01:42:50.642599 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.642363    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 03 01:42:50.642599 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.642427    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 03 01:42:50.642599 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.642485    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 03 01:42:50.642599 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.642499    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 03 01:42:50.642770 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.642665    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 03 01:42:50.655451 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.655421    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 01:42:50.710648 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.710611    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c90b783-8b32-49de-ba05-d3b517823841-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.710822 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.710666    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.710822 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.710689    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gfvd\" (UniqueName: \"kubernetes.io/projected/8c90b783-8b32-49de-ba05-d3b517823841-kube-api-access-9gfvd\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.710822 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.710709    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.710822 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.710734    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c90b783-8b32-49de-ba05-d3b517823841-config-out\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.710822 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.710804    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-config-volume\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.711017 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.710850    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c90b783-8b32-49de-ba05-d3b517823841-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.711017 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.710929    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-web-config\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.711017 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.710958    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.711017 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.710985    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c90b783-8b32-49de-ba05-d3b517823841-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.711248 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.711053    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.711248 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.711125    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.711248 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.711164    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8c90b783-8b32-49de-ba05-d3b517823841-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.811718 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.811686    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.811843 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.811733    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gfvd\" (UniqueName: \"kubernetes.io/projected/8c90b783-8b32-49de-ba05-d3b517823841-kube-api-access-9gfvd\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.811843 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.811763    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.811843 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.811791    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c90b783-8b32-49de-ba05-d3b517823841-config-out\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.811977 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.811952    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-config-volume\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.812035 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.812004    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c90b783-8b32-49de-ba05-d3b517823841-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.813968 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.812224    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-web-config\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.813968 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.812270    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.813968 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.812303    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c90b783-8b32-49de-ba05-d3b517823841-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.813968 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.812336    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.813968 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.812377    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.813968 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.812415    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8c90b783-8b32-49de-ba05-d3b517823841-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.813968 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.812445    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c90b783-8b32-49de-ba05-d3b517823841-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.813968 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.812793    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c90b783-8b32-49de-ba05-d3b517823841-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.813968 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.813123    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8c90b783-8b32-49de-ba05-d3b517823841-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.813968 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.813923    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c90b783-8b32-49de-ba05-d3b517823841-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.814891 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.814862    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.815319 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.815295    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.815610 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.815558    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-web-config\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.816325 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.816283    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.816923 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.816495    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-config-volume\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.816923 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.816887    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.817093 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.817072    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c90b783-8b32-49de-ba05-d3b517823841-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.817174 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.817153    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c90b783-8b32-49de-ba05-d3b517823841-config-out\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.818369 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.818339    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.821771 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.821751    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gfvd\" (UniqueName: \"kubernetes.io/projected/8c90b783-8b32-49de-ba05-d3b517823841-kube-api-access-9gfvd\") pod \"alertmanager-main-0\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:50.958626 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:50.958550    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:42:51.104127 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:51.103968    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 01:42:51.106624 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:42:51.106577    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c90b783_8b32_49de_ba05_d3b517823841.slice/crio-8d27f8af55f611b83fa2945c214fc7173e0999b84ffec9f4067050982a52c26a WatchSource:0}: Error finding container 8d27f8af55f611b83fa2945c214fc7173e0999b84ffec9f4067050982a52c26a: Status 404 returned error can't find the container with id 8d27f8af55f611b83fa2945c214fc7173e0999b84ffec9f4067050982a52c26a
Jun 03 01:42:51.601523 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:51.601485    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c90b783-8b32-49de-ba05-d3b517823841","Type":"ContainerStarted","Data":"8d27f8af55f611b83fa2945c214fc7173e0999b84ffec9f4067050982a52c26a"}
Jun 03 01:42:51.602797 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:51.602770    2577 generic.go:358] "Generic (PLEG): container finished" podID="e6e67ccc-cb1f-4856-b0d7-049b1a67872e" containerID="c83baab4305a2486243ef12d6334ea1e3ddb920819757865ec151f34dd92801c" exitCode=0
Jun 03 01:42:51.602899 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:51.602810    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bfp6w" event={"ID":"e6e67ccc-cb1f-4856-b0d7-049b1a67872e","Type":"ContainerDied","Data":"c83baab4305a2486243ef12d6334ea1e3ddb920819757865ec151f34dd92801c"}
Jun 03 01:42:52.606952 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:52.606865    2577 generic.go:358] "Generic (PLEG): container finished" podID="8c90b783-8b32-49de-ba05-d3b517823841" containerID="aba45f3f34e145ca04bbf34629860e9c52aeddcf0ce837e70ec1cd6385723019" exitCode=0
Jun 03 01:42:52.607331 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:52.606953    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c90b783-8b32-49de-ba05-d3b517823841","Type":"ContainerDied","Data":"aba45f3f34e145ca04bbf34629860e9c52aeddcf0ce837e70ec1cd6385723019"}
Jun 03 01:42:52.608810 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:52.608789    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bfp6w" event={"ID":"e6e67ccc-cb1f-4856-b0d7-049b1a67872e","Type":"ContainerStarted","Data":"cb5e2fc0ce7e6f43224710b33bf0b65a0dde1004cbe42dcbe0303d4ec81140fb"}
Jun 03 01:42:52.608881 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:52.608816    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bfp6w" event={"ID":"e6e67ccc-cb1f-4856-b0d7-049b1a67872e","Type":"ContainerStarted","Data":"1ea02b1beb941c8da3b2a6536502b6ed4e1c1f6d5deaa8507fc156f1ae945686"}
Jun 03 01:42:52.646432 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:52.646376    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bfp6w" podStartSLOduration=2.81773697 podStartE2EDuration="3.646362355s" podCreationTimestamp="2026-06-03 01:42:49 +0000 UTC" firstStartedPulling="2026-06-03 01:42:49.914971173 +0000 UTC m=+139.479366970" lastFinishedPulling="2026-06-03 01:42:50.743596551 +0000 UTC m=+140.307992355" observedRunningTime="2026-06-03 01:42:52.645081049 +0000 UTC m=+142.209476882" watchObservedRunningTime="2026-06-03 01:42:52.646362355 +0000 UTC m=+142.210758166"
Jun 03 01:42:54.617045 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.617016    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c90b783-8b32-49de-ba05-d3b517823841","Type":"ContainerStarted","Data":"fba0d4e1ed51051e2ce0701e27678f108ae77098486517a9e4fee7d27680ecaa"}
Jun 03 01:42:54.617371 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.617052    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c90b783-8b32-49de-ba05-d3b517823841","Type":"ContainerStarted","Data":"615876b66e40071597b8648093f052b4d26568f40ced1ae952a4c8b4701ddfe6"}
Jun 03 01:42:54.617371 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.617064    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c90b783-8b32-49de-ba05-d3b517823841","Type":"ContainerStarted","Data":"6cae71040d56a3e37efeb6a6b59a76b5624e2e02500a90df9ba9187b39f4d7b1"}
Jun 03 01:42:54.617371 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.617072    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c90b783-8b32-49de-ba05-d3b517823841","Type":"ContainerStarted","Data":"7f279c30cb7e7a8cbf0a1f114912e71bda0d7b0b226f581cae36031e8737a841"}
Jun 03 01:42:54.617371 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.617083    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c90b783-8b32-49de-ba05-d3b517823841","Type":"ContainerStarted","Data":"4028b58cdc57b3bef470b16b5f59af2c70e6b67f095eebe7ea11d2c174b2ca76"}
Jun 03 01:42:54.749957 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.749915    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"]
Jun 03 01:42:54.753137 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.753119    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:54.757344 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.757320    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jun 03 01:42:54.757559 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.757537    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jun 03 01:42:54.757682 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.757563    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jun 03 01:42:54.757817 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.757796    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-8wcts\""
Jun 03 01:42:54.757894 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.757803    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jun 03 01:42:54.758286 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.758271    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jun 03 01:42:54.768967 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.768936    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jun 03 01:42:54.769094 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.769069    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"]
Jun 03 01:42:54.850458 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.850354    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83767c39-2a8a-4689-a7eb-e4fdc77d2238-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d9ff5fbb-jxnmg\" (UID: \"83767c39-2a8a-4689-a7eb-e4fdc77d2238\") " pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:54.850458 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.850396    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/83767c39-2a8a-4689-a7eb-e4fdc77d2238-secret-telemeter-client\") pod \"telemeter-client-d9ff5fbb-jxnmg\" (UID: \"83767c39-2a8a-4689-a7eb-e4fdc77d2238\") " pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:54.850458 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.850420    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83767c39-2a8a-4689-a7eb-e4fdc77d2238-serving-certs-ca-bundle\") pod \"telemeter-client-d9ff5fbb-jxnmg\" (UID: \"83767c39-2a8a-4689-a7eb-e4fdc77d2238\") " pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:54.850458 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.850443    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83767c39-2a8a-4689-a7eb-e4fdc77d2238-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d9ff5fbb-jxnmg\" (UID: \"83767c39-2a8a-4689-a7eb-e4fdc77d2238\") " pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:54.850458 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.850463    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83767c39-2a8a-4689-a7eb-e4fdc77d2238-metrics-client-ca\") pod \"telemeter-client-d9ff5fbb-jxnmg\" (UID: \"83767c39-2a8a-4689-a7eb-e4fdc77d2238\") " pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:54.850816 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.850507    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrggf\" (UniqueName: \"kubernetes.io/projected/83767c39-2a8a-4689-a7eb-e4fdc77d2238-kube-api-access-jrggf\") pod \"telemeter-client-d9ff5fbb-jxnmg\" (UID: \"83767c39-2a8a-4689-a7eb-e4fdc77d2238\") " pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:54.850816 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.850548    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/83767c39-2a8a-4689-a7eb-e4fdc77d2238-telemeter-client-tls\") pod \"telemeter-client-d9ff5fbb-jxnmg\" (UID: \"83767c39-2a8a-4689-a7eb-e4fdc77d2238\") " pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:54.850816 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.850658    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/83767c39-2a8a-4689-a7eb-e4fdc77d2238-federate-client-tls\") pod \"telemeter-client-d9ff5fbb-jxnmg\" (UID: \"83767c39-2a8a-4689-a7eb-e4fdc77d2238\") " pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:54.951888 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.951845    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83767c39-2a8a-4689-a7eb-e4fdc77d2238-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d9ff5fbb-jxnmg\" (UID: \"83767c39-2a8a-4689-a7eb-e4fdc77d2238\") " pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:54.951888 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.951886    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/83767c39-2a8a-4689-a7eb-e4fdc77d2238-secret-telemeter-client\") pod \"telemeter-client-d9ff5fbb-jxnmg\" (UID: \"83767c39-2a8a-4689-a7eb-e4fdc77d2238\") " pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:54.952163 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.951909    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83767c39-2a8a-4689-a7eb-e4fdc77d2238-serving-certs-ca-bundle\") pod \"telemeter-client-d9ff5fbb-jxnmg\" (UID: \"83767c39-2a8a-4689-a7eb-e4fdc77d2238\") " pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:54.952163 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.951931    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83767c39-2a8a-4689-a7eb-e4fdc77d2238-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d9ff5fbb-jxnmg\" (UID: \"83767c39-2a8a-4689-a7eb-e4fdc77d2238\") " pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:54.952163 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.952037    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83767c39-2a8a-4689-a7eb-e4fdc77d2238-metrics-client-ca\") pod \"telemeter-client-d9ff5fbb-jxnmg\" (UID: \"83767c39-2a8a-4689-a7eb-e4fdc77d2238\") " pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:54.952163 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.952087    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jrggf\" (UniqueName: \"kubernetes.io/projected/83767c39-2a8a-4689-a7eb-e4fdc77d2238-kube-api-access-jrggf\") pod \"telemeter-client-d9ff5fbb-jxnmg\" (UID: \"83767c39-2a8a-4689-a7eb-e4fdc77d2238\") " pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:54.952163 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.952129    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/83767c39-2a8a-4689-a7eb-e4fdc77d2238-telemeter-client-tls\") pod \"telemeter-client-d9ff5fbb-jxnmg\" (UID: \"83767c39-2a8a-4689-a7eb-e4fdc77d2238\") " pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:54.952399 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.952228    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/83767c39-2a8a-4689-a7eb-e4fdc77d2238-federate-client-tls\") pod \"telemeter-client-d9ff5fbb-jxnmg\" (UID: \"83767c39-2a8a-4689-a7eb-e4fdc77d2238\") " pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:54.952951 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.952878    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83767c39-2a8a-4689-a7eb-e4fdc77d2238-metrics-client-ca\") pod \"telemeter-client-d9ff5fbb-jxnmg\" (UID: \"83767c39-2a8a-4689-a7eb-e4fdc77d2238\") " pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:54.952951 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.952916    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83767c39-2a8a-4689-a7eb-e4fdc77d2238-serving-certs-ca-bundle\") pod \"telemeter-client-d9ff5fbb-jxnmg\" (UID: \"83767c39-2a8a-4689-a7eb-e4fdc77d2238\") " pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:54.953831 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.953807    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83767c39-2a8a-4689-a7eb-e4fdc77d2238-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d9ff5fbb-jxnmg\" (UID: \"83767c39-2a8a-4689-a7eb-e4fdc77d2238\") " pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:54.954682 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.954658    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/83767c39-2a8a-4689-a7eb-e4fdc77d2238-federate-client-tls\") pod \"telemeter-client-d9ff5fbb-jxnmg\" (UID: \"83767c39-2a8a-4689-a7eb-e4fdc77d2238\") " pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:54.954807 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.954790    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/83767c39-2a8a-4689-a7eb-e4fdc77d2238-telemeter-client-tls\") pod \"telemeter-client-d9ff5fbb-jxnmg\" (UID: \"83767c39-2a8a-4689-a7eb-e4fdc77d2238\") " pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:54.954929 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.954913    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/83767c39-2a8a-4689-a7eb-e4fdc77d2238-secret-telemeter-client\") pod \"telemeter-client-d9ff5fbb-jxnmg\" (UID: \"83767c39-2a8a-4689-a7eb-e4fdc77d2238\") " pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:54.954963 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.954934    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83767c39-2a8a-4689-a7eb-e4fdc77d2238-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d9ff5fbb-jxnmg\" (UID: \"83767c39-2a8a-4689-a7eb-e4fdc77d2238\") " pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:54.959152 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:54.959136    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrggf\" (UniqueName: \"kubernetes.io/projected/83767c39-2a8a-4689-a7eb-e4fdc77d2238-kube-api-access-jrggf\") pod \"telemeter-client-d9ff5fbb-jxnmg\" (UID: \"83767c39-2a8a-4689-a7eb-e4fdc77d2238\") " pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:55.062376 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:55.062335    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"
Jun 03 01:42:55.196945 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:55.196905    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg"]
Jun 03 01:42:55.199110 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:42:55.199078    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83767c39_2a8a_4689_a7eb_e4fdc77d2238.slice/crio-2e62c8721bb523cb752515d7ebe1f4495aecbf96aea60322afa818d9e5389bf1 WatchSource:0}: Error finding container 2e62c8721bb523cb752515d7ebe1f4495aecbf96aea60322afa818d9e5389bf1: Status 404 returned error can't find the container with id 2e62c8721bb523cb752515d7ebe1f4495aecbf96aea60322afa818d9e5389bf1
Jun 03 01:42:55.620703 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:55.620669    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg" event={"ID":"83767c39-2a8a-4689-a7eb-e4fdc77d2238","Type":"ContainerStarted","Data":"2e62c8721bb523cb752515d7ebe1f4495aecbf96aea60322afa818d9e5389bf1"}
Jun 03 01:42:56.625901 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:56.625870    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c90b783-8b32-49de-ba05-d3b517823841","Type":"ContainerStarted","Data":"bcf196fc744b5f61d1994f42cc8d0314b7928dd93e7551c9564806e7093e7d22"}
Jun 03 01:42:56.650287 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:56.650228    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.163845136 podStartE2EDuration="6.650207545s" podCreationTimestamp="2026-06-03 01:42:50 +0000 UTC" firstStartedPulling="2026-06-03 01:42:51.108347183 +0000 UTC m=+140.672742972" lastFinishedPulling="2026-06-03 01:42:55.594709588 +0000 UTC m=+145.159105381" observedRunningTime="2026-06-03 01:42:56.648284251 +0000 UTC m=+146.212680061" watchObservedRunningTime="2026-06-03 01:42:56.650207545 +0000 UTC m=+146.214603356"
Jun 03 01:42:57.631375 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:57.631329    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg" event={"ID":"83767c39-2a8a-4689-a7eb-e4fdc77d2238","Type":"ContainerStarted","Data":"f891e73ec942be120d5e1f5c313ad0c5c3325e470d3583cb60220e37ad8461e2"}
Jun 03 01:42:57.631375 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:57.631378    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg" event={"ID":"83767c39-2a8a-4689-a7eb-e4fdc77d2238","Type":"ContainerStarted","Data":"1ac33fb7c8e66f91d3dac144bf41313bbe8092c1050819f0d456e20a1c7390df"}
Jun 03 01:42:57.998532 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:57.998496    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-rrfkj"]
Jun 03 01:42:58.001637 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:58.001614    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-rrfkj"
Jun 03 01:42:58.004946 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:58.004922    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-vrcgs\""
Jun 03 01:42:58.005045 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:58.004945    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 03 01:42:58.005097 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:58.005054    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 03 01:42:58.013223 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:58.013196    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-rrfkj"]
Jun 03 01:42:58.082348 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:58.082304    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cbmd\" (UniqueName: \"kubernetes.io/projected/b81dfe85-1760-4ac0-87b4-5a90bf58547f-kube-api-access-4cbmd\") pod \"downloads-c65b8dc4b-rrfkj\" (UID: \"b81dfe85-1760-4ac0-87b4-5a90bf58547f\") " pod="openshift-console/downloads-c65b8dc4b-rrfkj"
Jun 03 01:42:58.183034 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:58.182990    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4cbmd\" (UniqueName: \"kubernetes.io/projected/b81dfe85-1760-4ac0-87b4-5a90bf58547f-kube-api-access-4cbmd\") pod \"downloads-c65b8dc4b-rrfkj\" (UID: \"b81dfe85-1760-4ac0-87b4-5a90bf58547f\") " pod="openshift-console/downloads-c65b8dc4b-rrfkj"
Jun 03 01:42:58.192262 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:58.192227    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cbmd\" (UniqueName: \"kubernetes.io/projected/b81dfe85-1760-4ac0-87b4-5a90bf58547f-kube-api-access-4cbmd\") pod \"downloads-c65b8dc4b-rrfkj\" (UID: \"b81dfe85-1760-4ac0-87b4-5a90bf58547f\") " pod="openshift-console/downloads-c65b8dc4b-rrfkj"
Jun 03 01:42:58.310525 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:58.310438    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-rrfkj"
Jun 03 01:42:58.442536 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:58.442496    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-rrfkj"]
Jun 03 01:42:58.445486 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:42:58.445454    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb81dfe85_1760_4ac0_87b4_5a90bf58547f.slice/crio-0345d27e65fb750a2e562a665f36dd2a8f917fce0061c7e671caf01cabfc87f2 WatchSource:0}: Error finding container 0345d27e65fb750a2e562a665f36dd2a8f917fce0061c7e671caf01cabfc87f2: Status 404 returned error can't find the container with id 0345d27e65fb750a2e562a665f36dd2a8f917fce0061c7e671caf01cabfc87f2
Jun 03 01:42:58.635807 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:58.635767    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg" event={"ID":"83767c39-2a8a-4689-a7eb-e4fdc77d2238","Type":"ContainerStarted","Data":"a599e045c9fe20a0464560134076577ed73fcec7828b4a758d7bd2c7fea22bcc"}
Jun 03 01:42:58.636764 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:58.636729    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-rrfkj" event={"ID":"b81dfe85-1760-4ac0-87b4-5a90bf58547f","Type":"ContainerStarted","Data":"0345d27e65fb750a2e562a665f36dd2a8f917fce0061c7e671caf01cabfc87f2"}
Jun 03 01:42:58.661294 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:42:58.661224    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-d9ff5fbb-jxnmg" podStartSLOduration=2.397229613 podStartE2EDuration="4.661203642s" podCreationTimestamp="2026-06-03 01:42:54 +0000 UTC" firstStartedPulling="2026-06-03 01:42:55.201006084 +0000 UTC m=+144.765401874" lastFinishedPulling="2026-06-03 01:42:57.464980106 +0000 UTC m=+147.029375903" observedRunningTime="2026-06-03 01:42:58.659153293 +0000 UTC m=+148.223549103" watchObservedRunningTime="2026-06-03 01:42:58.661203642 +0000 UTC m=+148.225599453"
Jun 03 01:43:03.046276 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.046239    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6485c9758f-m4d9g"]
Jun 03 01:43:03.049884 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.049860    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:03.052892 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.052695    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 03 01:43:03.052892 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.052737    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 03 01:43:03.052892 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.052790    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 03 01:43:03.053755 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.053448    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 03 01:43:03.054001 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.053984    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 03 01:43:03.054229 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.054212    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gp4d2\""
Jun 03 01:43:03.062120 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.061520    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6485c9758f-m4d9g"]
Jun 03 01:43:03.130648 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.130612    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2wxt\" (UniqueName: \"kubernetes.io/projected/7d77d9c3-58e2-4af3-b439-788f88a65bf1-kube-api-access-p2wxt\") pod \"console-6485c9758f-m4d9g\" (UID: \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\") " pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:03.130830 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.130680    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d77d9c3-58e2-4af3-b439-788f88a65bf1-console-oauth-config\") pod \"console-6485c9758f-m4d9g\" (UID: \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\") " pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:03.130830 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.130703    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d77d9c3-58e2-4af3-b439-788f88a65bf1-console-config\") pod \"console-6485c9758f-m4d9g\" (UID: \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\") " pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:03.130830 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.130757    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d77d9c3-58e2-4af3-b439-788f88a65bf1-service-ca\") pod \"console-6485c9758f-m4d9g\" (UID: \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\") " pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:03.130830 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.130820    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d77d9c3-58e2-4af3-b439-788f88a65bf1-console-serving-cert\") pod \"console-6485c9758f-m4d9g\" (UID: \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\") " pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:03.130985 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.130852    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d77d9c3-58e2-4af3-b439-788f88a65bf1-oauth-serving-cert\") pod \"console-6485c9758f-m4d9g\" (UID: \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\") " pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:03.232169 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.232128    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p2wxt\" (UniqueName: \"kubernetes.io/projected/7d77d9c3-58e2-4af3-b439-788f88a65bf1-kube-api-access-p2wxt\") pod \"console-6485c9758f-m4d9g\" (UID: \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\") " pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:03.232353 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.232195    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d77d9c3-58e2-4af3-b439-788f88a65bf1-console-oauth-config\") pod \"console-6485c9758f-m4d9g\" (UID: \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\") " pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:03.232353 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.232294    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d77d9c3-58e2-4af3-b439-788f88a65bf1-console-config\") pod \"console-6485c9758f-m4d9g\" (UID: \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\") " pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:03.232353 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.232341    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d77d9c3-58e2-4af3-b439-788f88a65bf1-service-ca\") pod \"console-6485c9758f-m4d9g\" (UID: \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\") " pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:03.232526 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.232497    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d77d9c3-58e2-4af3-b439-788f88a65bf1-console-serving-cert\") pod \"console-6485c9758f-m4d9g\" (UID: \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\") " pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:03.232575 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.232554    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d77d9c3-58e2-4af3-b439-788f88a65bf1-oauth-serving-cert\") pod \"console-6485c9758f-m4d9g\" (UID: \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\") " pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:03.233004 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.232984    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d77d9c3-58e2-4af3-b439-788f88a65bf1-console-config\") pod \"console-6485c9758f-m4d9g\" (UID: \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\") " pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:03.233157 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.233134    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d77d9c3-58e2-4af3-b439-788f88a65bf1-service-ca\") pod \"console-6485c9758f-m4d9g\" (UID: \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\") " pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:03.233247 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.233229    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d77d9c3-58e2-4af3-b439-788f88a65bf1-oauth-serving-cert\") pod \"console-6485c9758f-m4d9g\" (UID: \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\") " pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:03.234738 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.234711    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d77d9c3-58e2-4af3-b439-788f88a65bf1-console-oauth-config\") pod \"console-6485c9758f-m4d9g\" (UID: \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\") " pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:03.234828 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.234778    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d77d9c3-58e2-4af3-b439-788f88a65bf1-console-serving-cert\") pod \"console-6485c9758f-m4d9g\" (UID: \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\") " pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:03.239238 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.239218    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2wxt\" (UniqueName: \"kubernetes.io/projected/7d77d9c3-58e2-4af3-b439-788f88a65bf1-kube-api-access-p2wxt\") pod \"console-6485c9758f-m4d9g\" (UID: \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\") " pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:03.365553 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.365463    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:03.533881 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.533757    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6485c9758f-m4d9g"]
Jun 03 01:43:03.537057 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:43:03.537030    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d77d9c3_58e2_4af3_b439_788f88a65bf1.slice/crio-d693b3f73e610c432425a1b5dcd6633d75f01db513ef90ab865c375828e283ca WatchSource:0}: Error finding container d693b3f73e610c432425a1b5dcd6633d75f01db513ef90ab865c375828e283ca: Status 404 returned error can't find the container with id d693b3f73e610c432425a1b5dcd6633d75f01db513ef90ab865c375828e283ca
Jun 03 01:43:03.582524 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.582489    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c99f595c-zl8vj"
Jun 03 01:43:03.654150 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:03.654103    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6485c9758f-m4d9g" event={"ID":"7d77d9c3-58e2-4af3-b439-788f88a65bf1","Type":"ContainerStarted","Data":"d693b3f73e610c432425a1b5dcd6633d75f01db513ef90ab865c375828e283ca"}
Jun 03 01:43:07.668653 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:07.668619    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6485c9758f-m4d9g" event={"ID":"7d77d9c3-58e2-4af3-b439-788f88a65bf1","Type":"ContainerStarted","Data":"987d37b92e653da9b4807ba27e85eec8446b4ae2daeb1e9f8f179d87c7d2e201"}
Jun 03 01:43:07.685740 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:07.685685    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6485c9758f-m4d9g" podStartSLOduration=1.372955825 podStartE2EDuration="4.685668435s" podCreationTimestamp="2026-06-03 01:43:03 +0000 UTC" firstStartedPulling="2026-06-03 01:43:03.539565131 +0000 UTC m=+153.103960920" lastFinishedPulling="2026-06-03 01:43:06.852277738 +0000 UTC m=+156.416673530" observedRunningTime="2026-06-03 01:43:07.683716548 +0000 UTC m=+157.248112381" watchObservedRunningTime="2026-06-03 01:43:07.685668435 +0000 UTC m=+157.250064247"
Jun 03 01:43:07.781972 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:43:07.781930    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zthbg" podUID="b3864081-3019-44a7-8958-5075918ca6b3"
Jun 03 01:43:07.798135 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:43:07.798094    2577 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-96vwc" podUID="ab8c3cff-b7cf-4b1e-bc43-a690f753ec12"
Jun 03 01:43:08.671658 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:08.671624    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-96vwc"
Jun 03 01:43:08.672137 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:08.671730    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zthbg"
Jun 03 01:43:12.075645 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.075535    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f875f9cbd-wgvjp"]
Jun 03 01:43:12.078887 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.078863    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:12.086874 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.086842    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jun 03 01:43:12.089430 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.089402    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f875f9cbd-wgvjp"]
Jun 03 01:43:12.217180 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.217122    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f0dde36-65ca-48df-95cc-809fa55dad5e-console-oauth-config\") pod \"console-6f875f9cbd-wgvjp\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") " pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:12.217367 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.217209    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f0dde36-65ca-48df-95cc-809fa55dad5e-console-config\") pod \"console-6f875f9cbd-wgvjp\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") " pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:12.217367 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.217242    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdbsm\" (UniqueName: \"kubernetes.io/projected/0f0dde36-65ca-48df-95cc-809fa55dad5e-kube-api-access-bdbsm\") pod \"console-6f875f9cbd-wgvjp\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") " pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:12.217367 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.217320    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f0dde36-65ca-48df-95cc-809fa55dad5e-console-serving-cert\") pod \"console-6f875f9cbd-wgvjp\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") " pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:12.217367 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.217352    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f0dde36-65ca-48df-95cc-809fa55dad5e-trusted-ca-bundle\") pod \"console-6f875f9cbd-wgvjp\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") " pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:12.217609 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.217429    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f0dde36-65ca-48df-95cc-809fa55dad5e-service-ca\") pod \"console-6f875f9cbd-wgvjp\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") " pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:12.217609 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.217503    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f0dde36-65ca-48df-95cc-809fa55dad5e-oauth-serving-cert\") pod \"console-6f875f9cbd-wgvjp\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") " pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:12.318429 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.318386    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f0dde36-65ca-48df-95cc-809fa55dad5e-console-serving-cert\") pod \"console-6f875f9cbd-wgvjp\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") " pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:12.318753 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.318441    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f0dde36-65ca-48df-95cc-809fa55dad5e-trusted-ca-bundle\") pod \"console-6f875f9cbd-wgvjp\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") " pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:12.318753 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.318468    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f0dde36-65ca-48df-95cc-809fa55dad5e-service-ca\") pod \"console-6f875f9cbd-wgvjp\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") " pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:12.318753 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.318505    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f0dde36-65ca-48df-95cc-809fa55dad5e-oauth-serving-cert\") pod \"console-6f875f9cbd-wgvjp\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") " pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:12.318753 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.318541    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f0dde36-65ca-48df-95cc-809fa55dad5e-console-oauth-config\") pod \"console-6f875f9cbd-wgvjp\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") " pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:12.318753 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.318607    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f0dde36-65ca-48df-95cc-809fa55dad5e-console-config\") pod \"console-6f875f9cbd-wgvjp\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") " pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:12.318753 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.318653    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bdbsm\" (UniqueName: \"kubernetes.io/projected/0f0dde36-65ca-48df-95cc-809fa55dad5e-kube-api-access-bdbsm\") pod \"console-6f875f9cbd-wgvjp\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") " pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:12.319410 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.319375    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f0dde36-65ca-48df-95cc-809fa55dad5e-oauth-serving-cert\") pod \"console-6f875f9cbd-wgvjp\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") " pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:12.319501 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.319458    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f0dde36-65ca-48df-95cc-809fa55dad5e-console-config\") pod \"console-6f875f9cbd-wgvjp\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") " pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:12.319565 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.319527    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f0dde36-65ca-48df-95cc-809fa55dad5e-service-ca\") pod \"console-6f875f9cbd-wgvjp\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") " pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:12.319693 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.319666    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f0dde36-65ca-48df-95cc-809fa55dad5e-trusted-ca-bundle\") pod \"console-6f875f9cbd-wgvjp\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") " pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:12.321497 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.321472    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f0dde36-65ca-48df-95cc-809fa55dad5e-console-serving-cert\") pod \"console-6f875f9cbd-wgvjp\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") " pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:12.321623 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.321606    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f0dde36-65ca-48df-95cc-809fa55dad5e-console-oauth-config\") pod \"console-6f875f9cbd-wgvjp\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") " pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:12.326781 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.326729    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdbsm\" (UniqueName: \"kubernetes.io/projected/0f0dde36-65ca-48df-95cc-809fa55dad5e-kube-api-access-bdbsm\") pod \"console-6f875f9cbd-wgvjp\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") " pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:12.390127 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.390082    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:12.722778 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.722730    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls\") pod \"dns-default-zthbg\" (UID: \"b3864081-3019-44a7-8958-5075918ca6b3\") " pod="openshift-dns/dns-default-zthbg"
Jun 03 01:43:12.722970 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.722795    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert\") pod \"ingress-canary-96vwc\" (UID: \"ab8c3cff-b7cf-4b1e-bc43-a690f753ec12\") " pod="openshift-ingress-canary/ingress-canary-96vwc"
Jun 03 01:43:12.725636 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.725605    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab8c3cff-b7cf-4b1e-bc43-a690f753ec12-cert\") pod \"ingress-canary-96vwc\" (UID: \"ab8c3cff-b7cf-4b1e-bc43-a690f753ec12\") " pod="openshift-ingress-canary/ingress-canary-96vwc"
Jun 03 01:43:12.725938 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.725914    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3864081-3019-44a7-8958-5075918ca6b3-metrics-tls\") pod \"dns-default-zthbg\" (UID: \"b3864081-3019-44a7-8958-5075918ca6b3\") " pod="openshift-dns/dns-default-zthbg"
Jun 03 01:43:12.875271 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.875241    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tsbnv\""
Jun 03 01:43:12.876049 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.876026    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2xcbn\""
Jun 03 01:43:12.883813 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.883785    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-96vwc"
Jun 03 01:43:12.883947 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:12.883818    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zthbg"
Jun 03 01:43:13.366168 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:13.366129    2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:13.366168 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:13.366171    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:13.371988 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:13.371960    2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:13.690309 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:13.690270    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:14.577431 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:14.577243    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zthbg"]
Jun 03 01:43:14.588900 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:43:14.588866    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3864081_3019_44a7_8958_5075918ca6b3.slice/crio-8e03a326ba117bd7b5d42e7778459e50b27e0adcefd9ccc0dcdeb2c75edeb3bb WatchSource:0}: Error finding container 8e03a326ba117bd7b5d42e7778459e50b27e0adcefd9ccc0dcdeb2c75edeb3bb: Status 404 returned error can't find the container with id 8e03a326ba117bd7b5d42e7778459e50b27e0adcefd9ccc0dcdeb2c75edeb3bb
Jun 03 01:43:14.603175 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:14.603137    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f875f9cbd-wgvjp"]
Jun 03 01:43:14.607943 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:43:14.607907    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f0dde36_65ca_48df_95cc_809fa55dad5e.slice/crio-e00fa000b0032cd5f3f60a879544a519d9c0e0ec298f3ab5de6c6cbad75e89d3 WatchSource:0}: Error finding container e00fa000b0032cd5f3f60a879544a519d9c0e0ec298f3ab5de6c6cbad75e89d3: Status 404 returned error can't find the container with id e00fa000b0032cd5f3f60a879544a519d9c0e0ec298f3ab5de6c6cbad75e89d3
Jun 03 01:43:14.616437 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:14.616410    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-96vwc"]
Jun 03 01:43:14.620089 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:43:14.620064    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab8c3cff_b7cf_4b1e_bc43_a690f753ec12.slice/crio-b7e044cfd119e5a4e35aac1a2e2e0247559409ceb3cbdcf97008ab8058fc37ee WatchSource:0}: Error finding container b7e044cfd119e5a4e35aac1a2e2e0247559409ceb3cbdcf97008ab8058fc37ee: Status 404 returned error can't find the container with id b7e044cfd119e5a4e35aac1a2e2e0247559409ceb3cbdcf97008ab8058fc37ee
Jun 03 01:43:14.690892 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:14.690863    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-rrfkj" event={"ID":"b81dfe85-1760-4ac0-87b4-5a90bf58547f","Type":"ContainerStarted","Data":"a821ecc7a831b591c059d4cac85cfc180e448db96015f844e05e9777b3d6c779"}
Jun 03 01:43:14.691076 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:14.691056    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-rrfkj"
Jun 03 01:43:14.692071 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:14.692045    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-96vwc" event={"ID":"ab8c3cff-b7cf-4b1e-bc43-a690f753ec12","Type":"ContainerStarted","Data":"b7e044cfd119e5a4e35aac1a2e2e0247559409ceb3cbdcf97008ab8058fc37ee"}
Jun 03 01:43:14.692572 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:14.692477    2577 patch_prober.go:28] interesting pod/downloads-c65b8dc4b-rrfkj container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.17:8080/\": dial tcp 10.134.0.17:8080: connect: connection refused" start-of-body=
Jun 03 01:43:14.692572 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:14.692539    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-c65b8dc4b-rrfkj" podUID="b81dfe85-1760-4ac0-87b4-5a90bf58547f" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.17:8080/\": dial tcp 10.134.0.17:8080: connect: connection refused"
Jun 03 01:43:14.693265 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:14.693241    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zthbg" event={"ID":"b3864081-3019-44a7-8958-5075918ca6b3","Type":"ContainerStarted","Data":"8e03a326ba117bd7b5d42e7778459e50b27e0adcefd9ccc0dcdeb2c75edeb3bb"}
Jun 03 01:43:14.694691 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:14.694665    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f875f9cbd-wgvjp" event={"ID":"0f0dde36-65ca-48df-95cc-809fa55dad5e","Type":"ContainerStarted","Data":"e00fa000b0032cd5f3f60a879544a519d9c0e0ec298f3ab5de6c6cbad75e89d3"}
Jun 03 01:43:14.706734 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:14.706670    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-rrfkj" podStartSLOduration=1.614047118 podStartE2EDuration="17.706649923s" podCreationTimestamp="2026-06-03 01:42:57 +0000 UTC" firstStartedPulling="2026-06-03 01:42:58.447233064 +0000 UTC m=+148.011628853" lastFinishedPulling="2026-06-03 01:43:14.539835865 +0000 UTC m=+164.104231658" observedRunningTime="2026-06-03 01:43:14.704769264 +0000 UTC m=+164.269165065" watchObservedRunningTime="2026-06-03 01:43:14.706649923 +0000 UTC m=+164.271045734"
Jun 03 01:43:14.721517 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:14.721462    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6f875f9cbd-wgvjp" podStartSLOduration=2.721435449 podStartE2EDuration="2.721435449s" podCreationTimestamp="2026-06-03 01:43:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:43:14.719035717 +0000 UTC m=+164.283431527" watchObservedRunningTime="2026-06-03 01:43:14.721435449 +0000 UTC m=+164.285831259"
Jun 03 01:43:15.700989 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:15.700821    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f875f9cbd-wgvjp" event={"ID":"0f0dde36-65ca-48df-95cc-809fa55dad5e","Type":"ContainerStarted","Data":"31dccb0422fe12531598a65f0b5e8135deef5c8dccb778f50b8944f207eb65f1"}
Jun 03 01:43:15.716444 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:15.716382    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-rrfkj"
Jun 03 01:43:17.710044 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:17.710008    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-96vwc" event={"ID":"ab8c3cff-b7cf-4b1e-bc43-a690f753ec12","Type":"ContainerStarted","Data":"1d291a661d664aefd41845d8c1f2f3c2c5bc53234c4ed194f438bebd4f962cdd"}
Jun 03 01:43:17.712098 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:17.712071    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zthbg" event={"ID":"b3864081-3019-44a7-8958-5075918ca6b3","Type":"ContainerStarted","Data":"a140c700c8913985ed022122398b4508879bf5e582300e77c7fa583baa129bfe"}
Jun 03 01:43:17.726747 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:17.726687    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-96vwc" podStartSLOduration=130.929761577 podStartE2EDuration="2m13.726666326s" podCreationTimestamp="2026-06-03 01:41:04 +0000 UTC" firstStartedPulling="2026-06-03 01:43:14.622216595 +0000 UTC m=+164.186612397" lastFinishedPulling="2026-06-03 01:43:17.419121353 +0000 UTC m=+166.983517146" observedRunningTime="2026-06-03 01:43:17.725136832 +0000 UTC m=+167.289532643" watchObservedRunningTime="2026-06-03 01:43:17.726666326 +0000 UTC m=+167.291062136"
Jun 03 01:43:18.717073 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:18.717027    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zthbg" event={"ID":"b3864081-3019-44a7-8958-5075918ca6b3","Type":"ContainerStarted","Data":"51632c6ae5c321ae0be30d56946748226220a3fac41a91683f7c534a4d72e012"}
Jun 03 01:43:18.735045 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:18.734988    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-zthbg" podStartSLOduration=131.91289859 podStartE2EDuration="2m14.734968563s" podCreationTimestamp="2026-06-03 01:41:04 +0000 UTC" firstStartedPulling="2026-06-03 01:43:14.591409532 +0000 UTC m=+164.155805322" lastFinishedPulling="2026-06-03 01:43:17.413479489 +0000 UTC m=+166.977875295" observedRunningTime="2026-06-03 01:43:18.732260587 +0000 UTC m=+168.296656398" watchObservedRunningTime="2026-06-03 01:43:18.734968563 +0000 UTC m=+168.299364375"
Jun 03 01:43:19.721040 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:19.721001    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zthbg"
Jun 03 01:43:22.391054 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:22.391011    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:22.391543 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:22.391068    2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:22.396803 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:22.396768    2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:22.736118 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:22.736034    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:43:22.780845 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:22.780812    2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6485c9758f-m4d9g"]
Jun 03 01:43:29.727105 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:29.727073    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zthbg"
Jun 03 01:43:30.758037 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:30.758005    2577 generic.go:358] "Generic (PLEG): container finished" podID="d7dc8e7f-6638-40fb-9c54-6cc4902c5938" containerID="43ddbfccfd04b6f5788a7ed48f09fec3d0c4f70c4eb3160fbf4cf29d791a0e36" exitCode=0
Jun 03 01:43:30.758387 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:30.758077    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-9j24t" event={"ID":"d7dc8e7f-6638-40fb-9c54-6cc4902c5938","Type":"ContainerDied","Data":"43ddbfccfd04b6f5788a7ed48f09fec3d0c4f70c4eb3160fbf4cf29d791a0e36"}
Jun 03 01:43:30.758427 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:30.758387    2577 scope.go:117] "RemoveContainer" containerID="43ddbfccfd04b6f5788a7ed48f09fec3d0c4f70c4eb3160fbf4cf29d791a0e36"
Jun 03 01:43:31.762775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:31.762740    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-9j24t" event={"ID":"d7dc8e7f-6638-40fb-9c54-6cc4902c5938","Type":"ContainerStarted","Data":"3fb7828a4b6302b6fad4559d8a8c7b3303c7fb731d0367d12b8a101b143a4de9"}
Jun 03 01:43:36.777985 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:36.777948    2577 generic.go:358] "Generic (PLEG): container finished" podID="9660d554-801a-4129-b6f1-d316e2ba79a5" containerID="06e156d8d5e71ba9b2808675e254803b69b90fd70292c2e1128f1496ddd6a7e3" exitCode=0
Jun 03 01:43:36.778396 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:36.778004    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-hz9sm" event={"ID":"9660d554-801a-4129-b6f1-d316e2ba79a5","Type":"ContainerDied","Data":"06e156d8d5e71ba9b2808675e254803b69b90fd70292c2e1128f1496ddd6a7e3"}
Jun 03 01:43:36.778396 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:36.778349    2577 scope.go:117] "RemoveContainer" containerID="06e156d8d5e71ba9b2808675e254803b69b90fd70292c2e1128f1496ddd6a7e3"
Jun 03 01:43:37.782602 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:37.782546    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-hz9sm" event={"ID":"9660d554-801a-4129-b6f1-d316e2ba79a5","Type":"ContainerStarted","Data":"38fba8c83f64b8a37ce2b41cf911eca224ac6015fe3876822a7aed96342fed45"}
Jun 03 01:43:47.807620 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:47.807529    2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6485c9758f-m4d9g" podUID="7d77d9c3-58e2-4af3-b439-788f88a65bf1" containerName="console" containerID="cri-o://987d37b92e653da9b4807ba27e85eec8446b4ae2daeb1e9f8f179d87c7d2e201" gracePeriod=15
Jun 03 01:43:48.085030 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.085004    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6485c9758f-m4d9g_7d77d9c3-58e2-4af3-b439-788f88a65bf1/console/0.log"
Jun 03 01:43:48.085182 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.085092    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:48.140730 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.140697    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2wxt\" (UniqueName: \"kubernetes.io/projected/7d77d9c3-58e2-4af3-b439-788f88a65bf1-kube-api-access-p2wxt\") pod \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\" (UID: \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\") "
Jun 03 01:43:48.140921 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.140752    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d77d9c3-58e2-4af3-b439-788f88a65bf1-console-oauth-config\") pod \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\" (UID: \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\") "
Jun 03 01:43:48.140921 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.140842    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d77d9c3-58e2-4af3-b439-788f88a65bf1-console-serving-cert\") pod \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\" (UID: \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\") "
Jun 03 01:43:48.141039 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.140931    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d77d9c3-58e2-4af3-b439-788f88a65bf1-console-config\") pod \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\" (UID: \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\") "
Jun 03 01:43:48.141039 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.141007    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d77d9c3-58e2-4af3-b439-788f88a65bf1-oauth-serving-cert\") pod \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\" (UID: \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\") "
Jun 03 01:43:48.141132 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.141095    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d77d9c3-58e2-4af3-b439-788f88a65bf1-service-ca\") pod \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\" (UID: \"7d77d9c3-58e2-4af3-b439-788f88a65bf1\") "
Jun 03 01:43:48.141319 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.141271    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d77d9c3-58e2-4af3-b439-788f88a65bf1-console-config" (OuterVolumeSpecName: "console-config") pod "7d77d9c3-58e2-4af3-b439-788f88a65bf1" (UID: "7d77d9c3-58e2-4af3-b439-788f88a65bf1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 01:43:48.141452 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.141405    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d77d9c3-58e2-4af3-b439-788f88a65bf1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7d77d9c3-58e2-4af3-b439-788f88a65bf1" (UID: "7d77d9c3-58e2-4af3-b439-788f88a65bf1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 01:43:48.141526 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.141499    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d77d9c3-58e2-4af3-b439-788f88a65bf1-service-ca" (OuterVolumeSpecName: "service-ca") pod "7d77d9c3-58e2-4af3-b439-788f88a65bf1" (UID: "7d77d9c3-58e2-4af3-b439-788f88a65bf1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 01:43:48.143054 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.143023    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d77d9c3-58e2-4af3-b439-788f88a65bf1-kube-api-access-p2wxt" (OuterVolumeSpecName: "kube-api-access-p2wxt") pod "7d77d9c3-58e2-4af3-b439-788f88a65bf1" (UID: "7d77d9c3-58e2-4af3-b439-788f88a65bf1"). InnerVolumeSpecName "kube-api-access-p2wxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:43:48.143054 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.143023    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d77d9c3-58e2-4af3-b439-788f88a65bf1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7d77d9c3-58e2-4af3-b439-788f88a65bf1" (UID: "7d77d9c3-58e2-4af3-b439-788f88a65bf1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 01:43:48.143184 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.143104    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d77d9c3-58e2-4af3-b439-788f88a65bf1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7d77d9c3-58e2-4af3-b439-788f88a65bf1" (UID: "7d77d9c3-58e2-4af3-b439-788f88a65bf1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 01:43:48.242600 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.242545    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d77d9c3-58e2-4af3-b439-788f88a65bf1-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:43:48.242600 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.242576    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2wxt\" (UniqueName: \"kubernetes.io/projected/7d77d9c3-58e2-4af3-b439-788f88a65bf1-kube-api-access-p2wxt\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:43:48.242795 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.242610    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d77d9c3-58e2-4af3-b439-788f88a65bf1-console-oauth-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:43:48.242795 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.242620    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d77d9c3-58e2-4af3-b439-788f88a65bf1-console-serving-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:43:48.242795 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.242629    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d77d9c3-58e2-4af3-b439-788f88a65bf1-console-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:43:48.242795 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.242638    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d77d9c3-58e2-4af3-b439-788f88a65bf1-oauth-serving-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:43:48.812842 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.812812    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6485c9758f-m4d9g_7d77d9c3-58e2-4af3-b439-788f88a65bf1/console/0.log"
Jun 03 01:43:48.813278 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.812860    2577 generic.go:358] "Generic (PLEG): container finished" podID="7d77d9c3-58e2-4af3-b439-788f88a65bf1" containerID="987d37b92e653da9b4807ba27e85eec8446b4ae2daeb1e9f8f179d87c7d2e201" exitCode=2
Jun 03 01:43:48.813278 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.812925    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6485c9758f-m4d9g"
Jun 03 01:43:48.813278 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.812948    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6485c9758f-m4d9g" event={"ID":"7d77d9c3-58e2-4af3-b439-788f88a65bf1","Type":"ContainerDied","Data":"987d37b92e653da9b4807ba27e85eec8446b4ae2daeb1e9f8f179d87c7d2e201"}
Jun 03 01:43:48.813278 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.812993    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6485c9758f-m4d9g" event={"ID":"7d77d9c3-58e2-4af3-b439-788f88a65bf1","Type":"ContainerDied","Data":"d693b3f73e610c432425a1b5dcd6633d75f01db513ef90ab865c375828e283ca"}
Jun 03 01:43:48.813278 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.813014    2577 scope.go:117] "RemoveContainer" containerID="987d37b92e653da9b4807ba27e85eec8446b4ae2daeb1e9f8f179d87c7d2e201"
Jun 03 01:43:48.821781 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.821762    2577 scope.go:117] "RemoveContainer" containerID="987d37b92e653da9b4807ba27e85eec8446b4ae2daeb1e9f8f179d87c7d2e201"
Jun 03 01:43:48.822039 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:43:48.822016    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"987d37b92e653da9b4807ba27e85eec8446b4ae2daeb1e9f8f179d87c7d2e201\": container with ID starting with 987d37b92e653da9b4807ba27e85eec8446b4ae2daeb1e9f8f179d87c7d2e201 not found: ID does not exist" containerID="987d37b92e653da9b4807ba27e85eec8446b4ae2daeb1e9f8f179d87c7d2e201"
Jun 03 01:43:48.822105 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.822052    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"987d37b92e653da9b4807ba27e85eec8446b4ae2daeb1e9f8f179d87c7d2e201"} err="failed to get container status \"987d37b92e653da9b4807ba27e85eec8446b4ae2daeb1e9f8f179d87c7d2e201\": rpc error: code = NotFound desc = could not find container \"987d37b92e653da9b4807ba27e85eec8446b4ae2daeb1e9f8f179d87c7d2e201\": container with ID starting with 987d37b92e653da9b4807ba27e85eec8446b4ae2daeb1e9f8f179d87c7d2e201 not found: ID does not exist"
Jun 03 01:43:48.833310 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.833283    2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6485c9758f-m4d9g"]
Jun 03 01:43:48.838998 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:48.838974    2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6485c9758f-m4d9g"]
Jun 03 01:43:49.078793 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:43:49.078711    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d77d9c3-58e2-4af3-b439-788f88a65bf1" path="/var/lib/kubelet/pods/7d77d9c3-58e2-4af3-b439-788f88a65bf1/volumes"
Jun 03 01:44:09.866036 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:09.865998    2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 01:44:09.866452 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:09.866417    2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="alertmanager" containerID="cri-o://4028b58cdc57b3bef470b16b5f59af2c70e6b67f095eebe7ea11d2c174b2ca76" gracePeriod=120
Jun 03 01:44:09.866564 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:09.866506    2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="kube-rbac-proxy-web" containerID="cri-o://6cae71040d56a3e37efeb6a6b59a76b5624e2e02500a90df9ba9187b39f4d7b1" gracePeriod=120
Jun 03 01:44:09.866806 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:09.866537    2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="kube-rbac-proxy" containerID="cri-o://615876b66e40071597b8648093f052b4d26568f40ced1ae952a4c8b4701ddfe6" gracePeriod=120
Jun 03 01:44:09.866969 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:09.866571    2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="config-reloader" containerID="cri-o://7f279c30cb7e7a8cbf0a1f114912e71bda0d7b0b226f581cae36031e8737a841" gracePeriod=120
Jun 03 01:44:09.866969 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:09.866599    2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="kube-rbac-proxy-metric" containerID="cri-o://fba0d4e1ed51051e2ce0701e27678f108ae77098486517a9e4fee7d27680ecaa" gracePeriod=120
Jun 03 01:44:09.866969 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:09.866641    2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="prom-label-proxy" containerID="cri-o://bcf196fc744b5f61d1994f42cc8d0314b7928dd93e7551c9564806e7093e7d22" gracePeriod=120
Jun 03 01:44:10.881283 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:10.881249    2577 generic.go:358] "Generic (PLEG): container finished" podID="8c90b783-8b32-49de-ba05-d3b517823841" containerID="bcf196fc744b5f61d1994f42cc8d0314b7928dd93e7551c9564806e7093e7d22" exitCode=0
Jun 03 01:44:10.881283 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:10.881275    2577 generic.go:358] "Generic (PLEG): container finished" podID="8c90b783-8b32-49de-ba05-d3b517823841" containerID="615876b66e40071597b8648093f052b4d26568f40ced1ae952a4c8b4701ddfe6" exitCode=0
Jun 03 01:44:10.881283 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:10.881282    2577 generic.go:358] "Generic (PLEG): container finished" podID="8c90b783-8b32-49de-ba05-d3b517823841" containerID="6cae71040d56a3e37efeb6a6b59a76b5624e2e02500a90df9ba9187b39f4d7b1" exitCode=0
Jun 03 01:44:10.881283 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:10.881288    2577 generic.go:358] "Generic (PLEG): container finished" podID="8c90b783-8b32-49de-ba05-d3b517823841" containerID="7f279c30cb7e7a8cbf0a1f114912e71bda0d7b0b226f581cae36031e8737a841" exitCode=0
Jun 03 01:44:10.881826 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:10.881296    2577 generic.go:358] "Generic (PLEG): container finished" podID="8c90b783-8b32-49de-ba05-d3b517823841" containerID="4028b58cdc57b3bef470b16b5f59af2c70e6b67f095eebe7ea11d2c174b2ca76" exitCode=0
Jun 03 01:44:10.881826 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:10.881319    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c90b783-8b32-49de-ba05-d3b517823841","Type":"ContainerDied","Data":"bcf196fc744b5f61d1994f42cc8d0314b7928dd93e7551c9564806e7093e7d22"}
Jun 03 01:44:10.881826 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:10.881352    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c90b783-8b32-49de-ba05-d3b517823841","Type":"ContainerDied","Data":"615876b66e40071597b8648093f052b4d26568f40ced1ae952a4c8b4701ddfe6"}
Jun 03 01:44:10.881826 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:10.881363    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c90b783-8b32-49de-ba05-d3b517823841","Type":"ContainerDied","Data":"6cae71040d56a3e37efeb6a6b59a76b5624e2e02500a90df9ba9187b39f4d7b1"}
Jun 03 01:44:10.881826 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:10.881373    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c90b783-8b32-49de-ba05-d3b517823841","Type":"ContainerDied","Data":"7f279c30cb7e7a8cbf0a1f114912e71bda0d7b0b226f581cae36031e8737a841"}
Jun 03 01:44:10.881826 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:10.881381    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c90b783-8b32-49de-ba05-d3b517823841","Type":"ContainerDied","Data":"4028b58cdc57b3bef470b16b5f59af2c70e6b67f095eebe7ea11d2c174b2ca76"}
Jun 03 01:44:11.109266 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.109241    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:11.143913 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.143829    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c90b783-8b32-49de-ba05-d3b517823841-tls-assets\") pod \"8c90b783-8b32-49de-ba05-d3b517823841\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") "
Jun 03 01:44:11.143913 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.143876    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c90b783-8b32-49de-ba05-d3b517823841-config-out\") pod \"8c90b783-8b32-49de-ba05-d3b517823841\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") "
Jun 03 01:44:11.144131 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.144007    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8c90b783-8b32-49de-ba05-d3b517823841\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") "
Jun 03 01:44:11.144131 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.144048    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-config-volume\") pod \"8c90b783-8b32-49de-ba05-d3b517823841\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") "
Jun 03 01:44:11.144131 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.144082    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-secret-alertmanager-kube-rbac-proxy\") pod \"8c90b783-8b32-49de-ba05-d3b517823841\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") "
Jun 03 01:44:11.144131 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.144117    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-web-config\") pod \"8c90b783-8b32-49de-ba05-d3b517823841\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") "
Jun 03 01:44:11.144341 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.144156    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gfvd\" (UniqueName: \"kubernetes.io/projected/8c90b783-8b32-49de-ba05-d3b517823841-kube-api-access-9gfvd\") pod \"8c90b783-8b32-49de-ba05-d3b517823841\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") "
Jun 03 01:44:11.144341 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.144181    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-cluster-tls-config\") pod \"8c90b783-8b32-49de-ba05-d3b517823841\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") "
Jun 03 01:44:11.147106 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.146697    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c90b783-8b32-49de-ba05-d3b517823841-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8c90b783-8b32-49de-ba05-d3b517823841" (UID: "8c90b783-8b32-49de-ba05-d3b517823841"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:44:11.147106 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.146775    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8c90b783-8b32-49de-ba05-d3b517823841-alertmanager-main-db\") pod \"8c90b783-8b32-49de-ba05-d3b517823841\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") "
Jun 03 01:44:11.147106 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.146828    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-secret-alertmanager-kube-rbac-proxy-web\") pod \"8c90b783-8b32-49de-ba05-d3b517823841\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") "
Jun 03 01:44:11.147106 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.146876    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-secret-alertmanager-main-tls\") pod \"8c90b783-8b32-49de-ba05-d3b517823841\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") "
Jun 03 01:44:11.147106 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.146904    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c90b783-8b32-49de-ba05-d3b517823841-metrics-client-ca\") pod \"8c90b783-8b32-49de-ba05-d3b517823841\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") "
Jun 03 01:44:11.147106 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.146929    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c90b783-8b32-49de-ba05-d3b517823841-alertmanager-trusted-ca-bundle\") pod \"8c90b783-8b32-49de-ba05-d3b517823841\" (UID: \"8c90b783-8b32-49de-ba05-d3b517823841\") "
Jun 03 01:44:11.147856 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.147788    2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c90b783-8b32-49de-ba05-d3b517823841-tls-assets\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:44:11.148686 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.148246    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c90b783-8b32-49de-ba05-d3b517823841-kube-api-access-9gfvd" (OuterVolumeSpecName: "kube-api-access-9gfvd") pod "8c90b783-8b32-49de-ba05-d3b517823841" (UID: "8c90b783-8b32-49de-ba05-d3b517823841"). InnerVolumeSpecName "kube-api-access-9gfvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:44:11.148686 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.148315    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c90b783-8b32-49de-ba05-d3b517823841-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8c90b783-8b32-49de-ba05-d3b517823841" (UID: "8c90b783-8b32-49de-ba05-d3b517823841"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 01:44:11.148686 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.148382    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8c90b783-8b32-49de-ba05-d3b517823841" (UID: "8c90b783-8b32-49de-ba05-d3b517823841"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 01:44:11.148892 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.148701    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c90b783-8b32-49de-ba05-d3b517823841-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8c90b783-8b32-49de-ba05-d3b517823841" (UID: "8c90b783-8b32-49de-ba05-d3b517823841"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 01:44:11.149061 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.148998    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c90b783-8b32-49de-ba05-d3b517823841-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8c90b783-8b32-49de-ba05-d3b517823841" (UID: "8c90b783-8b32-49de-ba05-d3b517823841"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 01:44:11.151434 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.151405    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c90b783-8b32-49de-ba05-d3b517823841-config-out" (OuterVolumeSpecName: "config-out") pod "8c90b783-8b32-49de-ba05-d3b517823841" (UID: "8c90b783-8b32-49de-ba05-d3b517823841"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 01:44:11.152259 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.152199    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8c90b783-8b32-49de-ba05-d3b517823841" (UID: "8c90b783-8b32-49de-ba05-d3b517823841"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 01:44:11.152429 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.152399    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-config-volume" (OuterVolumeSpecName: "config-volume") pod "8c90b783-8b32-49de-ba05-d3b517823841" (UID: "8c90b783-8b32-49de-ba05-d3b517823841"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 01:44:11.152792 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.152768    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8c90b783-8b32-49de-ba05-d3b517823841" (UID: "8c90b783-8b32-49de-ba05-d3b517823841"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 01:44:11.153467 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.153322    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8c90b783-8b32-49de-ba05-d3b517823841" (UID: "8c90b783-8b32-49de-ba05-d3b517823841"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 01:44:11.154143 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.154118    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8c90b783-8b32-49de-ba05-d3b517823841" (UID: "8c90b783-8b32-49de-ba05-d3b517823841"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 01:44:11.161934 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.161897    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-web-config" (OuterVolumeSpecName: "web-config") pod "8c90b783-8b32-49de-ba05-d3b517823841" (UID: "8c90b783-8b32-49de-ba05-d3b517823841"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 01:44:11.249149 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.249105    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:44:11.249149 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.249143    2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-config-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:44:11.249149 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.249154    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:44:11.249385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.249166    2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-web-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:44:11.249385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.249177    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gfvd\" (UniqueName: \"kubernetes.io/projected/8c90b783-8b32-49de-ba05-d3b517823841-kube-api-access-9gfvd\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:44:11.249385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.249186    2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-cluster-tls-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:44:11.249385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.249194    2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8c90b783-8b32-49de-ba05-d3b517823841-alertmanager-main-db\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:44:11.249385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.249204    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:44:11.249385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.249213    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8c90b783-8b32-49de-ba05-d3b517823841-secret-alertmanager-main-tls\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:44:11.249385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.249221    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c90b783-8b32-49de-ba05-d3b517823841-metrics-client-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:44:11.249385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.249230    2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c90b783-8b32-49de-ba05-d3b517823841-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:44:11.249385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.249238    2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c90b783-8b32-49de-ba05-d3b517823841-config-out\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:44:11.886633 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.886572    2577 generic.go:358] "Generic (PLEG): container finished" podID="8c90b783-8b32-49de-ba05-d3b517823841" containerID="fba0d4e1ed51051e2ce0701e27678f108ae77098486517a9e4fee7d27680ecaa" exitCode=0
Jun 03 01:44:11.887034 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.886624    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c90b783-8b32-49de-ba05-d3b517823841","Type":"ContainerDied","Data":"fba0d4e1ed51051e2ce0701e27678f108ae77098486517a9e4fee7d27680ecaa"}
Jun 03 01:44:11.887034 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.886673    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c90b783-8b32-49de-ba05-d3b517823841","Type":"ContainerDied","Data":"8d27f8af55f611b83fa2945c214fc7173e0999b84ffec9f4067050982a52c26a"}
Jun 03 01:44:11.887034 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.886692    2577 scope.go:117] "RemoveContainer" containerID="bcf196fc744b5f61d1994f42cc8d0314b7928dd93e7551c9564806e7093e7d22"
Jun 03 01:44:11.887034 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.886741    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:11.894118 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.894098    2577 scope.go:117] "RemoveContainer" containerID="fba0d4e1ed51051e2ce0701e27678f108ae77098486517a9e4fee7d27680ecaa"
Jun 03 01:44:11.901114 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.901095    2577 scope.go:117] "RemoveContainer" containerID="615876b66e40071597b8648093f052b4d26568f40ced1ae952a4c8b4701ddfe6"
Jun 03 01:44:11.907564 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.907543    2577 scope.go:117] "RemoveContainer" containerID="6cae71040d56a3e37efeb6a6b59a76b5624e2e02500a90df9ba9187b39f4d7b1"
Jun 03 01:44:11.910205 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.910179    2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 01:44:11.914504 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.914463    2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 01:44:11.915827 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.915804    2577 scope.go:117] "RemoveContainer" containerID="7f279c30cb7e7a8cbf0a1f114912e71bda0d7b0b226f581cae36031e8737a841"
Jun 03 01:44:11.924777 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.924755    2577 scope.go:117] "RemoveContainer" containerID="4028b58cdc57b3bef470b16b5f59af2c70e6b67f095eebe7ea11d2c174b2ca76"
Jun 03 01:44:11.931929 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.931909    2577 scope.go:117] "RemoveContainer" containerID="aba45f3f34e145ca04bbf34629860e9c52aeddcf0ce837e70ec1cd6385723019"
Jun 03 01:44:11.936192 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.936164    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 01:44:11.936538 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.936519    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="kube-rbac-proxy-web"
Jun 03 01:44:11.936637 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.936541    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="kube-rbac-proxy-web"
Jun 03 01:44:11.936637 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.936553    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="config-reloader"
Jun 03 01:44:11.936637 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.936561    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="config-reloader"
Jun 03 01:44:11.936637 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.936574    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="kube-rbac-proxy-metric"
Jun 03 01:44:11.936637 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.936597    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="kube-rbac-proxy-metric"
Jun 03 01:44:11.936637 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.936615    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="prom-label-proxy"
Jun 03 01:44:11.936637 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.936634    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="prom-label-proxy"
Jun 03 01:44:11.936637 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.936645    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="kube-rbac-proxy"
Jun 03 01:44:11.937035 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.936654    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="kube-rbac-proxy"
Jun 03 01:44:11.937035 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.936668    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="alertmanager"
Jun 03 01:44:11.937035 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.936677    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="alertmanager"
Jun 03 01:44:11.937035 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.936692    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="init-config-reloader"
Jun 03 01:44:11.937035 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.936701    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="init-config-reloader"
Jun 03 01:44:11.937035 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.936713    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d77d9c3-58e2-4af3-b439-788f88a65bf1" containerName="console"
Jun 03 01:44:11.937035 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.936721    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d77d9c3-58e2-4af3-b439-788f88a65bf1" containerName="console"
Jun 03 01:44:11.937035 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.936800    2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d77d9c3-58e2-4af3-b439-788f88a65bf1" containerName="console"
Jun 03 01:44:11.937035 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.936813    2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="config-reloader"
Jun 03 01:44:11.937035 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.936823    2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="kube-rbac-proxy"
Jun 03 01:44:11.937035 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.936833    2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="alertmanager"
Jun 03 01:44:11.937035 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.936842    2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="prom-label-proxy"
Jun 03 01:44:11.937035 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.936852    2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="kube-rbac-proxy-metric"
Jun 03 01:44:11.937035 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.936863    2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c90b783-8b32-49de-ba05-d3b517823841" containerName="kube-rbac-proxy-web"
Jun 03 01:44:11.940440 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.940421    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:11.940516 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.940443    2577 scope.go:117] "RemoveContainer" containerID="bcf196fc744b5f61d1994f42cc8d0314b7928dd93e7551c9564806e7093e7d22"
Jun 03 01:44:11.940828 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:44:11.940799    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcf196fc744b5f61d1994f42cc8d0314b7928dd93e7551c9564806e7093e7d22\": container with ID starting with bcf196fc744b5f61d1994f42cc8d0314b7928dd93e7551c9564806e7093e7d22 not found: ID does not exist" containerID="bcf196fc744b5f61d1994f42cc8d0314b7928dd93e7551c9564806e7093e7d22"
Jun 03 01:44:11.940913 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.940838    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcf196fc744b5f61d1994f42cc8d0314b7928dd93e7551c9564806e7093e7d22"} err="failed to get container status \"bcf196fc744b5f61d1994f42cc8d0314b7928dd93e7551c9564806e7093e7d22\": rpc error: code = NotFound desc = could not find container \"bcf196fc744b5f61d1994f42cc8d0314b7928dd93e7551c9564806e7093e7d22\": container with ID starting with bcf196fc744b5f61d1994f42cc8d0314b7928dd93e7551c9564806e7093e7d22 not found: ID does not exist"
Jun 03 01:44:11.940913 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.940866    2577 scope.go:117] "RemoveContainer" containerID="fba0d4e1ed51051e2ce0701e27678f108ae77098486517a9e4fee7d27680ecaa"
Jun 03 01:44:11.941124 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:44:11.941103    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fba0d4e1ed51051e2ce0701e27678f108ae77098486517a9e4fee7d27680ecaa\": container with ID starting with fba0d4e1ed51051e2ce0701e27678f108ae77098486517a9e4fee7d27680ecaa not found: ID does not exist" containerID="fba0d4e1ed51051e2ce0701e27678f108ae77098486517a9e4fee7d27680ecaa"
Jun 03 01:44:11.941172 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.941127    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fba0d4e1ed51051e2ce0701e27678f108ae77098486517a9e4fee7d27680ecaa"} err="failed to get container status \"fba0d4e1ed51051e2ce0701e27678f108ae77098486517a9e4fee7d27680ecaa\": rpc error: code = NotFound desc = could not find container \"fba0d4e1ed51051e2ce0701e27678f108ae77098486517a9e4fee7d27680ecaa\": container with ID starting with fba0d4e1ed51051e2ce0701e27678f108ae77098486517a9e4fee7d27680ecaa not found: ID does not exist"
Jun 03 01:44:11.941172 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.941148    2577 scope.go:117] "RemoveContainer" containerID="615876b66e40071597b8648093f052b4d26568f40ced1ae952a4c8b4701ddfe6"
Jun 03 01:44:11.941346 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:44:11.941331    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"615876b66e40071597b8648093f052b4d26568f40ced1ae952a4c8b4701ddfe6\": container with ID starting with 615876b66e40071597b8648093f052b4d26568f40ced1ae952a4c8b4701ddfe6 not found: ID does not exist" containerID="615876b66e40071597b8648093f052b4d26568f40ced1ae952a4c8b4701ddfe6"
Jun 03 01:44:11.941387 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.941349    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"615876b66e40071597b8648093f052b4d26568f40ced1ae952a4c8b4701ddfe6"} err="failed to get container status \"615876b66e40071597b8648093f052b4d26568f40ced1ae952a4c8b4701ddfe6\": rpc error: code = NotFound desc = could not find container \"615876b66e40071597b8648093f052b4d26568f40ced1ae952a4c8b4701ddfe6\": container with ID starting with 615876b66e40071597b8648093f052b4d26568f40ced1ae952a4c8b4701ddfe6 not found: ID does not exist"
Jun 03 01:44:11.941387 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.941362    2577 scope.go:117] "RemoveContainer" containerID="6cae71040d56a3e37efeb6a6b59a76b5624e2e02500a90df9ba9187b39f4d7b1"
Jun 03 01:44:11.941593 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:44:11.941563    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cae71040d56a3e37efeb6a6b59a76b5624e2e02500a90df9ba9187b39f4d7b1\": container with ID starting with 6cae71040d56a3e37efeb6a6b59a76b5624e2e02500a90df9ba9187b39f4d7b1 not found: ID does not exist" containerID="6cae71040d56a3e37efeb6a6b59a76b5624e2e02500a90df9ba9187b39f4d7b1"
Jun 03 01:44:11.941642 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.941600    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cae71040d56a3e37efeb6a6b59a76b5624e2e02500a90df9ba9187b39f4d7b1"} err="failed to get container status \"6cae71040d56a3e37efeb6a6b59a76b5624e2e02500a90df9ba9187b39f4d7b1\": rpc error: code = NotFound desc = could not find container \"6cae71040d56a3e37efeb6a6b59a76b5624e2e02500a90df9ba9187b39f4d7b1\": container with ID starting with 6cae71040d56a3e37efeb6a6b59a76b5624e2e02500a90df9ba9187b39f4d7b1 not found: ID does not exist"
Jun 03 01:44:11.941642 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.941614    2577 scope.go:117] "RemoveContainer" containerID="7f279c30cb7e7a8cbf0a1f114912e71bda0d7b0b226f581cae36031e8737a841"
Jun 03 01:44:11.941908 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:44:11.941891    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f279c30cb7e7a8cbf0a1f114912e71bda0d7b0b226f581cae36031e8737a841\": container with ID starting with 7f279c30cb7e7a8cbf0a1f114912e71bda0d7b0b226f581cae36031e8737a841 not found: ID does not exist" containerID="7f279c30cb7e7a8cbf0a1f114912e71bda0d7b0b226f581cae36031e8737a841"
Jun 03 01:44:11.941948 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.941912    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f279c30cb7e7a8cbf0a1f114912e71bda0d7b0b226f581cae36031e8737a841"} err="failed to get container status \"7f279c30cb7e7a8cbf0a1f114912e71bda0d7b0b226f581cae36031e8737a841\": rpc error: code = NotFound desc = could not find container \"7f279c30cb7e7a8cbf0a1f114912e71bda0d7b0b226f581cae36031e8737a841\": container with ID starting with 7f279c30cb7e7a8cbf0a1f114912e71bda0d7b0b226f581cae36031e8737a841 not found: ID does not exist"
Jun 03 01:44:11.941948 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.941927    2577 scope.go:117] "RemoveContainer" containerID="4028b58cdc57b3bef470b16b5f59af2c70e6b67f095eebe7ea11d2c174b2ca76"
Jun 03 01:44:11.942176 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:44:11.942157    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4028b58cdc57b3bef470b16b5f59af2c70e6b67f095eebe7ea11d2c174b2ca76\": container with ID starting with 4028b58cdc57b3bef470b16b5f59af2c70e6b67f095eebe7ea11d2c174b2ca76 not found: ID does not exist" containerID="4028b58cdc57b3bef470b16b5f59af2c70e6b67f095eebe7ea11d2c174b2ca76"
Jun 03 01:44:11.942243 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.942184    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4028b58cdc57b3bef470b16b5f59af2c70e6b67f095eebe7ea11d2c174b2ca76"} err="failed to get container status \"4028b58cdc57b3bef470b16b5f59af2c70e6b67f095eebe7ea11d2c174b2ca76\": rpc error: code = NotFound desc = could not find container \"4028b58cdc57b3bef470b16b5f59af2c70e6b67f095eebe7ea11d2c174b2ca76\": container with ID starting with 4028b58cdc57b3bef470b16b5f59af2c70e6b67f095eebe7ea11d2c174b2ca76 not found: ID does not exist"
Jun 03 01:44:11.942243 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.942205    2577 scope.go:117] "RemoveContainer" containerID="aba45f3f34e145ca04bbf34629860e9c52aeddcf0ce837e70ec1cd6385723019"
Jun 03 01:44:11.942431 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:44:11.942415    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aba45f3f34e145ca04bbf34629860e9c52aeddcf0ce837e70ec1cd6385723019\": container with ID starting with aba45f3f34e145ca04bbf34629860e9c52aeddcf0ce837e70ec1cd6385723019 not found: ID does not exist" containerID="aba45f3f34e145ca04bbf34629860e9c52aeddcf0ce837e70ec1cd6385723019"
Jun 03 01:44:11.942472 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.942435    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aba45f3f34e145ca04bbf34629860e9c52aeddcf0ce837e70ec1cd6385723019"} err="failed to get container status \"aba45f3f34e145ca04bbf34629860e9c52aeddcf0ce837e70ec1cd6385723019\": rpc error: code = NotFound desc = could not find container \"aba45f3f34e145ca04bbf34629860e9c52aeddcf0ce837e70ec1cd6385723019\": container with ID starting with aba45f3f34e145ca04bbf34629860e9c52aeddcf0ce837e70ec1cd6385723019 not found: ID does not exist"
Jun 03 01:44:11.942914 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.942891    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 03 01:44:11.943005 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.942907    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 03 01:44:11.943068 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.943021    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 03 01:44:11.943068 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.943060    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 03 01:44:11.943169 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.943087    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5r522\""
Jun 03 01:44:11.943169 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.943103    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 03 01:44:11.943169 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.943060    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 03 01:44:11.943169 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.943160    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 03 01:44:11.943706 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.943356    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 03 01:44:11.947883 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.947861    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 03 01:44:11.951805 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.951627    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 01:44:11.954639 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.954616    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh5pm\" (UniqueName: \"kubernetes.io/projected/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-kube-api-access-sh5pm\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:11.954755 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.954650    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:11.954755 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.954710    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-config-volume\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:11.954866 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.954762    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:11.954866 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.954783    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:11.954866 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.954803    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-config-out\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:11.954866 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.954843    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:11.954866 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.954865    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:11.955096 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.954880    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:11.955096 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.954976    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:11.955096 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.955003    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-web-config\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:11.955096 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.955033    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:11.955244 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:11.955105    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.055864 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.055823    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.055864 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.055867    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-web-config\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.056156 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.055904    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.056156 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.055932    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.056156 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.055958    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sh5pm\" (UniqueName: \"kubernetes.io/projected/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-kube-api-access-sh5pm\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.056156 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.055985    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.056156 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.056012    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-config-volume\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.056156 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.056053    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.056156 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.056078    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.056156 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.056109    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-config-out\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.056156 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.056138    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.056551 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.056169    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.056551 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.056193    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.057788 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.056986    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.057788 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.057243    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.057788 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.057410    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.059143 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.059015    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.059143 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.059089    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-web-config\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.059370 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.059345    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.059455 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.059424    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.059670 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.059648    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-config-volume\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.059929 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.059908    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.060323 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.060297    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-config-out\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.060460 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.060438    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.060651 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.060633    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.063851 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.063833    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh5pm\" (UniqueName: \"kubernetes.io/projected/ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86-kube-api-access-sh5pm\") pod \"alertmanager-main-0\" (UID: \"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.255232 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.255127    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 01:44:12.394045 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.394000    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 01:44:12.396502 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:44:12.396471    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba4f7b5f_4f2a_402f_8e35_38ffb08fbe86.slice/crio-a6add718c4812088307928880e00bc388710351a86bbed4a5c9b73d34a07cccc WatchSource:0}: Error finding container a6add718c4812088307928880e00bc388710351a86bbed4a5c9b73d34a07cccc: Status 404 returned error can't find the container with id a6add718c4812088307928880e00bc388710351a86bbed4a5c9b73d34a07cccc
Jun 03 01:44:12.891992 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.891957    2577 generic.go:358] "Generic (PLEG): container finished" podID="ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86" containerID="8c1c482dd347cf250bf4960dea15b9d11c6630f1a991fe1381d7022084e567e0" exitCode=0
Jun 03 01:44:12.892427 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.892003    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86","Type":"ContainerDied","Data":"8c1c482dd347cf250bf4960dea15b9d11c6630f1a991fe1381d7022084e567e0"}
Jun 03 01:44:12.892427 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:12.892026    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86","Type":"ContainerStarted","Data":"a6add718c4812088307928880e00bc388710351a86bbed4a5c9b73d34a07cccc"}
Jun 03 01:44:13.078787 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:13.078752    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c90b783-8b32-49de-ba05-d3b517823841" path="/var/lib/kubelet/pods/8c90b783-8b32-49de-ba05-d3b517823841/volumes"
Jun 03 01:44:13.898098 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:13.898064    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86","Type":"ContainerStarted","Data":"b68ece271c5646b64ae3e23342126211d19e35f6cc503476f52c1fe5146c62f3"}
Jun 03 01:44:13.898098 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:13.898099    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86","Type":"ContainerStarted","Data":"536694f28f7601a935cd030e84e37a64a048a17cc9c3a0f6168215fd81993ca0"}
Jun 03 01:44:13.898098 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:13.898108    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86","Type":"ContainerStarted","Data":"1a58db966bdf54d08033ad191b8209c24cb2df96b2f9d67f9c08b11e01ec2361"}
Jun 03 01:44:13.898546 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:13.898117    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86","Type":"ContainerStarted","Data":"3a83d875eac1a5d0922b432e53758328edb9da4ced380f77cf7d33a3936874c5"}
Jun 03 01:44:13.898546 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:13.898125    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86","Type":"ContainerStarted","Data":"3c036bd908e65ad30d8c8533e783ca3dae8bf17726c97e98850cb5f25664b82e"}
Jun 03 01:44:13.898546 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:13.898133    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86","Type":"ContainerStarted","Data":"275245ae890986146e4baf401c4592e268644ba11f6da714730caffb6c5a8c6d"}
Jun 03 01:44:13.923469 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:13.923420    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.9234039000000003 podStartE2EDuration="2.9234039s" podCreationTimestamp="2026-06-03 01:44:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:44:13.921775734 +0000 UTC m=+223.486171544" watchObservedRunningTime="2026-06-03 01:44:13.9234039 +0000 UTC m=+223.487799710"
Jun 03 01:44:31.991138 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:31.991104    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-94f69bbc4-sk8p2"]
Jun 03 01:44:31.993873 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:31.993853    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:32.005745 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.005718    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-94f69bbc4-sk8p2"]
Jun 03 01:44:32.126129 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.126088    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tphz6\" (UniqueName: \"kubernetes.io/projected/baa381b8-9b05-4db2-a167-8970680d3751-kube-api-access-tphz6\") pod \"console-94f69bbc4-sk8p2\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") " pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:32.126304 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.126137    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/baa381b8-9b05-4db2-a167-8970680d3751-service-ca\") pod \"console-94f69bbc4-sk8p2\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") " pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:32.126304 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.126160    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/baa381b8-9b05-4db2-a167-8970680d3751-console-config\") pod \"console-94f69bbc4-sk8p2\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") " pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:32.126304 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.126223    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baa381b8-9b05-4db2-a167-8970680d3751-trusted-ca-bundle\") pod \"console-94f69bbc4-sk8p2\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") " pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:32.126304 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.126265    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/baa381b8-9b05-4db2-a167-8970680d3751-oauth-serving-cert\") pod \"console-94f69bbc4-sk8p2\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") " pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:32.126304 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.126300    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/baa381b8-9b05-4db2-a167-8970680d3751-console-serving-cert\") pod \"console-94f69bbc4-sk8p2\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") " pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:32.126527 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.126370    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/baa381b8-9b05-4db2-a167-8970680d3751-console-oauth-config\") pod \"console-94f69bbc4-sk8p2\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") " pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:32.227125 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.227089    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baa381b8-9b05-4db2-a167-8970680d3751-trusted-ca-bundle\") pod \"console-94f69bbc4-sk8p2\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") " pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:32.227125 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.227132    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/baa381b8-9b05-4db2-a167-8970680d3751-oauth-serving-cert\") pod \"console-94f69bbc4-sk8p2\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") " pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:32.227395 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.227158    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/baa381b8-9b05-4db2-a167-8970680d3751-console-serving-cert\") pod \"console-94f69bbc4-sk8p2\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") " pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:32.227395 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.227179    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/baa381b8-9b05-4db2-a167-8970680d3751-console-oauth-config\") pod \"console-94f69bbc4-sk8p2\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") " pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:32.227395 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.227212    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tphz6\" (UniqueName: \"kubernetes.io/projected/baa381b8-9b05-4db2-a167-8970680d3751-kube-api-access-tphz6\") pod \"console-94f69bbc4-sk8p2\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") " pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:32.227395 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.227235    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/baa381b8-9b05-4db2-a167-8970680d3751-service-ca\") pod \"console-94f69bbc4-sk8p2\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") " pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:32.227395 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.227253    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/baa381b8-9b05-4db2-a167-8970680d3751-console-config\") pod \"console-94f69bbc4-sk8p2\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") " pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:32.227974 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.227944    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/baa381b8-9b05-4db2-a167-8970680d3751-oauth-serving-cert\") pod \"console-94f69bbc4-sk8p2\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") " pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:32.228096 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.228076    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/baa381b8-9b05-4db2-a167-8970680d3751-console-config\") pod \"console-94f69bbc4-sk8p2\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") " pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:32.228158 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.228086    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/baa381b8-9b05-4db2-a167-8970680d3751-service-ca\") pod \"console-94f69bbc4-sk8p2\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") " pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:32.228337 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.228314    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baa381b8-9b05-4db2-a167-8970680d3751-trusted-ca-bundle\") pod \"console-94f69bbc4-sk8p2\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") " pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:32.229651 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.229629    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/baa381b8-9b05-4db2-a167-8970680d3751-console-serving-cert\") pod \"console-94f69bbc4-sk8p2\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") " pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:32.229753 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.229736    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/baa381b8-9b05-4db2-a167-8970680d3751-console-oauth-config\") pod \"console-94f69bbc4-sk8p2\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") " pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:32.234838 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.234816    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tphz6\" (UniqueName: \"kubernetes.io/projected/baa381b8-9b05-4db2-a167-8970680d3751-kube-api-access-tphz6\") pod \"console-94f69bbc4-sk8p2\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") " pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:32.302648 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.302542    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:32.429414 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.429380    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-94f69bbc4-sk8p2"]
Jun 03 01:44:32.432454 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:44:32.432420    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaa381b8_9b05_4db2_a167_8970680d3751.slice/crio-b96b6d3a86eebac888a4cd803c679d2077ee45fd9d006f5331a30131a13faedd WatchSource:0}: Error finding container b96b6d3a86eebac888a4cd803c679d2077ee45fd9d006f5331a30131a13faedd: Status 404 returned error can't find the container with id b96b6d3a86eebac888a4cd803c679d2077ee45fd9d006f5331a30131a13faedd
Jun 03 01:44:32.956427 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.956387    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-94f69bbc4-sk8p2" event={"ID":"baa381b8-9b05-4db2-a167-8970680d3751","Type":"ContainerStarted","Data":"c658e2e8b22157c9bf678204ae6a35944318c16b390cd61a42cdfccbb43359df"}
Jun 03 01:44:32.956427 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.956426    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-94f69bbc4-sk8p2" event={"ID":"baa381b8-9b05-4db2-a167-8970680d3751","Type":"ContainerStarted","Data":"b96b6d3a86eebac888a4cd803c679d2077ee45fd9d006f5331a30131a13faedd"}
Jun 03 01:44:32.972959 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:32.972905    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-94f69bbc4-sk8p2" podStartSLOduration=1.972887407 podStartE2EDuration="1.972887407s" podCreationTimestamp="2026-06-03 01:44:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:44:32.9718109 +0000 UTC m=+242.536206711" watchObservedRunningTime="2026-06-03 01:44:32.972887407 +0000 UTC m=+242.537283218"
Jun 03 01:44:42.303322 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:42.303221    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:42.303322 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:42.303289    2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:42.307990 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:42.307963    2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:42.988342 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:42.988313    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:44:43.033282 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:43.033243    2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f875f9cbd-wgvjp"]
Jun 03 01:44:44.094651 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:44.094610    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-q7jxs"]
Jun 03 01:44:44.098141 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:44.098120    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7jxs"
Jun 03 01:44:44.100857 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:44.100830    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 03 01:44:44.107339 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:44.107316    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q7jxs"]
Jun 03 01:44:44.240272 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:44.240230    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/734f349a-3318-40d6-96ea-8f6bfca3dff2-kubelet-config\") pod \"global-pull-secret-syncer-q7jxs\" (UID: \"734f349a-3318-40d6-96ea-8f6bfca3dff2\") " pod="kube-system/global-pull-secret-syncer-q7jxs"
Jun 03 01:44:44.240272 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:44.240274    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/734f349a-3318-40d6-96ea-8f6bfca3dff2-original-pull-secret\") pod \"global-pull-secret-syncer-q7jxs\" (UID: \"734f349a-3318-40d6-96ea-8f6bfca3dff2\") " pod="kube-system/global-pull-secret-syncer-q7jxs"
Jun 03 01:44:44.240510 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:44.240343    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/734f349a-3318-40d6-96ea-8f6bfca3dff2-dbus\") pod \"global-pull-secret-syncer-q7jxs\" (UID: \"734f349a-3318-40d6-96ea-8f6bfca3dff2\") " pod="kube-system/global-pull-secret-syncer-q7jxs"
Jun 03 01:44:44.341216 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:44.341181    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/734f349a-3318-40d6-96ea-8f6bfca3dff2-dbus\") pod \"global-pull-secret-syncer-q7jxs\" (UID: \"734f349a-3318-40d6-96ea-8f6bfca3dff2\") " pod="kube-system/global-pull-secret-syncer-q7jxs"
Jun 03 01:44:44.341380 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:44.341240    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/734f349a-3318-40d6-96ea-8f6bfca3dff2-kubelet-config\") pod \"global-pull-secret-syncer-q7jxs\" (UID: \"734f349a-3318-40d6-96ea-8f6bfca3dff2\") " pod="kube-system/global-pull-secret-syncer-q7jxs"
Jun 03 01:44:44.341380 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:44.341263    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/734f349a-3318-40d6-96ea-8f6bfca3dff2-original-pull-secret\") pod \"global-pull-secret-syncer-q7jxs\" (UID: \"734f349a-3318-40d6-96ea-8f6bfca3dff2\") " pod="kube-system/global-pull-secret-syncer-q7jxs"
Jun 03 01:44:44.341459 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:44.341373    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/734f349a-3318-40d6-96ea-8f6bfca3dff2-kubelet-config\") pod \"global-pull-secret-syncer-q7jxs\" (UID: \"734f349a-3318-40d6-96ea-8f6bfca3dff2\") " pod="kube-system/global-pull-secret-syncer-q7jxs"
Jun 03 01:44:44.341459 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:44.341381    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/734f349a-3318-40d6-96ea-8f6bfca3dff2-dbus\") pod \"global-pull-secret-syncer-q7jxs\" (UID: \"734f349a-3318-40d6-96ea-8f6bfca3dff2\") " pod="kube-system/global-pull-secret-syncer-q7jxs"
Jun 03 01:44:44.343505 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:44.343485    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/734f349a-3318-40d6-96ea-8f6bfca3dff2-original-pull-secret\") pod \"global-pull-secret-syncer-q7jxs\" (UID: \"734f349a-3318-40d6-96ea-8f6bfca3dff2\") " pod="kube-system/global-pull-secret-syncer-q7jxs"
Jun 03 01:44:44.407882 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:44.407829    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7jxs"
Jun 03 01:44:44.536676 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:44.536636    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q7jxs"]
Jun 03 01:44:44.539845 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:44:44.539802    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod734f349a_3318_40d6_96ea_8f6bfca3dff2.slice/crio-046c5314066ec4521a104ea876044a5d22fb31fa2a809e14536c80a361e48164 WatchSource:0}: Error finding container 046c5314066ec4521a104ea876044a5d22fb31fa2a809e14536c80a361e48164: Status 404 returned error can't find the container with id 046c5314066ec4521a104ea876044a5d22fb31fa2a809e14536c80a361e48164
Jun 03 01:44:44.990603 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:44.990545    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q7jxs" event={"ID":"734f349a-3318-40d6-96ea-8f6bfca3dff2","Type":"ContainerStarted","Data":"046c5314066ec4521a104ea876044a5d22fb31fa2a809e14536c80a361e48164"}
Jun 03 01:44:50.007171 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:50.007129    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q7jxs" event={"ID":"734f349a-3318-40d6-96ea-8f6bfca3dff2","Type":"ContainerStarted","Data":"37b5e69586676292fcf6ad00bcef7abb34d3a9735de26dcbad02185e749f10c7"}
Jun 03 01:44:50.024136 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:50.024087    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-q7jxs" podStartSLOduration=1.422211376 podStartE2EDuration="6.024069628s" podCreationTimestamp="2026-06-03 01:44:44 +0000 UTC" firstStartedPulling="2026-06-03 01:44:44.541810434 +0000 UTC m=+254.106206226" lastFinishedPulling="2026-06-03 01:44:49.143668686 +0000 UTC m=+258.708064478" observedRunningTime="2026-06-03 01:44:50.022562602 +0000 UTC m=+259.586958412" watchObservedRunningTime="2026-06-03 01:44:50.024069628 +0000 UTC m=+259.588465468"
Jun 03 01:44:58.129345 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:58.129304    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9"]
Jun 03 01:44:58.132859 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:58.132842    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9"
Jun 03 01:44:58.135247 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:58.135222    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 03 01:44:58.135438 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:58.135422    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 03 01:44:58.136241 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:58.136221    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qh4d6\""
Jun 03 01:44:58.139814 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:58.139526    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9"]
Jun 03 01:44:58.261916 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:58.261884    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/256270a2-12c1-4a2c-b187-2f259ebfaca4-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9\" (UID: \"256270a2-12c1-4a2c-b187-2f259ebfaca4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9"
Jun 03 01:44:58.261916 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:58.261927    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdrh7\" (UniqueName: \"kubernetes.io/projected/256270a2-12c1-4a2c-b187-2f259ebfaca4-kube-api-access-zdrh7\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9\" (UID: \"256270a2-12c1-4a2c-b187-2f259ebfaca4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9"
Jun 03 01:44:58.262159 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:58.262010    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/256270a2-12c1-4a2c-b187-2f259ebfaca4-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9\" (UID: \"256270a2-12c1-4a2c-b187-2f259ebfaca4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9"
Jun 03 01:44:58.362491 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:58.362458    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/256270a2-12c1-4a2c-b187-2f259ebfaca4-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9\" (UID: \"256270a2-12c1-4a2c-b187-2f259ebfaca4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9"
Jun 03 01:44:58.362491 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:58.362497    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zdrh7\" (UniqueName: \"kubernetes.io/projected/256270a2-12c1-4a2c-b187-2f259ebfaca4-kube-api-access-zdrh7\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9\" (UID: \"256270a2-12c1-4a2c-b187-2f259ebfaca4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9"
Jun 03 01:44:58.362723 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:58.362537    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/256270a2-12c1-4a2c-b187-2f259ebfaca4-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9\" (UID: \"256270a2-12c1-4a2c-b187-2f259ebfaca4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9"
Jun 03 01:44:58.362868 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:58.362846    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/256270a2-12c1-4a2c-b187-2f259ebfaca4-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9\" (UID: \"256270a2-12c1-4a2c-b187-2f259ebfaca4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9"
Jun 03 01:44:58.362905 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:58.362872    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/256270a2-12c1-4a2c-b187-2f259ebfaca4-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9\" (UID: \"256270a2-12c1-4a2c-b187-2f259ebfaca4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9"
Jun 03 01:44:58.370246 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:58.370223    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdrh7\" (UniqueName: \"kubernetes.io/projected/256270a2-12c1-4a2c-b187-2f259ebfaca4-kube-api-access-zdrh7\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9\" (UID: \"256270a2-12c1-4a2c-b187-2f259ebfaca4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9"
Jun 03 01:44:58.442431 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:58.442346    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9"
Jun 03 01:44:58.573755 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:58.573717    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9"]
Jun 03 01:44:58.576812 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:44:58.576779    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod256270a2_12c1_4a2c_b187_2f259ebfaca4.slice/crio-91f02e28bc5989b6c51fabc4f714ce4a27c33e9e190406bd786e35cf1c00cdbf WatchSource:0}: Error finding container 91f02e28bc5989b6c51fabc4f714ce4a27c33e9e190406bd786e35cf1c00cdbf: Status 404 returned error can't find the container with id 91f02e28bc5989b6c51fabc4f714ce4a27c33e9e190406bd786e35cf1c00cdbf
Jun 03 01:44:59.036369 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:44:59.036323    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9" event={"ID":"256270a2-12c1-4a2c-b187-2f259ebfaca4","Type":"ContainerStarted","Data":"91f02e28bc5989b6c51fabc4f714ce4a27c33e9e190406bd786e35cf1c00cdbf"}
Jun 03 01:45:05.060289 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:05.060251    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9" event={"ID":"256270a2-12c1-4a2c-b187-2f259ebfaca4","Type":"ContainerStarted","Data":"31f5ee058cbede93eefd2f14849e58f319559f5a9f44b5e7d342503efc4fc9aa"}
Jun 03 01:45:06.063971 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:06.063930    2577 generic.go:358] "Generic (PLEG): container finished" podID="256270a2-12c1-4a2c-b187-2f259ebfaca4" containerID="31f5ee058cbede93eefd2f14849e58f319559f5a9f44b5e7d342503efc4fc9aa" exitCode=0
Jun 03 01:45:06.064451 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:06.064005    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9" event={"ID":"256270a2-12c1-4a2c-b187-2f259ebfaca4","Type":"ContainerDied","Data":"31f5ee058cbede93eefd2f14849e58f319559f5a9f44b5e7d342503efc4fc9aa"}
Jun 03 01:45:08.059054 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:08.058995    2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6f875f9cbd-wgvjp" podUID="0f0dde36-65ca-48df-95cc-809fa55dad5e" containerName="console" containerID="cri-o://31dccb0422fe12531598a65f0b5e8135deef5c8dccb778f50b8944f207eb65f1" gracePeriod=15
Jun 03 01:45:08.306550 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:08.306516    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6f875f9cbd-wgvjp_0f0dde36-65ca-48df-95cc-809fa55dad5e/console/0.log"
Jun 03 01:45:08.306710 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:08.306603    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:45:08.348858 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:08.348824    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f0dde36-65ca-48df-95cc-809fa55dad5e-service-ca\") pod \"0f0dde36-65ca-48df-95cc-809fa55dad5e\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") "
Jun 03 01:45:08.349037 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:08.348877    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdbsm\" (UniqueName: \"kubernetes.io/projected/0f0dde36-65ca-48df-95cc-809fa55dad5e-kube-api-access-bdbsm\") pod \"0f0dde36-65ca-48df-95cc-809fa55dad5e\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") "
Jun 03 01:45:08.349037 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:08.348918    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f0dde36-65ca-48df-95cc-809fa55dad5e-oauth-serving-cert\") pod \"0f0dde36-65ca-48df-95cc-809fa55dad5e\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") "
Jun 03 01:45:08.349037 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:08.348968    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f0dde36-65ca-48df-95cc-809fa55dad5e-console-serving-cert\") pod \"0f0dde36-65ca-48df-95cc-809fa55dad5e\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") "
Jun 03 01:45:08.349037 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:08.348997    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f0dde36-65ca-48df-95cc-809fa55dad5e-console-oauth-config\") pod \"0f0dde36-65ca-48df-95cc-809fa55dad5e\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") "
Jun 03 01:45:08.349037 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:08.349020    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f0dde36-65ca-48df-95cc-809fa55dad5e-trusted-ca-bundle\") pod \"0f0dde36-65ca-48df-95cc-809fa55dad5e\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") "
Jun 03 01:45:08.349321 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:08.349071    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f0dde36-65ca-48df-95cc-809fa55dad5e-console-config\") pod \"0f0dde36-65ca-48df-95cc-809fa55dad5e\" (UID: \"0f0dde36-65ca-48df-95cc-809fa55dad5e\") "
Jun 03 01:45:08.349377 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:08.349321    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f0dde36-65ca-48df-95cc-809fa55dad5e-service-ca" (OuterVolumeSpecName: "service-ca") pod "0f0dde36-65ca-48df-95cc-809fa55dad5e" (UID: "0f0dde36-65ca-48df-95cc-809fa55dad5e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 01:45:08.349510 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:08.349483    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f0dde36-65ca-48df-95cc-809fa55dad5e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0f0dde36-65ca-48df-95cc-809fa55dad5e" (UID: "0f0dde36-65ca-48df-95cc-809fa55dad5e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 01:45:08.349620 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:08.349568    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f0dde36-65ca-48df-95cc-809fa55dad5e-console-config" (OuterVolumeSpecName: "console-config") pod "0f0dde36-65ca-48df-95cc-809fa55dad5e" (UID: "0f0dde36-65ca-48df-95cc-809fa55dad5e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 01:45:08.349748 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:08.349633    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f0dde36-65ca-48df-95cc-809fa55dad5e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0f0dde36-65ca-48df-95cc-809fa55dad5e" (UID: "0f0dde36-65ca-48df-95cc-809fa55dad5e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 01:45:08.351171 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:08.351134    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f0dde36-65ca-48df-95cc-809fa55dad5e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0f0dde36-65ca-48df-95cc-809fa55dad5e" (UID: "0f0dde36-65ca-48df-95cc-809fa55dad5e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 01:45:08.351270 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:08.351174    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f0dde36-65ca-48df-95cc-809fa55dad5e-kube-api-access-bdbsm" (OuterVolumeSpecName: "kube-api-access-bdbsm") pod "0f0dde36-65ca-48df-95cc-809fa55dad5e" (UID: "0f0dde36-65ca-48df-95cc-809fa55dad5e"). InnerVolumeSpecName "kube-api-access-bdbsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:45:08.351270 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:08.351190    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f0dde36-65ca-48df-95cc-809fa55dad5e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0f0dde36-65ca-48df-95cc-809fa55dad5e" (UID: "0f0dde36-65ca-48df-95cc-809fa55dad5e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 01:45:08.449995 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:08.449943    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f0dde36-65ca-48df-95cc-809fa55dad5e-console-serving-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:45:08.449995 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:08.449991    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f0dde36-65ca-48df-95cc-809fa55dad5e-console-oauth-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:45:08.449995 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:08.450003    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f0dde36-65ca-48df-95cc-809fa55dad5e-trusted-ca-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:45:08.449995 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:08.450013    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f0dde36-65ca-48df-95cc-809fa55dad5e-console-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:45:08.450258 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:08.450023    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f0dde36-65ca-48df-95cc-809fa55dad5e-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:45:08.450258 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:08.450032    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdbsm\" (UniqueName: \"kubernetes.io/projected/0f0dde36-65ca-48df-95cc-809fa55dad5e-kube-api-access-bdbsm\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:45:08.450258 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:08.450042    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f0dde36-65ca-48df-95cc-809fa55dad5e-oauth-serving-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:45:09.074691 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:09.074666    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6f875f9cbd-wgvjp_0f0dde36-65ca-48df-95cc-809fa55dad5e/console/0.log"
Jun 03 01:45:09.075085 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:09.074706    2577 generic.go:358] "Generic (PLEG): container finished" podID="0f0dde36-65ca-48df-95cc-809fa55dad5e" containerID="31dccb0422fe12531598a65f0b5e8135deef5c8dccb778f50b8944f207eb65f1" exitCode=2
Jun 03 01:45:09.075085 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:09.074857    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f875f9cbd-wgvjp"
Jun 03 01:45:09.076362 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:09.076329    2577 generic.go:358] "Generic (PLEG): container finished" podID="256270a2-12c1-4a2c-b187-2f259ebfaca4" containerID="aa3f311ba126c5cb2da28b57c98feaf1d975372144629f75948be5c0e6227d59" exitCode=0
Jun 03 01:45:09.078624 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:09.078597    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f875f9cbd-wgvjp" event={"ID":"0f0dde36-65ca-48df-95cc-809fa55dad5e","Type":"ContainerDied","Data":"31dccb0422fe12531598a65f0b5e8135deef5c8dccb778f50b8944f207eb65f1"}
Jun 03 01:45:09.078732 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:09.078635    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f875f9cbd-wgvjp" event={"ID":"0f0dde36-65ca-48df-95cc-809fa55dad5e","Type":"ContainerDied","Data":"e00fa000b0032cd5f3f60a879544a519d9c0e0ec298f3ab5de6c6cbad75e89d3"}
Jun 03 01:45:09.078732 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:09.078646    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9" event={"ID":"256270a2-12c1-4a2c-b187-2f259ebfaca4","Type":"ContainerDied","Data":"aa3f311ba126c5cb2da28b57c98feaf1d975372144629f75948be5c0e6227d59"}
Jun 03 01:45:09.078732 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:09.078665    2577 scope.go:117] "RemoveContainer" containerID="31dccb0422fe12531598a65f0b5e8135deef5c8dccb778f50b8944f207eb65f1"
Jun 03 01:45:09.087986 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:09.087962    2577 scope.go:117] "RemoveContainer" containerID="31dccb0422fe12531598a65f0b5e8135deef5c8dccb778f50b8944f207eb65f1"
Jun 03 01:45:09.088232 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:45:09.088211    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31dccb0422fe12531598a65f0b5e8135deef5c8dccb778f50b8944f207eb65f1\": container with ID starting with 31dccb0422fe12531598a65f0b5e8135deef5c8dccb778f50b8944f207eb65f1 not found: ID does not exist" containerID="31dccb0422fe12531598a65f0b5e8135deef5c8dccb778f50b8944f207eb65f1"
Jun 03 01:45:09.088301 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:09.088245    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31dccb0422fe12531598a65f0b5e8135deef5c8dccb778f50b8944f207eb65f1"} err="failed to get container status \"31dccb0422fe12531598a65f0b5e8135deef5c8dccb778f50b8944f207eb65f1\": rpc error: code = NotFound desc = could not find container \"31dccb0422fe12531598a65f0b5e8135deef5c8dccb778f50b8944f207eb65f1\": container with ID starting with 31dccb0422fe12531598a65f0b5e8135deef5c8dccb778f50b8944f207eb65f1 not found: ID does not exist"
Jun 03 01:45:09.107240 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:09.107201    2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f875f9cbd-wgvjp"]
Jun 03 01:45:09.109825 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:09.109799    2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f875f9cbd-wgvjp"]
Jun 03 01:45:11.079390 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:11.079353    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f0dde36-65ca-48df-95cc-809fa55dad5e" path="/var/lib/kubelet/pods/0f0dde36-65ca-48df-95cc-809fa55dad5e/volumes"
Jun 03 01:45:17.101699 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:17.101656    2577 generic.go:358] "Generic (PLEG): container finished" podID="256270a2-12c1-4a2c-b187-2f259ebfaca4" containerID="a987adc08b770bbe7ad6b0171793feef1c16b2999541256712b2b57a71af35a9" exitCode=0
Jun 03 01:45:17.102105 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:17.101699    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9" event={"ID":"256270a2-12c1-4a2c-b187-2f259ebfaca4","Type":"ContainerDied","Data":"a987adc08b770bbe7ad6b0171793feef1c16b2999541256712b2b57a71af35a9"}
Jun 03 01:45:18.227730 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:18.227704    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9"
Jun 03 01:45:18.334672 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:18.334635    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/256270a2-12c1-4a2c-b187-2f259ebfaca4-bundle\") pod \"256270a2-12c1-4a2c-b187-2f259ebfaca4\" (UID: \"256270a2-12c1-4a2c-b187-2f259ebfaca4\") "
Jun 03 01:45:18.334843 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:18.334683    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/256270a2-12c1-4a2c-b187-2f259ebfaca4-util\") pod \"256270a2-12c1-4a2c-b187-2f259ebfaca4\" (UID: \"256270a2-12c1-4a2c-b187-2f259ebfaca4\") "
Jun 03 01:45:18.334843 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:18.334705    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdrh7\" (UniqueName: \"kubernetes.io/projected/256270a2-12c1-4a2c-b187-2f259ebfaca4-kube-api-access-zdrh7\") pod \"256270a2-12c1-4a2c-b187-2f259ebfaca4\" (UID: \"256270a2-12c1-4a2c-b187-2f259ebfaca4\") "
Jun 03 01:45:18.335424 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:18.335394    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/256270a2-12c1-4a2c-b187-2f259ebfaca4-bundle" (OuterVolumeSpecName: "bundle") pod "256270a2-12c1-4a2c-b187-2f259ebfaca4" (UID: "256270a2-12c1-4a2c-b187-2f259ebfaca4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 01:45:18.336963 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:18.336936    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/256270a2-12c1-4a2c-b187-2f259ebfaca4-kube-api-access-zdrh7" (OuterVolumeSpecName: "kube-api-access-zdrh7") pod "256270a2-12c1-4a2c-b187-2f259ebfaca4" (UID: "256270a2-12c1-4a2c-b187-2f259ebfaca4"). InnerVolumeSpecName "kube-api-access-zdrh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:45:18.339048 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:18.339028    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/256270a2-12c1-4a2c-b187-2f259ebfaca4-util" (OuterVolumeSpecName: "util") pod "256270a2-12c1-4a2c-b187-2f259ebfaca4" (UID: "256270a2-12c1-4a2c-b187-2f259ebfaca4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 01:45:18.435357 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:18.435321    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/256270a2-12c1-4a2c-b187-2f259ebfaca4-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:45:18.435357 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:18.435354    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/256270a2-12c1-4a2c-b187-2f259ebfaca4-util\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:45:18.435357 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:18.435363    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdrh7\" (UniqueName: \"kubernetes.io/projected/256270a2-12c1-4a2c-b187-2f259ebfaca4-kube-api-access-zdrh7\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:45:19.109960 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:19.109923    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9" event={"ID":"256270a2-12c1-4a2c-b187-2f259ebfaca4","Type":"ContainerDied","Data":"91f02e28bc5989b6c51fabc4f714ce4a27c33e9e190406bd786e35cf1c00cdbf"}
Jun 03 01:45:19.109960 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:19.109958    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91f02e28bc5989b6c51fabc4f714ce4a27c33e9e190406bd786e35cf1c00cdbf"
Jun 03 01:45:19.110188 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:19.109992    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dt6kb9"
Jun 03 01:45:25.882324 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:25.882283    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-br7l7"]
Jun 03 01:45:25.882764 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:25.882607    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f0dde36-65ca-48df-95cc-809fa55dad5e" containerName="console"
Jun 03 01:45:25.882764 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:25.882618    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f0dde36-65ca-48df-95cc-809fa55dad5e" containerName="console"
Jun 03 01:45:25.882764 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:25.882625    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="256270a2-12c1-4a2c-b187-2f259ebfaca4" containerName="extract"
Jun 03 01:45:25.882764 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:25.882631    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="256270a2-12c1-4a2c-b187-2f259ebfaca4" containerName="extract"
Jun 03 01:45:25.882764 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:25.882639    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="256270a2-12c1-4a2c-b187-2f259ebfaca4" containerName="pull"
Jun 03 01:45:25.882764 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:25.882645    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="256270a2-12c1-4a2c-b187-2f259ebfaca4" containerName="pull"
Jun 03 01:45:25.882764 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:25.882662    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="256270a2-12c1-4a2c-b187-2f259ebfaca4" containerName="util"
Jun 03 01:45:25.882764 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:25.882667    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="256270a2-12c1-4a2c-b187-2f259ebfaca4" containerName="util"
Jun 03 01:45:25.882764 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:25.882715    2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="0f0dde36-65ca-48df-95cc-809fa55dad5e" containerName="console"
Jun 03 01:45:25.882764 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:25.882724    2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="256270a2-12c1-4a2c-b187-2f259ebfaca4" containerName="extract"
Jun 03 01:45:25.886761 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:25.886741    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-br7l7"
Jun 03 01:45:25.889443 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:25.889407    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jun 03 01:45:25.889602 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:25.889510    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-7dnb4\""
Jun 03 01:45:25.889602 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:25.889547    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jun 03 01:45:25.899431 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:25.899398    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-br7l7"]
Jun 03 01:45:25.999968 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:25.999923    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjls6\" (UniqueName: \"kubernetes.io/projected/ba629acb-5ea5-481a-b8b0-57f941e3000d-kube-api-access-qjls6\") pod \"cert-manager-operator-controller-manager-54b9655956-br7l7\" (UID: \"ba629acb-5ea5-481a-b8b0-57f941e3000d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-br7l7"
Jun 03 01:45:26.000140 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:25.999987    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba629acb-5ea5-481a-b8b0-57f941e3000d-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-br7l7\" (UID: \"ba629acb-5ea5-481a-b8b0-57f941e3000d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-br7l7"
Jun 03 01:45:26.101375 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:26.101332    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjls6\" (UniqueName: \"kubernetes.io/projected/ba629acb-5ea5-481a-b8b0-57f941e3000d-kube-api-access-qjls6\") pod \"cert-manager-operator-controller-manager-54b9655956-br7l7\" (UID: \"ba629acb-5ea5-481a-b8b0-57f941e3000d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-br7l7"
Jun 03 01:45:26.101552 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:26.101390    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba629acb-5ea5-481a-b8b0-57f941e3000d-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-br7l7\" (UID: \"ba629acb-5ea5-481a-b8b0-57f941e3000d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-br7l7"
Jun 03 01:45:26.101796 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:26.101779    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba629acb-5ea5-481a-b8b0-57f941e3000d-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-br7l7\" (UID: \"ba629acb-5ea5-481a-b8b0-57f941e3000d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-br7l7"
Jun 03 01:45:26.109062 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:26.109043    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjls6\" (UniqueName: \"kubernetes.io/projected/ba629acb-5ea5-481a-b8b0-57f941e3000d-kube-api-access-qjls6\") pod \"cert-manager-operator-controller-manager-54b9655956-br7l7\" (UID: \"ba629acb-5ea5-481a-b8b0-57f941e3000d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-br7l7"
Jun 03 01:45:26.195845 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:26.195744    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-br7l7"
Jun 03 01:45:26.327808 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:26.327778    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-br7l7"]
Jun 03 01:45:26.330915 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:45:26.330882    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba629acb_5ea5_481a_b8b0_57f941e3000d.slice/crio-bb448dc77314f894d7f0befe7a64456530f3c6381df36e5f17b828635e09a858 WatchSource:0}: Error finding container bb448dc77314f894d7f0befe7a64456530f3c6381df36e5f17b828635e09a858: Status 404 returned error can't find the container with id bb448dc77314f894d7f0befe7a64456530f3c6381df36e5f17b828635e09a858
Jun 03 01:45:27.133960 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:27.133919    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-br7l7" event={"ID":"ba629acb-5ea5-481a-b8b0-57f941e3000d","Type":"ContainerStarted","Data":"bb448dc77314f894d7f0befe7a64456530f3c6381df36e5f17b828635e09a858"}
Jun 03 01:45:28.139634 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:28.139568    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-br7l7" event={"ID":"ba629acb-5ea5-481a-b8b0-57f941e3000d","Type":"ContainerStarted","Data":"73c9818a020c81a17d2e99833034214cc73a446eb0ce7544990442e6cba1db21"}
Jun 03 01:45:28.165457 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:28.165385    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-br7l7" podStartSLOduration=1.5041694589999999 podStartE2EDuration="3.165366642s" podCreationTimestamp="2026-06-03 01:45:25 +0000 UTC" firstStartedPulling="2026-06-03 01:45:26.33322924 +0000 UTC m=+295.897625029" lastFinishedPulling="2026-06-03 01:45:27.994426421 +0000 UTC m=+297.558822212" observedRunningTime="2026-06-03 01:45:28.164261761 +0000 UTC m=+297.728657574" watchObservedRunningTime="2026-06-03 01:45:28.165366642 +0000 UTC m=+297.729762455"
Jun 03 01:45:29.370614 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:29.370565    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r"]
Jun 03 01:45:29.374044 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:29.374028    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r"
Jun 03 01:45:29.376228 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:29.376202    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 03 01:45:29.376228 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:29.376208    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qh4d6\""
Jun 03 01:45:29.376939 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:29.376922    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 03 01:45:29.381656 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:29.381627    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r"]
Jun 03 01:45:29.427466 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:29.427424    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d129a489-d7a2-46f2-8976-a218b74e2517-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r\" (UID: \"d129a489-d7a2-46f2-8976-a218b74e2517\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r"
Jun 03 01:45:29.427673 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:29.427482    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp8pq\" (UniqueName: \"kubernetes.io/projected/d129a489-d7a2-46f2-8976-a218b74e2517-kube-api-access-hp8pq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r\" (UID: \"d129a489-d7a2-46f2-8976-a218b74e2517\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r"
Jun 03 01:45:29.427673 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:29.427622    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d129a489-d7a2-46f2-8976-a218b74e2517-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r\" (UID: \"d129a489-d7a2-46f2-8976-a218b74e2517\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r"
Jun 03 01:45:29.528661 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:29.528614    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d129a489-d7a2-46f2-8976-a218b74e2517-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r\" (UID: \"d129a489-d7a2-46f2-8976-a218b74e2517\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r"
Jun 03 01:45:29.528849 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:29.528699    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hp8pq\" (UniqueName: \"kubernetes.io/projected/d129a489-d7a2-46f2-8976-a218b74e2517-kube-api-access-hp8pq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r\" (UID: \"d129a489-d7a2-46f2-8976-a218b74e2517\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r"
Jun 03 01:45:29.528849 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:29.528753    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d129a489-d7a2-46f2-8976-a218b74e2517-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r\" (UID: \"d129a489-d7a2-46f2-8976-a218b74e2517\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r"
Jun 03 01:45:29.529000 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:29.528979    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d129a489-d7a2-46f2-8976-a218b74e2517-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r\" (UID: \"d129a489-d7a2-46f2-8976-a218b74e2517\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r"
Jun 03 01:45:29.529116 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:29.529085    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d129a489-d7a2-46f2-8976-a218b74e2517-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r\" (UID: \"d129a489-d7a2-46f2-8976-a218b74e2517\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r"
Jun 03 01:45:29.536745 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:29.536719    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp8pq\" (UniqueName: \"kubernetes.io/projected/d129a489-d7a2-46f2-8976-a218b74e2517-kube-api-access-hp8pq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r\" (UID: \"d129a489-d7a2-46f2-8976-a218b74e2517\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r"
Jun 03 01:45:29.684113 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:29.684019    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r"
Jun 03 01:45:29.816655 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:29.816497    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r"]
Jun 03 01:45:29.819153 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:45:29.819123    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd129a489_d7a2_46f2_8976_a218b74e2517.slice/crio-c26796b7dfd9f326d7a99fd05f93d7614fde4bff6529912c12bafebfe2934b82 WatchSource:0}: Error finding container c26796b7dfd9f326d7a99fd05f93d7614fde4bff6529912c12bafebfe2934b82: Status 404 returned error can't find the container with id c26796b7dfd9f326d7a99fd05f93d7614fde4bff6529912c12bafebfe2934b82
Jun 03 01:45:30.148081 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:30.148045    2577 generic.go:358] "Generic (PLEG): container finished" podID="d129a489-d7a2-46f2-8976-a218b74e2517" containerID="9f523b3e10cff16a5f42f009b938860f008829dfa1aed47b0b6c0708f7ac04a3" exitCode=0
Jun 03 01:45:30.148268 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:30.148116    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r" event={"ID":"d129a489-d7a2-46f2-8976-a218b74e2517","Type":"ContainerDied","Data":"9f523b3e10cff16a5f42f009b938860f008829dfa1aed47b0b6c0708f7ac04a3"}
Jun 03 01:45:30.148268 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:30.148139    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r" event={"ID":"d129a489-d7a2-46f2-8976-a218b74e2517","Type":"ContainerStarted","Data":"c26796b7dfd9f326d7a99fd05f93d7614fde4bff6529912c12bafebfe2934b82"}
Jun 03 01:45:30.979092 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:30.979068    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/ovn-acl-logging/0.log"
Jun 03 01:45:30.979462 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:30.979107    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/ovn-acl-logging/0.log"
Jun 03 01:45:30.985499 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:30.985473    2577 kubelet.go:1628] "Image garbage collection succeeded"
Jun 03 01:45:33.159021 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:33.158980    2577 generic.go:358] "Generic (PLEG): container finished" podID="d129a489-d7a2-46f2-8976-a218b74e2517" containerID="5a81aae1a15ec3ae7e00f389df018a897c316e4e9617a8431de3889094f1d606" exitCode=0
Jun 03 01:45:33.159427 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:33.159028    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r" event={"ID":"d129a489-d7a2-46f2-8976-a218b74e2517","Type":"ContainerDied","Data":"5a81aae1a15ec3ae7e00f389df018a897c316e4e9617a8431de3889094f1d606"}
Jun 03 01:45:33.160050 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:33.160033    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 01:45:34.164016 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:34.163980    2577 generic.go:358] "Generic (PLEG): container finished" podID="d129a489-d7a2-46f2-8976-a218b74e2517" containerID="e03f9c9a9623ef274678927ca06fbfa02b6e0ba359fc525c07c5023d18d8c610" exitCode=0
Jun 03 01:45:34.164414 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:34.164071    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r" event={"ID":"d129a489-d7a2-46f2-8976-a218b74e2517","Type":"ContainerDied","Data":"e03f9c9a9623ef274678927ca06fbfa02b6e0ba359fc525c07c5023d18d8c610"}
Jun 03 01:45:35.296154 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:35.296124    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r"
Jun 03 01:45:35.385789 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:35.385749    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d129a489-d7a2-46f2-8976-a218b74e2517-bundle\") pod \"d129a489-d7a2-46f2-8976-a218b74e2517\" (UID: \"d129a489-d7a2-46f2-8976-a218b74e2517\") "
Jun 03 01:45:35.385983 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:35.385851    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d129a489-d7a2-46f2-8976-a218b74e2517-util\") pod \"d129a489-d7a2-46f2-8976-a218b74e2517\" (UID: \"d129a489-d7a2-46f2-8976-a218b74e2517\") "
Jun 03 01:45:35.385983 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:35.385900    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hp8pq\" (UniqueName: \"kubernetes.io/projected/d129a489-d7a2-46f2-8976-a218b74e2517-kube-api-access-hp8pq\") pod \"d129a489-d7a2-46f2-8976-a218b74e2517\" (UID: \"d129a489-d7a2-46f2-8976-a218b74e2517\") "
Jun 03 01:45:35.386187 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:35.386159    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d129a489-d7a2-46f2-8976-a218b74e2517-bundle" (OuterVolumeSpecName: "bundle") pod "d129a489-d7a2-46f2-8976-a218b74e2517" (UID: "d129a489-d7a2-46f2-8976-a218b74e2517"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 01:45:35.388173 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:35.388138    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d129a489-d7a2-46f2-8976-a218b74e2517-kube-api-access-hp8pq" (OuterVolumeSpecName: "kube-api-access-hp8pq") pod "d129a489-d7a2-46f2-8976-a218b74e2517" (UID: "d129a489-d7a2-46f2-8976-a218b74e2517"). InnerVolumeSpecName "kube-api-access-hp8pq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:45:35.389881 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:35.389857    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d129a489-d7a2-46f2-8976-a218b74e2517-util" (OuterVolumeSpecName: "util") pod "d129a489-d7a2-46f2-8976-a218b74e2517" (UID: "d129a489-d7a2-46f2-8976-a218b74e2517"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 01:45:35.487513 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:35.487404    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d129a489-d7a2-46f2-8976-a218b74e2517-util\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:45:35.487513 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:35.487458    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hp8pq\" (UniqueName: \"kubernetes.io/projected/d129a489-d7a2-46f2-8976-a218b74e2517-kube-api-access-hp8pq\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:45:35.487513 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:35.487479    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d129a489-d7a2-46f2-8976-a218b74e2517-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:45:36.174174 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:36.174138    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r" event={"ID":"d129a489-d7a2-46f2-8976-a218b74e2517","Type":"ContainerDied","Data":"c26796b7dfd9f326d7a99fd05f93d7614fde4bff6529912c12bafebfe2934b82"}
Jun 03 01:45:36.174174 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:36.174159    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8j85r"
Jun 03 01:45:36.174174 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:36.174173    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c26796b7dfd9f326d7a99fd05f93d7614fde4bff6529912c12bafebfe2934b82"
Jun 03 01:45:36.298728 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:36.298694    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-crwns"]
Jun 03 01:45:36.299102 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:36.299042    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d129a489-d7a2-46f2-8976-a218b74e2517" containerName="pull"
Jun 03 01:45:36.299102 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:36.299054    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d129a489-d7a2-46f2-8976-a218b74e2517" containerName="pull"
Jun 03 01:45:36.299102 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:36.299071    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d129a489-d7a2-46f2-8976-a218b74e2517" containerName="extract"
Jun 03 01:45:36.299102 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:36.299080    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d129a489-d7a2-46f2-8976-a218b74e2517" containerName="extract"
Jun 03 01:45:36.299102 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:36.299091    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d129a489-d7a2-46f2-8976-a218b74e2517" containerName="util"
Jun 03 01:45:36.299102 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:36.299097    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d129a489-d7a2-46f2-8976-a218b74e2517" containerName="util"
Jun 03 01:45:36.299286 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:36.299144    2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="d129a489-d7a2-46f2-8976-a218b74e2517" containerName="extract"
Jun 03 01:45:36.304916 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:36.304893    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-crwns"
Jun 03 01:45:36.307656 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:36.307550    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-rbnhn\""
Jun 03 01:45:36.307656 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:36.307553    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jun 03 01:45:36.308133 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:36.308109    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jun 03 01:45:36.309650 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:36.309627    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-crwns"]
Jun 03 01:45:36.395681 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:36.395636    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a14f730-fb42-4284-8726-b147e25636fd-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-crwns\" (UID: \"1a14f730-fb42-4284-8726-b147e25636fd\") " pod="cert-manager/cert-manager-cainjector-68b757865b-crwns"
Jun 03 01:45:36.395900 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:36.395694    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dj4j\" (UniqueName: \"kubernetes.io/projected/1a14f730-fb42-4284-8726-b147e25636fd-kube-api-access-4dj4j\") pod \"cert-manager-cainjector-68b757865b-crwns\" (UID: \"1a14f730-fb42-4284-8726-b147e25636fd\") " pod="cert-manager/cert-manager-cainjector-68b757865b-crwns"
Jun 03 01:45:36.497273 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:36.497177    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a14f730-fb42-4284-8726-b147e25636fd-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-crwns\" (UID: \"1a14f730-fb42-4284-8726-b147e25636fd\") " pod="cert-manager/cert-manager-cainjector-68b757865b-crwns"
Jun 03 01:45:36.497273 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:36.497234    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4dj4j\" (UniqueName: \"kubernetes.io/projected/1a14f730-fb42-4284-8726-b147e25636fd-kube-api-access-4dj4j\") pod \"cert-manager-cainjector-68b757865b-crwns\" (UID: \"1a14f730-fb42-4284-8726-b147e25636fd\") " pod="cert-manager/cert-manager-cainjector-68b757865b-crwns"
Jun 03 01:45:36.505003 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:36.504970    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dj4j\" (UniqueName: \"kubernetes.io/projected/1a14f730-fb42-4284-8726-b147e25636fd-kube-api-access-4dj4j\") pod \"cert-manager-cainjector-68b757865b-crwns\" (UID: \"1a14f730-fb42-4284-8726-b147e25636fd\") " pod="cert-manager/cert-manager-cainjector-68b757865b-crwns"
Jun 03 01:45:36.505142 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:36.504967    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a14f730-fb42-4284-8726-b147e25636fd-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-crwns\" (UID: \"1a14f730-fb42-4284-8726-b147e25636fd\") " pod="cert-manager/cert-manager-cainjector-68b757865b-crwns"
Jun 03 01:45:36.629972 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:36.629929    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-crwns"
Jun 03 01:45:36.757817 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:36.757598    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-crwns"]
Jun 03 01:45:36.760329 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:45:36.760296    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a14f730_fb42_4284_8726_b147e25636fd.slice/crio-93845aba9bc12e00856790cfff724ac095e2d0ec2a903d214433e7687a3c52a3 WatchSource:0}: Error finding container 93845aba9bc12e00856790cfff724ac095e2d0ec2a903d214433e7687a3c52a3: Status 404 returned error can't find the container with id 93845aba9bc12e00856790cfff724ac095e2d0ec2a903d214433e7687a3c52a3
Jun 03 01:45:37.178147 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:37.178108    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-crwns" event={"ID":"1a14f730-fb42-4284-8726-b147e25636fd","Type":"ContainerStarted","Data":"93845aba9bc12e00856790cfff724ac095e2d0ec2a903d214433e7687a3c52a3"}
Jun 03 01:45:40.189154 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:40.189109    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-crwns" event={"ID":"1a14f730-fb42-4284-8726-b147e25636fd","Type":"ContainerStarted","Data":"e9ebcaf2b2044597cd7fa3f91083fe3ded1d17998083bc572b114b0022ba77d3"}
Jun 03 01:45:40.204315 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:40.204263    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-crwns" podStartSLOduration=1.663159152 podStartE2EDuration="4.20424861s" podCreationTimestamp="2026-06-03 01:45:36 +0000 UTC" firstStartedPulling="2026-06-03 01:45:36.762206044 +0000 UTC m=+306.326601837" lastFinishedPulling="2026-06-03 01:45:39.303295505 +0000 UTC m=+308.867691295" observedRunningTime="2026-06-03 01:45:40.203402253 +0000 UTC m=+309.767798064" watchObservedRunningTime="2026-06-03 01:45:40.20424861 +0000 UTC m=+309.768644421"
Jun 03 01:45:42.893155 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:42.893115    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-fdhmv"]
Jun 03 01:45:42.898956 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:42.898935    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-fdhmv"
Jun 03 01:45:42.901371 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:42.901346    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jun 03 01:45:42.902190 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:42.902172    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-r49jd\""
Jun 03 01:45:42.902291 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:42.902209    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jun 03 01:45:42.907190 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:42.907165    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-fdhmv"]
Jun 03 01:45:43.061871 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:43.061825    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2db860f7-7c9a-477d-a0a5-d04b34c0710c-tmp\") pod \"openshift-lws-operator-bfc7f696d-fdhmv\" (UID: \"2db860f7-7c9a-477d-a0a5-d04b34c0710c\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-fdhmv"
Jun 03 01:45:43.062061 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:43.061887    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js6sl\" (UniqueName: \"kubernetes.io/projected/2db860f7-7c9a-477d-a0a5-d04b34c0710c-kube-api-access-js6sl\") pod \"openshift-lws-operator-bfc7f696d-fdhmv\" (UID: \"2db860f7-7c9a-477d-a0a5-d04b34c0710c\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-fdhmv"
Jun 03 01:45:43.163356 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:43.163256    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2db860f7-7c9a-477d-a0a5-d04b34c0710c-tmp\") pod \"openshift-lws-operator-bfc7f696d-fdhmv\" (UID: \"2db860f7-7c9a-477d-a0a5-d04b34c0710c\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-fdhmv"
Jun 03 01:45:43.163356 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:43.163316    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-js6sl\" (UniqueName: \"kubernetes.io/projected/2db860f7-7c9a-477d-a0a5-d04b34c0710c-kube-api-access-js6sl\") pod \"openshift-lws-operator-bfc7f696d-fdhmv\" (UID: \"2db860f7-7c9a-477d-a0a5-d04b34c0710c\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-fdhmv"
Jun 03 01:45:43.163628 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:43.163574    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2db860f7-7c9a-477d-a0a5-d04b34c0710c-tmp\") pod \"openshift-lws-operator-bfc7f696d-fdhmv\" (UID: \"2db860f7-7c9a-477d-a0a5-d04b34c0710c\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-fdhmv"
Jun 03 01:45:43.171027 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:43.170999    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-js6sl\" (UniqueName: \"kubernetes.io/projected/2db860f7-7c9a-477d-a0a5-d04b34c0710c-kube-api-access-js6sl\") pod \"openshift-lws-operator-bfc7f696d-fdhmv\" (UID: \"2db860f7-7c9a-477d-a0a5-d04b34c0710c\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-fdhmv"
Jun 03 01:45:43.209229 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:43.209197    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-fdhmv"
Jun 03 01:45:43.342224 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:43.342184    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-fdhmv"]
Jun 03 01:45:43.345360 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:45:43.345333    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2db860f7_7c9a_477d_a0a5_d04b34c0710c.slice/crio-d5045bc0d231cbf5115be81ae1838a75da2341b827942dd4f4ad4ba15313bfdc WatchSource:0}: Error finding container d5045bc0d231cbf5115be81ae1838a75da2341b827942dd4f4ad4ba15313bfdc: Status 404 returned error can't find the container with id d5045bc0d231cbf5115be81ae1838a75da2341b827942dd4f4ad4ba15313bfdc
Jun 03 01:45:44.204045 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:44.204006    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-fdhmv" event={"ID":"2db860f7-7c9a-477d-a0a5-d04b34c0710c","Type":"ContainerStarted","Data":"d5045bc0d231cbf5115be81ae1838a75da2341b827942dd4f4ad4ba15313bfdc"}
Jun 03 01:45:50.224473 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:50.224436    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-fdhmv" event={"ID":"2db860f7-7c9a-477d-a0a5-d04b34c0710c","Type":"ContainerStarted","Data":"8b90c541a88f862040ae0edcbd017452ed5abf73a5c2e0830f2d1f42bfef0292"}
Jun 03 01:45:50.239502 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:50.239436    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-fdhmv" podStartSLOduration=2.007989301 podStartE2EDuration="8.239418544s" podCreationTimestamp="2026-06-03 01:45:42 +0000 UTC" firstStartedPulling="2026-06-03 01:45:43.347284018 +0000 UTC m=+312.911679806" lastFinishedPulling="2026-06-03 01:45:49.578713257 +0000 UTC m=+319.143109049" observedRunningTime="2026-06-03 01:45:50.238516178 +0000 UTC m=+319.802911990" watchObservedRunningTime="2026-06-03 01:45:50.239418544 +0000 UTC m=+319.803814357"
Jun 03 01:45:52.886655 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:52.886614    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8"]
Jun 03 01:45:52.889738 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:52.889715    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8"
Jun 03 01:45:52.892053 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:52.892027    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 03 01:45:52.892236 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:52.892217    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 03 01:45:52.892921 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:52.892904    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qh4d6\""
Jun 03 01:45:52.898143 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:52.898115    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8"]
Jun 03 01:45:52.934175 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:52.934129    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmj6k\" (UniqueName: \"kubernetes.io/projected/4785bcba-c28c-4975-9652-eac17fb03d3c-kube-api-access-hmj6k\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8\" (UID: \"4785bcba-c28c-4975-9652-eac17fb03d3c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8"
Jun 03 01:45:52.934355 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:52.934187    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4785bcba-c28c-4975-9652-eac17fb03d3c-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8\" (UID: \"4785bcba-c28c-4975-9652-eac17fb03d3c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8"
Jun 03 01:45:52.934355 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:52.934206    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4785bcba-c28c-4975-9652-eac17fb03d3c-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8\" (UID: \"4785bcba-c28c-4975-9652-eac17fb03d3c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8"
Jun 03 01:45:53.034723 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:53.034682    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hmj6k\" (UniqueName: \"kubernetes.io/projected/4785bcba-c28c-4975-9652-eac17fb03d3c-kube-api-access-hmj6k\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8\" (UID: \"4785bcba-c28c-4975-9652-eac17fb03d3c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8"
Jun 03 01:45:53.034902 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:53.034760    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4785bcba-c28c-4975-9652-eac17fb03d3c-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8\" (UID: \"4785bcba-c28c-4975-9652-eac17fb03d3c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8"
Jun 03 01:45:53.034902 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:53.034782    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4785bcba-c28c-4975-9652-eac17fb03d3c-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8\" (UID: \"4785bcba-c28c-4975-9652-eac17fb03d3c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8"
Jun 03 01:45:53.035228 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:53.035212    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4785bcba-c28c-4975-9652-eac17fb03d3c-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8\" (UID: \"4785bcba-c28c-4975-9652-eac17fb03d3c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8"
Jun 03 01:45:53.035490 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:53.035470    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4785bcba-c28c-4975-9652-eac17fb03d3c-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8\" (UID: \"4785bcba-c28c-4975-9652-eac17fb03d3c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8"
Jun 03 01:45:53.042597 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:53.042549    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmj6k\" (UniqueName: \"kubernetes.io/projected/4785bcba-c28c-4975-9652-eac17fb03d3c-kube-api-access-hmj6k\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8\" (UID: \"4785bcba-c28c-4975-9652-eac17fb03d3c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8"
Jun 03 01:45:53.201439 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:53.201352    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8"
Jun 03 01:45:53.330968 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:53.330934    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8"]
Jun 03 01:45:53.334884 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:45:53.334854    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4785bcba_c28c_4975_9652_eac17fb03d3c.slice/crio-123d653a1f4a66c45c840e40df02224d681164d1a1924583172f41e54a793c22 WatchSource:0}: Error finding container 123d653a1f4a66c45c840e40df02224d681164d1a1924583172f41e54a793c22: Status 404 returned error can't find the container with id 123d653a1f4a66c45c840e40df02224d681164d1a1924583172f41e54a793c22
Jun 03 01:45:54.238476 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:54.238442    2577 generic.go:358] "Generic (PLEG): container finished" podID="4785bcba-c28c-4975-9652-eac17fb03d3c" containerID="fdf6ea647234a037eb2c5d946954234131898dc2a64437af8b6b5e17c9171c19" exitCode=0
Jun 03 01:45:54.238894 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:54.238515    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8" event={"ID":"4785bcba-c28c-4975-9652-eac17fb03d3c","Type":"ContainerDied","Data":"fdf6ea647234a037eb2c5d946954234131898dc2a64437af8b6b5e17c9171c19"}
Jun 03 01:45:54.238894 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:54.238537    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8" event={"ID":"4785bcba-c28c-4975-9652-eac17fb03d3c","Type":"ContainerStarted","Data":"123d653a1f4a66c45c840e40df02224d681164d1a1924583172f41e54a793c22"}
Jun 03 01:45:55.243450 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:55.243403    2577 generic.go:358] "Generic (PLEG): container finished" podID="4785bcba-c28c-4975-9652-eac17fb03d3c" containerID="78d0a34b5ba4a63c66918040e069a34edb0708496f599fad7ca93ccde01ac8c8" exitCode=0
Jun 03 01:45:55.243847 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:55.243484    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8" event={"ID":"4785bcba-c28c-4975-9652-eac17fb03d3c","Type":"ContainerDied","Data":"78d0a34b5ba4a63c66918040e069a34edb0708496f599fad7ca93ccde01ac8c8"}
Jun 03 01:45:56.248184 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:56.248145    2577 generic.go:358] "Generic (PLEG): container finished" podID="4785bcba-c28c-4975-9652-eac17fb03d3c" containerID="70e98c3012c0f923209bafed111ea58787e073448da2be97fe7d7709e95901b2" exitCode=0
Jun 03 01:45:56.248571 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:56.248237    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8" event={"ID":"4785bcba-c28c-4975-9652-eac17fb03d3c","Type":"ContainerDied","Data":"70e98c3012c0f923209bafed111ea58787e073448da2be97fe7d7709e95901b2"}
Jun 03 01:45:57.376741 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:57.376718    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8"
Jun 03 01:45:57.471093 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:57.471051    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4785bcba-c28c-4975-9652-eac17fb03d3c-util\") pod \"4785bcba-c28c-4975-9652-eac17fb03d3c\" (UID: \"4785bcba-c28c-4975-9652-eac17fb03d3c\") "
Jun 03 01:45:57.471260 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:57.471106    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmj6k\" (UniqueName: \"kubernetes.io/projected/4785bcba-c28c-4975-9652-eac17fb03d3c-kube-api-access-hmj6k\") pod \"4785bcba-c28c-4975-9652-eac17fb03d3c\" (UID: \"4785bcba-c28c-4975-9652-eac17fb03d3c\") "
Jun 03 01:45:57.471260 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:57.471166    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4785bcba-c28c-4975-9652-eac17fb03d3c-bundle\") pod \"4785bcba-c28c-4975-9652-eac17fb03d3c\" (UID: \"4785bcba-c28c-4975-9652-eac17fb03d3c\") "
Jun 03 01:45:57.472038 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:57.472007    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4785bcba-c28c-4975-9652-eac17fb03d3c-bundle" (OuterVolumeSpecName: "bundle") pod "4785bcba-c28c-4975-9652-eac17fb03d3c" (UID: "4785bcba-c28c-4975-9652-eac17fb03d3c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 01:45:57.473270 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:57.473243    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4785bcba-c28c-4975-9652-eac17fb03d3c-kube-api-access-hmj6k" (OuterVolumeSpecName: "kube-api-access-hmj6k") pod "4785bcba-c28c-4975-9652-eac17fb03d3c" (UID: "4785bcba-c28c-4975-9652-eac17fb03d3c"). InnerVolumeSpecName "kube-api-access-hmj6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:45:57.476878 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:57.476845    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4785bcba-c28c-4975-9652-eac17fb03d3c-util" (OuterVolumeSpecName: "util") pod "4785bcba-c28c-4975-9652-eac17fb03d3c" (UID: "4785bcba-c28c-4975-9652-eac17fb03d3c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 01:45:57.572397 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:57.572302    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmj6k\" (UniqueName: \"kubernetes.io/projected/4785bcba-c28c-4975-9652-eac17fb03d3c-kube-api-access-hmj6k\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:45:57.572397 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:57.572337    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4785bcba-c28c-4975-9652-eac17fb03d3c-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:45:57.572397 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:57.572348    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4785bcba-c28c-4975-9652-eac17fb03d3c-util\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:45:58.256862 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:58.256826    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8" event={"ID":"4785bcba-c28c-4975-9652-eac17fb03d3c","Type":"ContainerDied","Data":"123d653a1f4a66c45c840e40df02224d681164d1a1924583172f41e54a793c22"}
Jun 03 01:45:58.256862 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:58.256862    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="123d653a1f4a66c45c840e40df02224d681164d1a1924583172f41e54a793c22"
Jun 03 01:45:58.257067 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:45:58.256875    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfbzg8"
Jun 03 01:46:05.321488 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.321446    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7"]
Jun 03 01:46:05.322096 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.321993    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4785bcba-c28c-4975-9652-eac17fb03d3c" containerName="extract"
Jun 03 01:46:05.322096 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.322016    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4785bcba-c28c-4975-9652-eac17fb03d3c" containerName="extract"
Jun 03 01:46:05.322096 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.322053    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4785bcba-c28c-4975-9652-eac17fb03d3c" containerName="pull"
Jun 03 01:46:05.322096 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.322062    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4785bcba-c28c-4975-9652-eac17fb03d3c" containerName="pull"
Jun 03 01:46:05.322096 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.322081    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4785bcba-c28c-4975-9652-eac17fb03d3c" containerName="util"
Jun 03 01:46:05.322096 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.322089    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4785bcba-c28c-4975-9652-eac17fb03d3c" containerName="util"
Jun 03 01:46:05.322396 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.322159    2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="4785bcba-c28c-4975-9652-eac17fb03d3c" containerName="extract"
Jun 03 01:46:05.328114 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.328091    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7"
Jun 03 01:46:05.333823 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.333796    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jun 03 01:46:05.334275 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.334250    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jun 03 01:46:05.334406 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.334299    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6wj9t\""
Jun 03 01:46:05.334628 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.334606    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jun 03 01:46:05.335079 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.334672    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jun 03 01:46:05.343891 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.343860    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7"]
Jun 03 01:46:05.444746 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.444702    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f76882ed-aadb-44f4-84ae-f78bf86dec41-manifests\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7\" (UID: \"f76882ed-aadb-44f4-84ae-f78bf86dec41\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7"
Jun 03 01:46:05.444940 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.444753    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f76882ed-aadb-44f4-84ae-f78bf86dec41-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7\" (UID: \"f76882ed-aadb-44f4-84ae-f78bf86dec41\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7"
Jun 03 01:46:05.444940 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.444793    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw9c6\" (UniqueName: \"kubernetes.io/projected/f76882ed-aadb-44f4-84ae-f78bf86dec41-kube-api-access-jw9c6\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7\" (UID: \"f76882ed-aadb-44f4-84ae-f78bf86dec41\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7"
Jun 03 01:46:05.444940 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.444864    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f76882ed-aadb-44f4-84ae-f78bf86dec41-webhook-cert\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7\" (UID: \"f76882ed-aadb-44f4-84ae-f78bf86dec41\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7"
Jun 03 01:46:05.444940 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.444919    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f76882ed-aadb-44f4-84ae-f78bf86dec41-tmp\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7\" (UID: \"f76882ed-aadb-44f4-84ae-f78bf86dec41\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7"
Jun 03 01:46:05.545557 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.545510    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f76882ed-aadb-44f4-84ae-f78bf86dec41-manifests\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7\" (UID: \"f76882ed-aadb-44f4-84ae-f78bf86dec41\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7"
Jun 03 01:46:05.545557 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.545562    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f76882ed-aadb-44f4-84ae-f78bf86dec41-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7\" (UID: \"f76882ed-aadb-44f4-84ae-f78bf86dec41\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7"
Jun 03 01:46:05.545790 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.545628    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jw9c6\" (UniqueName: \"kubernetes.io/projected/f76882ed-aadb-44f4-84ae-f78bf86dec41-kube-api-access-jw9c6\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7\" (UID: \"f76882ed-aadb-44f4-84ae-f78bf86dec41\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7"
Jun 03 01:46:05.545790 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.545676    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f76882ed-aadb-44f4-84ae-f78bf86dec41-webhook-cert\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7\" (UID: \"f76882ed-aadb-44f4-84ae-f78bf86dec41\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7"
Jun 03 01:46:05.545790 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.545715    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f76882ed-aadb-44f4-84ae-f78bf86dec41-tmp\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7\" (UID: \"f76882ed-aadb-44f4-84ae-f78bf86dec41\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7"
Jun 03 01:46:05.546022 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.545997    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f76882ed-aadb-44f4-84ae-f78bf86dec41-manifests\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7\" (UID: \"f76882ed-aadb-44f4-84ae-f78bf86dec41\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7"
Jun 03 01:46:05.547957 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.547924    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f76882ed-aadb-44f4-84ae-f78bf86dec41-tmp\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7\" (UID: \"f76882ed-aadb-44f4-84ae-f78bf86dec41\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7"
Jun 03 01:46:05.548159 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.548139    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f76882ed-aadb-44f4-84ae-f78bf86dec41-webhook-cert\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7\" (UID: \"f76882ed-aadb-44f4-84ae-f78bf86dec41\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7"
Jun 03 01:46:05.548203 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.548175    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f76882ed-aadb-44f4-84ae-f78bf86dec41-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7\" (UID: \"f76882ed-aadb-44f4-84ae-f78bf86dec41\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7"
Jun 03 01:46:05.558331 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.558301    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw9c6\" (UniqueName: \"kubernetes.io/projected/f76882ed-aadb-44f4-84ae-f78bf86dec41-kube-api-access-jw9c6\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7\" (UID: \"f76882ed-aadb-44f4-84ae-f78bf86dec41\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7"
Jun 03 01:46:05.638376 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.638336    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7"
Jun 03 01:46:05.781852 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:05.781826    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7"]
Jun 03 01:46:05.784521 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:46:05.784491    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf76882ed_aadb_44f4_84ae_f78bf86dec41.slice/crio-dc42bc44333aae362cf66f33f94289d7a72a0072721e17224ff9f1ff6cb35c7a WatchSource:0}: Error finding container dc42bc44333aae362cf66f33f94289d7a72a0072721e17224ff9f1ff6cb35c7a: Status 404 returned error can't find the container with id dc42bc44333aae362cf66f33f94289d7a72a0072721e17224ff9f1ff6cb35c7a
Jun 03 01:46:06.291346 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:06.291303    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7" event={"ID":"f76882ed-aadb-44f4-84ae-f78bf86dec41","Type":"ContainerStarted","Data":"dc42bc44333aae362cf66f33f94289d7a72a0072721e17224ff9f1ff6cb35c7a"}
Jun 03 01:46:09.303625 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:09.303577    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7" event={"ID":"f76882ed-aadb-44f4-84ae-f78bf86dec41","Type":"ContainerStarted","Data":"5f0389c9be419a43bdbcb2fe6a8986f29a69b19f73e42b4ce3e5ac0920fc9e6a"}
Jun 03 01:46:10.308643 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:10.308539    2577 generic.go:358] "Generic (PLEG): container finished" podID="f76882ed-aadb-44f4-84ae-f78bf86dec41" containerID="5f0389c9be419a43bdbcb2fe6a8986f29a69b19f73e42b4ce3e5ac0920fc9e6a" exitCode=0
Jun 03 01:46:10.308643 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:10.308602    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7" event={"ID":"f76882ed-aadb-44f4-84ae-f78bf86dec41","Type":"ContainerDied","Data":"5f0389c9be419a43bdbcb2fe6a8986f29a69b19f73e42b4ce3e5ac0920fc9e6a"}
Jun 03 01:46:11.313104 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:11.313022    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7" event={"ID":"f76882ed-aadb-44f4-84ae-f78bf86dec41","Type":"ContainerStarted","Data":"1766b524bf3757d4f19108d76c3e5a5c401208c1bbca2cea89417bc7dbbb07a9"}
Jun 03 01:46:11.313486 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:11.313147    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7"
Jun 03 01:46:11.333346 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:11.333295    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7" podStartSLOduration=1.450660841 podStartE2EDuration="6.333280244s" podCreationTimestamp="2026-06-03 01:46:05 +0000 UTC" firstStartedPulling="2026-06-03 01:46:05.78621648 +0000 UTC m=+335.350612269" lastFinishedPulling="2026-06-03 01:46:10.66883588 +0000 UTC m=+340.233231672" observedRunningTime="2026-06-03 01:46:11.33224611 +0000 UTC m=+340.896641921" watchObservedRunningTime="2026-06-03 01:46:11.333280244 +0000 UTC m=+340.897676054"
Jun 03 01:46:22.318387 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:22.318359    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7"
Jun 03 01:46:24.916020 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:24.915983    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-889cb89c5-wsddf"]
Jun 03 01:46:24.924731 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:24.924705    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-889cb89c5-wsddf"
Jun 03 01:46:24.927003 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:24.926975    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jun 03 01:46:24.927003 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:24.926991    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8r42k\""
Jun 03 01:46:24.927215 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:24.926977    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jun 03 01:46:24.930240 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:24.930211    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-889cb89c5-wsddf"]
Jun 03 01:46:24.975386 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:24.975351    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-d5dt8"]
Jun 03 01:46:24.980697 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:24.980634    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-d5dt8"
Jun 03 01:46:24.983983 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:24.983961    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-lf29w\""
Jun 03 01:46:24.984160 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:24.984145    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jun 03 01:46:24.995875 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:24.995842    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-d5dt8"]
Jun 03 01:46:25.019297 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.019255    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75f8daf2-fbfd-4d99-b7f0-449dec047cc8-tmp\") pod \"kube-auth-proxy-889cb89c5-wsddf\" (UID: \"75f8daf2-fbfd-4d99-b7f0-449dec047cc8\") " pod="openshift-ingress/kube-auth-proxy-889cb89c5-wsddf"
Jun 03 01:46:25.019481 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.019305    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnx9d\" (UniqueName: \"kubernetes.io/projected/75f8daf2-fbfd-4d99-b7f0-449dec047cc8-kube-api-access-cnx9d\") pod \"kube-auth-proxy-889cb89c5-wsddf\" (UID: \"75f8daf2-fbfd-4d99-b7f0-449dec047cc8\") " pod="openshift-ingress/kube-auth-proxy-889cb89c5-wsddf"
Jun 03 01:46:25.019481 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.019380    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75f8daf2-fbfd-4d99-b7f0-449dec047cc8-tls-certs\") pod \"kube-auth-proxy-889cb89c5-wsddf\" (UID: \"75f8daf2-fbfd-4d99-b7f0-449dec047cc8\") " pod="openshift-ingress/kube-auth-proxy-889cb89c5-wsddf"
Jun 03 01:46:25.119920 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.119876    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75f8daf2-fbfd-4d99-b7f0-449dec047cc8-tls-certs\") pod \"kube-auth-proxy-889cb89c5-wsddf\" (UID: \"75f8daf2-fbfd-4d99-b7f0-449dec047cc8\") " pod="openshift-ingress/kube-auth-proxy-889cb89c5-wsddf"
Jun 03 01:46:25.120111 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.119951    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txsqc\" (UniqueName: \"kubernetes.io/projected/33dc33a6-a326-4f70-bebd-d9b2479414f0-kube-api-access-txsqc\") pod \"odh-model-controller-76588b95-d5dt8\" (UID: \"33dc33a6-a326-4f70-bebd-d9b2479414f0\") " pod="opendatahub/odh-model-controller-76588b95-d5dt8"
Jun 03 01:46:25.120111 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.120006    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75f8daf2-fbfd-4d99-b7f0-449dec047cc8-tmp\") pod \"kube-auth-proxy-889cb89c5-wsddf\" (UID: \"75f8daf2-fbfd-4d99-b7f0-449dec047cc8\") " pod="openshift-ingress/kube-auth-proxy-889cb89c5-wsddf"
Jun 03 01:46:25.120111 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.120033    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33dc33a6-a326-4f70-bebd-d9b2479414f0-cert\") pod \"odh-model-controller-76588b95-d5dt8\" (UID: \"33dc33a6-a326-4f70-bebd-d9b2479414f0\") " pod="opendatahub/odh-model-controller-76588b95-d5dt8"
Jun 03 01:46:25.120111 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.120072    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cnx9d\" (UniqueName: \"kubernetes.io/projected/75f8daf2-fbfd-4d99-b7f0-449dec047cc8-kube-api-access-cnx9d\") pod \"kube-auth-proxy-889cb89c5-wsddf\" (UID: \"75f8daf2-fbfd-4d99-b7f0-449dec047cc8\") " pod="openshift-ingress/kube-auth-proxy-889cb89c5-wsddf"
Jun 03 01:46:25.120751 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:46:25.120717    2577 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jun 03 01:46:25.120886 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:46:25.120871    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75f8daf2-fbfd-4d99-b7f0-449dec047cc8-tls-certs podName:75f8daf2-fbfd-4d99-b7f0-449dec047cc8 nodeName:}" failed. No retries permitted until 2026-06-03 01:46:25.620847684 +0000 UTC m=+355.185243491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/75f8daf2-fbfd-4d99-b7f0-449dec047cc8-tls-certs") pod "kube-auth-proxy-889cb89c5-wsddf" (UID: "75f8daf2-fbfd-4d99-b7f0-449dec047cc8") : secret "kube-auth-proxy-tls" not found
Jun 03 01:46:25.123237 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.123213    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75f8daf2-fbfd-4d99-b7f0-449dec047cc8-tmp\") pod \"kube-auth-proxy-889cb89c5-wsddf\" (UID: \"75f8daf2-fbfd-4d99-b7f0-449dec047cc8\") " pod="openshift-ingress/kube-auth-proxy-889cb89c5-wsddf"
Jun 03 01:46:25.136592 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.136546    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnx9d\" (UniqueName: \"kubernetes.io/projected/75f8daf2-fbfd-4d99-b7f0-449dec047cc8-kube-api-access-cnx9d\") pod \"kube-auth-proxy-889cb89c5-wsddf\" (UID: \"75f8daf2-fbfd-4d99-b7f0-449dec047cc8\") " pod="openshift-ingress/kube-auth-proxy-889cb89c5-wsddf"
Jun 03 01:46:25.221742 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.221645    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-txsqc\" (UniqueName: \"kubernetes.io/projected/33dc33a6-a326-4f70-bebd-d9b2479414f0-kube-api-access-txsqc\") pod \"odh-model-controller-76588b95-d5dt8\" (UID: \"33dc33a6-a326-4f70-bebd-d9b2479414f0\") " pod="opendatahub/odh-model-controller-76588b95-d5dt8"
Jun 03 01:46:25.221742 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.221711    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33dc33a6-a326-4f70-bebd-d9b2479414f0-cert\") pod \"odh-model-controller-76588b95-d5dt8\" (UID: \"33dc33a6-a326-4f70-bebd-d9b2479414f0\") " pod="opendatahub/odh-model-controller-76588b95-d5dt8"
Jun 03 01:46:25.221930 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:46:25.221825    2577 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jun 03 01:46:25.221930 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:46:25.221891    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33dc33a6-a326-4f70-bebd-d9b2479414f0-cert podName:33dc33a6-a326-4f70-bebd-d9b2479414f0 nodeName:}" failed. No retries permitted until 2026-06-03 01:46:25.721874847 +0000 UTC m=+355.286270635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/33dc33a6-a326-4f70-bebd-d9b2479414f0-cert") pod "odh-model-controller-76588b95-d5dt8" (UID: "33dc33a6-a326-4f70-bebd-d9b2479414f0") : secret "odh-model-controller-webhook-cert" not found
Jun 03 01:46:25.229816 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.229788    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txsqc\" (UniqueName: \"kubernetes.io/projected/33dc33a6-a326-4f70-bebd-d9b2479414f0-kube-api-access-txsqc\") pod \"odh-model-controller-76588b95-d5dt8\" (UID: \"33dc33a6-a326-4f70-bebd-d9b2479414f0\") " pod="opendatahub/odh-model-controller-76588b95-d5dt8"
Jun 03 01:46:25.625388 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.625352    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75f8daf2-fbfd-4d99-b7f0-449dec047cc8-tls-certs\") pod \"kube-auth-proxy-889cb89c5-wsddf\" (UID: \"75f8daf2-fbfd-4d99-b7f0-449dec047cc8\") " pod="openshift-ingress/kube-auth-proxy-889cb89c5-wsddf"
Jun 03 01:46:25.627829 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.627807    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75f8daf2-fbfd-4d99-b7f0-449dec047cc8-tls-certs\") pod \"kube-auth-proxy-889cb89c5-wsddf\" (UID: \"75f8daf2-fbfd-4d99-b7f0-449dec047cc8\") " pod="openshift-ingress/kube-auth-proxy-889cb89c5-wsddf"
Jun 03 01:46:25.679206 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.679176    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-nzznf"]
Jun 03 01:46:25.683139 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.683122    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-nzznf"
Jun 03 01:46:25.685296 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.685276    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jun 03 01:46:25.693195 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.693171    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-nzznf"]
Jun 03 01:46:25.726676 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.726636    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33dc33a6-a326-4f70-bebd-d9b2479414f0-cert\") pod \"odh-model-controller-76588b95-d5dt8\" (UID: \"33dc33a6-a326-4f70-bebd-d9b2479414f0\") " pod="opendatahub/odh-model-controller-76588b95-d5dt8"
Jun 03 01:46:25.729152 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.729129    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33dc33a6-a326-4f70-bebd-d9b2479414f0-cert\") pod \"odh-model-controller-76588b95-d5dt8\" (UID: \"33dc33a6-a326-4f70-bebd-d9b2479414f0\") " pod="opendatahub/odh-model-controller-76588b95-d5dt8"
Jun 03 01:46:25.827518 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.827481    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58mz9\" (UniqueName: \"kubernetes.io/projected/a2da778c-dbfc-4257-a01f-693abd213542-kube-api-access-58mz9\") pod \"model-serving-api-6577596cd5-nzznf\" (UID: \"a2da778c-dbfc-4257-a01f-693abd213542\") " pod="opendatahub/model-serving-api-6577596cd5-nzznf"
Jun 03 01:46:25.827752 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.827539    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2da778c-dbfc-4257-a01f-693abd213542-tls-certs\") pod \"model-serving-api-6577596cd5-nzznf\" (UID: \"a2da778c-dbfc-4257-a01f-693abd213542\") " pod="opendatahub/model-serving-api-6577596cd5-nzznf"
Jun 03 01:46:25.836451 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.836416    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-889cb89c5-wsddf"
Jun 03 01:46:25.893082 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.892682    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-d5dt8"
Jun 03 01:46:25.928558 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.928460    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2da778c-dbfc-4257-a01f-693abd213542-tls-certs\") pod \"model-serving-api-6577596cd5-nzznf\" (UID: \"a2da778c-dbfc-4257-a01f-693abd213542\") " pod="opendatahub/model-serving-api-6577596cd5-nzznf"
Jun 03 01:46:25.929026 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.928619    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-58mz9\" (UniqueName: \"kubernetes.io/projected/a2da778c-dbfc-4257-a01f-693abd213542-kube-api-access-58mz9\") pod \"model-serving-api-6577596cd5-nzznf\" (UID: \"a2da778c-dbfc-4257-a01f-693abd213542\") " pod="opendatahub/model-serving-api-6577596cd5-nzznf"
Jun 03 01:46:25.929026 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:46:25.928666    2577 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jun 03 01:46:25.929026 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:46:25.928767    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2da778c-dbfc-4257-a01f-693abd213542-tls-certs podName:a2da778c-dbfc-4257-a01f-693abd213542 nodeName:}" failed. No retries permitted until 2026-06-03 01:46:26.42873225 +0000 UTC m=+355.993128106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a2da778c-dbfc-4257-a01f-693abd213542-tls-certs") pod "model-serving-api-6577596cd5-nzznf" (UID: "a2da778c-dbfc-4257-a01f-693abd213542") : secret "model-serving-api-tls" not found
Jun 03 01:46:25.939991 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.939952    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58mz9\" (UniqueName: \"kubernetes.io/projected/a2da778c-dbfc-4257-a01f-693abd213542-kube-api-access-58mz9\") pod \"model-serving-api-6577596cd5-nzznf\" (UID: \"a2da778c-dbfc-4257-a01f-693abd213542\") " pod="opendatahub/model-serving-api-6577596cd5-nzznf"
Jun 03 01:46:25.980698 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:25.980660    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-889cb89c5-wsddf"]
Jun 03 01:46:25.984672 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:46:25.984630    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f8daf2_fbfd_4d99_b7f0_449dec047cc8.slice/crio-26dd05475aa329f74192e0ad209cbf68cbac01725c4c5fd4105b55c75c043a44 WatchSource:0}: Error finding container 26dd05475aa329f74192e0ad209cbf68cbac01725c4c5fd4105b55c75c043a44: Status 404 returned error can't find the container with id 26dd05475aa329f74192e0ad209cbf68cbac01725c4c5fd4105b55c75c043a44
Jun 03 01:46:26.032399 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:26.032247    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-d5dt8"]
Jun 03 01:46:26.035113 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:46:26.035085    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33dc33a6_a326_4f70_bebd_d9b2479414f0.slice/crio-041683a0e0b63ea58b9a020c552151508e29b2602a02ec9f2ee30964d334cac6 WatchSource:0}: Error finding container 041683a0e0b63ea58b9a020c552151508e29b2602a02ec9f2ee30964d334cac6: Status 404 returned error can't find the container with id 041683a0e0b63ea58b9a020c552151508e29b2602a02ec9f2ee30964d334cac6
Jun 03 01:46:26.365967 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:26.365866    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-889cb89c5-wsddf" event={"ID":"75f8daf2-fbfd-4d99-b7f0-449dec047cc8","Type":"ContainerStarted","Data":"26dd05475aa329f74192e0ad209cbf68cbac01725c4c5fd4105b55c75c043a44"}
Jun 03 01:46:26.366979 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:26.366955    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-d5dt8" event={"ID":"33dc33a6-a326-4f70-bebd-d9b2479414f0","Type":"ContainerStarted","Data":"041683a0e0b63ea58b9a020c552151508e29b2602a02ec9f2ee30964d334cac6"}
Jun 03 01:46:26.434709 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:26.434668    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2da778c-dbfc-4257-a01f-693abd213542-tls-certs\") pod \"model-serving-api-6577596cd5-nzznf\" (UID: \"a2da778c-dbfc-4257-a01f-693abd213542\") " pod="opendatahub/model-serving-api-6577596cd5-nzznf"
Jun 03 01:46:26.437179 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:26.437149    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2da778c-dbfc-4257-a01f-693abd213542-tls-certs\") pod \"model-serving-api-6577596cd5-nzznf\" (UID: \"a2da778c-dbfc-4257-a01f-693abd213542\") " pod="opendatahub/model-serving-api-6577596cd5-nzznf"
Jun 03 01:46:26.570367 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:26.570327    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z"]
Jun 03 01:46:26.575454 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:26.575436    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z"
Jun 03 01:46:26.577901 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:26.577875    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 03 01:46:26.578030 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:26.577915    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 03 01:46:26.578871 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:26.578847    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qh4d6\""
Jun 03 01:46:26.581548 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:26.581524    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z"]
Jun 03 01:46:26.595919 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:26.595885    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-nzznf"
Jun 03 01:46:26.738200 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:26.737751    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f0acc6e-abdb-4839-ae6e-95cbe33ff480-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z\" (UID: \"9f0acc6e-abdb-4839-ae6e-95cbe33ff480\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z"
Jun 03 01:46:26.738200 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:26.737828    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f0acc6e-abdb-4839-ae6e-95cbe33ff480-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z\" (UID: \"9f0acc6e-abdb-4839-ae6e-95cbe33ff480\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z"
Jun 03 01:46:26.738200 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:26.737887    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj2qb\" (UniqueName: \"kubernetes.io/projected/9f0acc6e-abdb-4839-ae6e-95cbe33ff480-kube-api-access-cj2qb\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z\" (UID: \"9f0acc6e-abdb-4839-ae6e-95cbe33ff480\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z"
Jun 03 01:46:26.765000 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:26.764957    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-nzznf"]
Jun 03 01:46:26.769294 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:46:26.769259    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2da778c_dbfc_4257_a01f_693abd213542.slice/crio-2abf1fb2fa3b62b429650d9f2a6a23f1509608f8bcd4dac95c664b57cd52d78f WatchSource:0}: Error finding container 2abf1fb2fa3b62b429650d9f2a6a23f1509608f8bcd4dac95c664b57cd52d78f: Status 404 returned error can't find the container with id 2abf1fb2fa3b62b429650d9f2a6a23f1509608f8bcd4dac95c664b57cd52d78f
Jun 03 01:46:26.839419 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:26.839374    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f0acc6e-abdb-4839-ae6e-95cbe33ff480-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z\" (UID: \"9f0acc6e-abdb-4839-ae6e-95cbe33ff480\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z"
Jun 03 01:46:26.839661 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:26.839451    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f0acc6e-abdb-4839-ae6e-95cbe33ff480-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z\" (UID: \"9f0acc6e-abdb-4839-ae6e-95cbe33ff480\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z"
Jun 03 01:46:26.839661 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:26.839498    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cj2qb\" (UniqueName: \"kubernetes.io/projected/9f0acc6e-abdb-4839-ae6e-95cbe33ff480-kube-api-access-cj2qb\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z\" (UID: \"9f0acc6e-abdb-4839-ae6e-95cbe33ff480\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z"
Jun 03 01:46:26.839849 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:26.839825    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f0acc6e-abdb-4839-ae6e-95cbe33ff480-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z\" (UID: \"9f0acc6e-abdb-4839-ae6e-95cbe33ff480\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z"
Jun 03 01:46:26.839908 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:26.839865    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f0acc6e-abdb-4839-ae6e-95cbe33ff480-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z\" (UID: \"9f0acc6e-abdb-4839-ae6e-95cbe33ff480\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z"
Jun 03 01:46:26.847847 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:26.847793    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj2qb\" (UniqueName: \"kubernetes.io/projected/9f0acc6e-abdb-4839-ae6e-95cbe33ff480-kube-api-access-cj2qb\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z\" (UID: \"9f0acc6e-abdb-4839-ae6e-95cbe33ff480\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z"
Jun 03 01:46:26.885446 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:26.885410    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z"
Jun 03 01:46:27.060738 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:27.060673    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z"]
Jun 03 01:46:27.065564 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:46:27.065509    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f0acc6e_abdb_4839_ae6e_95cbe33ff480.slice/crio-53f05f8750bb89d61b707f42154ca795f166a80f3c3f45669eb79b296a74993b WatchSource:0}: Error finding container 53f05f8750bb89d61b707f42154ca795f166a80f3c3f45669eb79b296a74993b: Status 404 returned error can't find the container with id 53f05f8750bb89d61b707f42154ca795f166a80f3c3f45669eb79b296a74993b
Jun 03 01:46:27.375239 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:27.375198    2577 generic.go:358] "Generic (PLEG): container finished" podID="9f0acc6e-abdb-4839-ae6e-95cbe33ff480" containerID="04d8b1ea54f11330c15e5aa7a29c6539902fb579421f0a8634d52b38dc25f785" exitCode=0
Jun 03 01:46:27.375431 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:27.375311    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z" event={"ID":"9f0acc6e-abdb-4839-ae6e-95cbe33ff480","Type":"ContainerDied","Data":"04d8b1ea54f11330c15e5aa7a29c6539902fb579421f0a8634d52b38dc25f785"}
Jun 03 01:46:27.375431 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:27.375346    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z" event={"ID":"9f0acc6e-abdb-4839-ae6e-95cbe33ff480","Type":"ContainerStarted","Data":"53f05f8750bb89d61b707f42154ca795f166a80f3c3f45669eb79b296a74993b"}
Jun 03 01:46:27.378546 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:27.378477    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-nzznf" event={"ID":"a2da778c-dbfc-4257-a01f-693abd213542","Type":"ContainerStarted","Data":"2abf1fb2fa3b62b429650d9f2a6a23f1509608f8bcd4dac95c664b57cd52d78f"}
Jun 03 01:46:28.387953 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:28.387907    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z" event={"ID":"9f0acc6e-abdb-4839-ae6e-95cbe33ff480","Type":"ContainerStarted","Data":"f34afc6855e2215d9c306e1683514c6486d088ae4f191b66a421ebfd2b21b4b4"}
Jun 03 01:46:29.394483 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:29.394447    2577 generic.go:358] "Generic (PLEG): container finished" podID="9f0acc6e-abdb-4839-ae6e-95cbe33ff480" containerID="f34afc6855e2215d9c306e1683514c6486d088ae4f191b66a421ebfd2b21b4b4" exitCode=0
Jun 03 01:46:29.394952 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:29.394490    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z" event={"ID":"9f0acc6e-abdb-4839-ae6e-95cbe33ff480","Type":"ContainerDied","Data":"f34afc6855e2215d9c306e1683514c6486d088ae4f191b66a421ebfd2b21b4b4"}
Jun 03 01:46:31.246903 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:31.246882    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jun 03 01:46:31.405503 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:31.405445    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z" event={"ID":"9f0acc6e-abdb-4839-ae6e-95cbe33ff480","Type":"ContainerStarted","Data":"d4dc3fe63a1bb8af8218cf6b7a28c9025ba12d890ca025dd51a64796a7c82b6a"}
Jun 03 01:46:31.406906 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:31.406881    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-nzznf" event={"ID":"a2da778c-dbfc-4257-a01f-693abd213542","Type":"ContainerStarted","Data":"9276b1c7946ca71a95940329f77a2bad0b5941dc33b714ea938fe99ab7eb636c"}
Jun 03 01:46:31.407057 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:31.406931    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-nzznf"
Jun 03 01:46:31.408317 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:31.408295    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-889cb89c5-wsddf" event={"ID":"75f8daf2-fbfd-4d99-b7f0-449dec047cc8","Type":"ContainerStarted","Data":"8981b8658c0f86ba142a32c11e967dd48dd88b6db0d7a806a36cc2913862ebb9"}
Jun 03 01:46:31.409628 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:31.409607    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-d5dt8" event={"ID":"33dc33a6-a326-4f70-bebd-d9b2479414f0","Type":"ContainerStarted","Data":"ab6b205c9deaccf538fbfd620fc95f69e8fb5d514e4b56e6e81350224123e966"}
Jun 03 01:46:31.409718 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:31.409699    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-d5dt8"
Jun 03 01:46:31.449087 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:31.449031    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z" podStartSLOduration=4.609217937 podStartE2EDuration="5.449014672s" podCreationTimestamp="2026-06-03 01:46:26 +0000 UTC" firstStartedPulling="2026-06-03 01:46:27.377421986 +0000 UTC m=+356.941817781" lastFinishedPulling="2026-06-03 01:46:28.217218709 +0000 UTC m=+357.781614516" observedRunningTime="2026-06-03 01:46:31.44847674 +0000 UTC m=+361.012872550" watchObservedRunningTime="2026-06-03 01:46:31.449014672 +0000 UTC m=+361.013410482"
Jun 03 01:46:31.476251 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:31.476116    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-d5dt8" podStartSLOduration=2.272596975 podStartE2EDuration="7.476096841s" podCreationTimestamp="2026-06-03 01:46:24 +0000 UTC" firstStartedPulling="2026-06-03 01:46:26.036461086 +0000 UTC m=+355.600856875" lastFinishedPulling="2026-06-03 01:46:31.239960927 +0000 UTC m=+360.804356741" observedRunningTime="2026-06-03 01:46:31.474385021 +0000 UTC m=+361.038780836" watchObservedRunningTime="2026-06-03 01:46:31.476096841 +0000 UTC m=+361.040492661"
Jun 03 01:46:31.502923 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:31.497519    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-nzznf" podStartSLOduration=2.025298442 podStartE2EDuration="6.497227324s" podCreationTimestamp="2026-06-03 01:46:25 +0000 UTC" firstStartedPulling="2026-06-03 01:46:26.772640362 +0000 UTC m=+356.337036166" lastFinishedPulling="2026-06-03 01:46:31.244569259 +0000 UTC m=+360.808965048" observedRunningTime="2026-06-03 01:46:31.495370264 +0000 UTC m=+361.059766076" watchObservedRunningTime="2026-06-03 01:46:31.497227324 +0000 UTC m=+361.061623128"
Jun 03 01:46:31.517569 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:31.517512    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-889cb89c5-wsddf" podStartSLOduration=2.259718923 podStartE2EDuration="7.517496896s" podCreationTimestamp="2026-06-03 01:46:24 +0000 UTC" firstStartedPulling="2026-06-03 01:46:25.986674847 +0000 UTC m=+355.551070639" lastFinishedPulling="2026-06-03 01:46:31.244452817 +0000 UTC m=+360.808848612" observedRunningTime="2026-06-03 01:46:31.514858473 +0000 UTC m=+361.079254284" watchObservedRunningTime="2026-06-03 01:46:31.517496896 +0000 UTC m=+361.081892707"
Jun 03 01:46:32.415553 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:32.415511    2577 generic.go:358] "Generic (PLEG): container finished" podID="9f0acc6e-abdb-4839-ae6e-95cbe33ff480" containerID="d4dc3fe63a1bb8af8218cf6b7a28c9025ba12d890ca025dd51a64796a7c82b6a" exitCode=0
Jun 03 01:46:32.415960 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:32.415616    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z" event={"ID":"9f0acc6e-abdb-4839-ae6e-95cbe33ff480","Type":"ContainerDied","Data":"d4dc3fe63a1bb8af8218cf6b7a28c9025ba12d890ca025dd51a64796a7c82b6a"}
Jun 03 01:46:33.548563 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:33.548539    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z"
Jun 03 01:46:33.708929 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:33.708831    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f0acc6e-abdb-4839-ae6e-95cbe33ff480-bundle\") pod \"9f0acc6e-abdb-4839-ae6e-95cbe33ff480\" (UID: \"9f0acc6e-abdb-4839-ae6e-95cbe33ff480\") "
Jun 03 01:46:33.708929 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:33.708877    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cj2qb\" (UniqueName: \"kubernetes.io/projected/9f0acc6e-abdb-4839-ae6e-95cbe33ff480-kube-api-access-cj2qb\") pod \"9f0acc6e-abdb-4839-ae6e-95cbe33ff480\" (UID: \"9f0acc6e-abdb-4839-ae6e-95cbe33ff480\") "
Jun 03 01:46:33.708929 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:33.708917    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f0acc6e-abdb-4839-ae6e-95cbe33ff480-util\") pod \"9f0acc6e-abdb-4839-ae6e-95cbe33ff480\" (UID: \"9f0acc6e-abdb-4839-ae6e-95cbe33ff480\") "
Jun 03 01:46:33.709709 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:33.709680    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f0acc6e-abdb-4839-ae6e-95cbe33ff480-bundle" (OuterVolumeSpecName: "bundle") pod "9f0acc6e-abdb-4839-ae6e-95cbe33ff480" (UID: "9f0acc6e-abdb-4839-ae6e-95cbe33ff480"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 01:46:33.711108 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:33.711076    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f0acc6e-abdb-4839-ae6e-95cbe33ff480-kube-api-access-cj2qb" (OuterVolumeSpecName: "kube-api-access-cj2qb") pod "9f0acc6e-abdb-4839-ae6e-95cbe33ff480" (UID: "9f0acc6e-abdb-4839-ae6e-95cbe33ff480"). InnerVolumeSpecName "kube-api-access-cj2qb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:46:33.713001 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:33.712960    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f0acc6e-abdb-4839-ae6e-95cbe33ff480-util" (OuterVolumeSpecName: "util") pod "9f0acc6e-abdb-4839-ae6e-95cbe33ff480" (UID: "9f0acc6e-abdb-4839-ae6e-95cbe33ff480"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 01:46:33.810397 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:33.810349    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f0acc6e-abdb-4839-ae6e-95cbe33ff480-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:46:33.810397 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:33.810398    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cj2qb\" (UniqueName: \"kubernetes.io/projected/9f0acc6e-abdb-4839-ae6e-95cbe33ff480-kube-api-access-cj2qb\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:46:33.810627 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:33.810414    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f0acc6e-abdb-4839-ae6e-95cbe33ff480-util\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:46:34.424496 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:34.424458    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z" event={"ID":"9f0acc6e-abdb-4839-ae6e-95cbe33ff480","Type":"ContainerDied","Data":"53f05f8750bb89d61b707f42154ca795f166a80f3c3f45669eb79b296a74993b"}
Jun 03 01:46:34.424496 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:34.424500    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53f05f8750bb89d61b707f42154ca795f166a80f3c3f45669eb79b296a74993b"
Jun 03 01:46:34.424729 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:34.424476    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fd66z"
Jun 03 01:46:34.770914 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:34.770833    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-lngwz"]
Jun 03 01:46:34.771265 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:34.771183    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f0acc6e-abdb-4839-ae6e-95cbe33ff480" containerName="pull"
Jun 03 01:46:34.771265 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:34.771193    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f0acc6e-abdb-4839-ae6e-95cbe33ff480" containerName="pull"
Jun 03 01:46:34.771265 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:34.771204    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f0acc6e-abdb-4839-ae6e-95cbe33ff480" containerName="util"
Jun 03 01:46:34.771265 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:34.771209    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f0acc6e-abdb-4839-ae6e-95cbe33ff480" containerName="util"
Jun 03 01:46:34.771265 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:34.771246    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f0acc6e-abdb-4839-ae6e-95cbe33ff480" containerName="extract"
Jun 03 01:46:34.771265 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:34.771252    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f0acc6e-abdb-4839-ae6e-95cbe33ff480" containerName="extract"
Jun 03 01:46:34.771534 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:34.771344    2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f0acc6e-abdb-4839-ae6e-95cbe33ff480" containerName="extract"
Jun 03 01:46:34.777411 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:34.777385    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-lngwz"
Jun 03 01:46:34.780233 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:34.780208    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jun 03 01:46:34.780479 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:34.780458    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-vxlnz\""
Jun 03 01:46:34.789520 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:34.786238    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-69dns"]
Jun 03 01:46:34.791470 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:34.791415    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-lngwz"]
Jun 03 01:46:34.792423 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:34.791767    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-69dns"
Jun 03 01:46:34.809629 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:34.809290    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-rtvzr\""
Jun 03 01:46:34.809629 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:34.809374    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jun 03 01:46:34.812662 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:34.812627    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-69dns"]
Jun 03 01:46:34.920067 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:34.920029    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sgqz\" (UniqueName: \"kubernetes.io/projected/5945ffb4-861e-489c-ac58-07e0dfa8cb92-kube-api-access-2sgqz\") pod \"kserve-controller-manager-7c99ffcdcd-lngwz\" (UID: \"5945ffb4-861e-489c-ac58-07e0dfa8cb92\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-lngwz"
Jun 03 01:46:34.920265 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:34.920092    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d99277bb-4449-4aa2-a1e2-40f61893d4a0-cert\") pod \"llmisvc-controller-manager-c6b9847d7-69dns\" (UID: \"d99277bb-4449-4aa2-a1e2-40f61893d4a0\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-69dns"
Jun 03 01:46:34.920265 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:34.920165    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5945ffb4-861e-489c-ac58-07e0dfa8cb92-cert\") pod \"kserve-controller-manager-7c99ffcdcd-lngwz\" (UID: \"5945ffb4-861e-489c-ac58-07e0dfa8cb92\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-lngwz"
Jun 03 01:46:34.920265 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:34.920228    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hn6j\" (UniqueName: \"kubernetes.io/projected/d99277bb-4449-4aa2-a1e2-40f61893d4a0-kube-api-access-9hn6j\") pod \"llmisvc-controller-manager-c6b9847d7-69dns\" (UID: \"d99277bb-4449-4aa2-a1e2-40f61893d4a0\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-69dns"
Jun 03 01:46:35.021133 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:35.021040    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9hn6j\" (UniqueName: \"kubernetes.io/projected/d99277bb-4449-4aa2-a1e2-40f61893d4a0-kube-api-access-9hn6j\") pod \"llmisvc-controller-manager-c6b9847d7-69dns\" (UID: \"d99277bb-4449-4aa2-a1e2-40f61893d4a0\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-69dns"
Jun 03 01:46:35.021133 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:35.021086    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2sgqz\" (UniqueName: \"kubernetes.io/projected/5945ffb4-861e-489c-ac58-07e0dfa8cb92-kube-api-access-2sgqz\") pod \"kserve-controller-manager-7c99ffcdcd-lngwz\" (UID: \"5945ffb4-861e-489c-ac58-07e0dfa8cb92\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-lngwz"
Jun 03 01:46:35.021133 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:35.021119    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d99277bb-4449-4aa2-a1e2-40f61893d4a0-cert\") pod \"llmisvc-controller-manager-c6b9847d7-69dns\" (UID: \"d99277bb-4449-4aa2-a1e2-40f61893d4a0\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-69dns"
Jun 03 01:46:35.021403 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:35.021167    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5945ffb4-861e-489c-ac58-07e0dfa8cb92-cert\") pod \"kserve-controller-manager-7c99ffcdcd-lngwz\" (UID: \"5945ffb4-861e-489c-ac58-07e0dfa8cb92\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-lngwz"
Jun 03 01:46:35.021403 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:46:35.021262    2577 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jun 03 01:46:35.021403 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:46:35.021326    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5945ffb4-861e-489c-ac58-07e0dfa8cb92-cert podName:5945ffb4-861e-489c-ac58-07e0dfa8cb92 nodeName:}" failed. No retries permitted until 2026-06-03 01:46:35.521304146 +0000 UTC m=+365.085699936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5945ffb4-861e-489c-ac58-07e0dfa8cb92-cert") pod "kserve-controller-manager-7c99ffcdcd-lngwz" (UID: "5945ffb4-861e-489c-ac58-07e0dfa8cb92") : secret "kserve-webhook-server-cert" not found
Jun 03 01:46:35.023775 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:35.023746    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d99277bb-4449-4aa2-a1e2-40f61893d4a0-cert\") pod \"llmisvc-controller-manager-c6b9847d7-69dns\" (UID: \"d99277bb-4449-4aa2-a1e2-40f61893d4a0\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-69dns"
Jun 03 01:46:35.043443 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:35.043412    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sgqz\" (UniqueName: \"kubernetes.io/projected/5945ffb4-861e-489c-ac58-07e0dfa8cb92-kube-api-access-2sgqz\") pod \"kserve-controller-manager-7c99ffcdcd-lngwz\" (UID: \"5945ffb4-861e-489c-ac58-07e0dfa8cb92\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-lngwz"
Jun 03 01:46:35.044470 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:35.044449    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hn6j\" (UniqueName: \"kubernetes.io/projected/d99277bb-4449-4aa2-a1e2-40f61893d4a0-kube-api-access-9hn6j\") pod \"llmisvc-controller-manager-c6b9847d7-69dns\" (UID: \"d99277bb-4449-4aa2-a1e2-40f61893d4a0\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-69dns"
Jun 03 01:46:35.120909 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:35.120870    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-69dns"
Jun 03 01:46:35.265601 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:35.265556    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-69dns"]
Jun 03 01:46:35.267669 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:46:35.267631    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd99277bb_4449_4aa2_a1e2_40f61893d4a0.slice/crio-5da6f349480c9e47a92ae590ad6d5550f72a523b3c2afa9ec7553a6477f22cb9 WatchSource:0}: Error finding container 5da6f349480c9e47a92ae590ad6d5550f72a523b3c2afa9ec7553a6477f22cb9: Status 404 returned error can't find the container with id 5da6f349480c9e47a92ae590ad6d5550f72a523b3c2afa9ec7553a6477f22cb9
Jun 03 01:46:35.429071 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:35.429028    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-69dns" event={"ID":"d99277bb-4449-4aa2-a1e2-40f61893d4a0","Type":"ContainerStarted","Data":"5da6f349480c9e47a92ae590ad6d5550f72a523b3c2afa9ec7553a6477f22cb9"}
Jun 03 01:46:35.525032 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:35.524936    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5945ffb4-861e-489c-ac58-07e0dfa8cb92-cert\") pod \"kserve-controller-manager-7c99ffcdcd-lngwz\" (UID: \"5945ffb4-861e-489c-ac58-07e0dfa8cb92\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-lngwz"
Jun 03 01:46:35.527357 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:35.527324    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5945ffb4-861e-489c-ac58-07e0dfa8cb92-cert\") pod \"kserve-controller-manager-7c99ffcdcd-lngwz\" (UID: \"5945ffb4-861e-489c-ac58-07e0dfa8cb92\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-lngwz"
Jun 03 01:46:35.693337 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:35.693299    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-lngwz"
Jun 03 01:46:35.851354 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:35.851324    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-lngwz"]
Jun 03 01:46:35.852907 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:46:35.852873    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5945ffb4_861e_489c_ac58_07e0dfa8cb92.slice/crio-8d21dfa48b4300004d6371e508326f6c68e3454642cae35cdc900f0c31b49615 WatchSource:0}: Error finding container 8d21dfa48b4300004d6371e508326f6c68e3454642cae35cdc900f0c31b49615: Status 404 returned error can't find the container with id 8d21dfa48b4300004d6371e508326f6c68e3454642cae35cdc900f0c31b49615
Jun 03 01:46:36.442745 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:36.442677    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-lngwz" event={"ID":"5945ffb4-861e-489c-ac58-07e0dfa8cb92","Type":"ContainerStarted","Data":"8d21dfa48b4300004d6371e508326f6c68e3454642cae35cdc900f0c31b49615"}
Jun 03 01:46:39.455488 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:39.455451    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-69dns" event={"ID":"d99277bb-4449-4aa2-a1e2-40f61893d4a0","Type":"ContainerStarted","Data":"b768be3d5e0189b69d958bb144c97edc9d9baba5c1cb64b02c50c536db1ad5fb"}
Jun 03 01:46:39.455947 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:39.455609    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-69dns"
Jun 03 01:46:39.456876 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:39.456854    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-lngwz" event={"ID":"5945ffb4-861e-489c-ac58-07e0dfa8cb92","Type":"ContainerStarted","Data":"aa77c60604d892398615077360df075be339648c50af8c29c50eb55b8b4e465d"}
Jun 03 01:46:39.456955 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:39.456908    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-lngwz"
Jun 03 01:46:39.486242 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:39.486187    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-69dns" podStartSLOduration=1.902664844 podStartE2EDuration="5.486170912s" podCreationTimestamp="2026-06-03 01:46:34 +0000 UTC" firstStartedPulling="2026-06-03 01:46:35.269407629 +0000 UTC m=+364.833803418" lastFinishedPulling="2026-06-03 01:46:38.852913683 +0000 UTC m=+368.417309486" observedRunningTime="2026-06-03 01:46:39.484382675 +0000 UTC m=+369.048778488" watchObservedRunningTime="2026-06-03 01:46:39.486170912 +0000 UTC m=+369.050566716"
Jun 03 01:46:39.520577 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:39.520523    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-lngwz" podStartSLOduration=2.5188746379999998 podStartE2EDuration="5.520508584s" podCreationTimestamp="2026-06-03 01:46:34 +0000 UTC" firstStartedPulling="2026-06-03 01:46:35.854155716 +0000 UTC m=+365.418551510" lastFinishedPulling="2026-06-03 01:46:38.855789658 +0000 UTC m=+368.420185456" observedRunningTime="2026-06-03 01:46:39.517639666 +0000 UTC m=+369.082035478" watchObservedRunningTime="2026-06-03 01:46:39.520508584 +0000 UTC m=+369.084904394"
Jun 03 01:46:41.202219 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:41.202183    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7"]
Jun 03 01:46:41.302838 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:41.302799    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7"]
Jun 03 01:46:41.303006 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:41.302934    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7"
Jun 03 01:46:41.305620 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:41.305569    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 03 01:46:41.305736 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:41.305669    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 03 01:46:41.306633 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:41.306609    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qh4d6\""
Jun 03 01:46:41.385645 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:41.385599    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tqrr\" (UniqueName: \"kubernetes.io/projected/bf7cec83-7d5c-48fb-a457-f5422f84747f-kube-api-access-8tqrr\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7\" (UID: \"bf7cec83-7d5c-48fb-a457-f5422f84747f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7"
Jun 03 01:46:41.385845 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:41.385669    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf7cec83-7d5c-48fb-a457-f5422f84747f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7\" (UID: \"bf7cec83-7d5c-48fb-a457-f5422f84747f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7"
Jun 03 01:46:41.385845 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:41.385740    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf7cec83-7d5c-48fb-a457-f5422f84747f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7\" (UID: \"bf7cec83-7d5c-48fb-a457-f5422f84747f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7"
Jun 03 01:46:41.486293 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:41.486188    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8tqrr\" (UniqueName: \"kubernetes.io/projected/bf7cec83-7d5c-48fb-a457-f5422f84747f-kube-api-access-8tqrr\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7\" (UID: \"bf7cec83-7d5c-48fb-a457-f5422f84747f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7"
Jun 03 01:46:41.486293 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:41.486243    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf7cec83-7d5c-48fb-a457-f5422f84747f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7\" (UID: \"bf7cec83-7d5c-48fb-a457-f5422f84747f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7"
Jun 03 01:46:41.486293 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:41.486289    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf7cec83-7d5c-48fb-a457-f5422f84747f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7\" (UID: \"bf7cec83-7d5c-48fb-a457-f5422f84747f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7"
Jun 03 01:46:41.486686 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:41.486669    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf7cec83-7d5c-48fb-a457-f5422f84747f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7\" (UID: \"bf7cec83-7d5c-48fb-a457-f5422f84747f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7"
Jun 03 01:46:41.486744 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:41.486723    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf7cec83-7d5c-48fb-a457-f5422f84747f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7\" (UID: \"bf7cec83-7d5c-48fb-a457-f5422f84747f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7"
Jun 03 01:46:41.494733 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:41.494710    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tqrr\" (UniqueName: \"kubernetes.io/projected/bf7cec83-7d5c-48fb-a457-f5422f84747f-kube-api-access-8tqrr\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7\" (UID: \"bf7cec83-7d5c-48fb-a457-f5422f84747f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7"
Jun 03 01:46:41.612663 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:41.612625    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7"
Jun 03 01:46:41.766224 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:41.766194    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7"]
Jun 03 01:46:41.767208 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:46:41.767179    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf7cec83_7d5c_48fb_a457_f5422f84747f.slice/crio-6a1f2da699d2361cf6629ab3d14a92605450d28c75b9606a63f245e7311052b4 WatchSource:0}: Error finding container 6a1f2da699d2361cf6629ab3d14a92605450d28c75b9606a63f245e7311052b4: Status 404 returned error can't find the container with id 6a1f2da699d2361cf6629ab3d14a92605450d28c75b9606a63f245e7311052b4
Jun 03 01:46:42.419081 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:42.419050    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-d5dt8"
Jun 03 01:46:42.420833 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:42.420813    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-nzznf"
Jun 03 01:46:42.429947 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:42.429917    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-xshmk"]
Jun 03 01:46:42.445935 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:42.445906    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xshmk"
Jun 03 01:46:42.448768 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:42.448728    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
Jun 03 01:46:42.448768 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:42.448728    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
Jun 03 01:46:42.449438 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:42.449408    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-478gn\""
Jun 03 01:46:42.453964 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:42.453936    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-xshmk"]
Jun 03 01:46:42.472093 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:42.472055    2577 generic.go:358] "Generic (PLEG): container finished" podID="bf7cec83-7d5c-48fb-a457-f5422f84747f" containerID="42c316eb7c53c089aa60e00c5c91468a88807cc53ac4bc20079df39025b77922" exitCode=0
Jun 03 01:46:42.472274 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:42.472118    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7" event={"ID":"bf7cec83-7d5c-48fb-a457-f5422f84747f","Type":"ContainerDied","Data":"42c316eb7c53c089aa60e00c5c91468a88807cc53ac4bc20079df39025b77922"}
Jun 03 01:46:42.472274 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:42.472145    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7" event={"ID":"bf7cec83-7d5c-48fb-a457-f5422f84747f","Type":"ContainerStarted","Data":"6a1f2da699d2361cf6629ab3d14a92605450d28c75b9606a63f245e7311052b4"}
Jun 03 01:46:42.497213 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:42.497178    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgdfh\" (UniqueName: \"kubernetes.io/projected/0ec74d54-1946-4622-b1f4-43a36160c3eb-kube-api-access-mgdfh\") pod \"servicemesh-operator3-55f49c5f94-xshmk\" (UID: \"0ec74d54-1946-4622-b1f4-43a36160c3eb\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xshmk"
Jun 03 01:46:42.497371 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:42.497318    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0ec74d54-1946-4622-b1f4-43a36160c3eb-operator-config\") pod \"servicemesh-operator3-55f49c5f94-xshmk\" (UID: \"0ec74d54-1946-4622-b1f4-43a36160c3eb\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xshmk"
Jun 03 01:46:42.598366 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:42.598324    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mgdfh\" (UniqueName: \"kubernetes.io/projected/0ec74d54-1946-4622-b1f4-43a36160c3eb-kube-api-access-mgdfh\") pod \"servicemesh-operator3-55f49c5f94-xshmk\" (UID: \"0ec74d54-1946-4622-b1f4-43a36160c3eb\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xshmk"
Jun 03 01:46:42.598543 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:42.598378    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0ec74d54-1946-4622-b1f4-43a36160c3eb-operator-config\") pod \"servicemesh-operator3-55f49c5f94-xshmk\" (UID: \"0ec74d54-1946-4622-b1f4-43a36160c3eb\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xshmk"
Jun 03 01:46:42.600943 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:42.600913    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0ec74d54-1946-4622-b1f4-43a36160c3eb-operator-config\") pod \"servicemesh-operator3-55f49c5f94-xshmk\" (UID: \"0ec74d54-1946-4622-b1f4-43a36160c3eb\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xshmk"
Jun 03 01:46:42.606157 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:42.606130    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgdfh\" (UniqueName: \"kubernetes.io/projected/0ec74d54-1946-4622-b1f4-43a36160c3eb-kube-api-access-mgdfh\") pod \"servicemesh-operator3-55f49c5f94-xshmk\" (UID: \"0ec74d54-1946-4622-b1f4-43a36160c3eb\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xshmk"
Jun 03 01:46:42.758025 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:42.757934    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xshmk"
Jun 03 01:46:42.929148 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:42.929115    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-xshmk"]
Jun 03 01:46:42.930385 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:46:42.930354    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec74d54_1946_4622_b1f4_43a36160c3eb.slice/crio-5150cf2feed8d952bbc9e62f87e8d70db6c79d2e882885dba5d7cf4f43feadeb WatchSource:0}: Error finding container 5150cf2feed8d952bbc9e62f87e8d70db6c79d2e882885dba5d7cf4f43feadeb: Status 404 returned error can't find the container with id 5150cf2feed8d952bbc9e62f87e8d70db6c79d2e882885dba5d7cf4f43feadeb
Jun 03 01:46:43.476754 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:43.476721    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xshmk" event={"ID":"0ec74d54-1946-4622-b1f4-43a36160c3eb","Type":"ContainerStarted","Data":"5150cf2feed8d952bbc9e62f87e8d70db6c79d2e882885dba5d7cf4f43feadeb"}
Jun 03 01:46:45.485832 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:45.485798    2577 generic.go:358] "Generic (PLEG): container finished" podID="bf7cec83-7d5c-48fb-a457-f5422f84747f" containerID="70a8d87eb68cb3c0358a477ef44f609405e970146685d349ec15efbd1d8573ce" exitCode=0
Jun 03 01:46:45.486243 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:45.485892    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7" event={"ID":"bf7cec83-7d5c-48fb-a457-f5422f84747f","Type":"ContainerDied","Data":"70a8d87eb68cb3c0358a477ef44f609405e970146685d349ec15efbd1d8573ce"}
Jun 03 01:46:46.491151 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:46.491117    2577 generic.go:358] "Generic (PLEG): container finished" podID="bf7cec83-7d5c-48fb-a457-f5422f84747f" containerID="5dfe10579034552b542a1aec77ab91e16c22b706226ac827d6e83e14eb1b7fdf" exitCode=0
Jun 03 01:46:46.491608 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:46.491211    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7" event={"ID":"bf7cec83-7d5c-48fb-a457-f5422f84747f","Type":"ContainerDied","Data":"5dfe10579034552b542a1aec77ab91e16c22b706226ac827d6e83e14eb1b7fdf"}
Jun 03 01:46:46.492730 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:46.492707    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xshmk" event={"ID":"0ec74d54-1946-4622-b1f4-43a36160c3eb","Type":"ContainerStarted","Data":"d7d02f46caa417964e5a4b8a7aa7a20fc7c126634282416e3ca90d3b3b36e9f7"}
Jun 03 01:46:46.492889 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:46.492874    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xshmk"
Jun 03 01:46:46.522573 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:46.522521    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xshmk" podStartSLOduration=1.808593041 podStartE2EDuration="4.522504648s" podCreationTimestamp="2026-06-03 01:46:42 +0000 UTC" firstStartedPulling="2026-06-03 01:46:42.933152036 +0000 UTC m=+372.497547825" lastFinishedPulling="2026-06-03 01:46:45.647063629 +0000 UTC m=+375.211459432" observedRunningTime="2026-06-03 01:46:46.52119635 +0000 UTC m=+376.085592380" watchObservedRunningTime="2026-06-03 01:46:46.522504648 +0000 UTC m=+376.086900459"
Jun 03 01:46:47.630253 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:47.630228    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7"
Jun 03 01:46:47.751147 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:47.751059    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf7cec83-7d5c-48fb-a457-f5422f84747f-util\") pod \"bf7cec83-7d5c-48fb-a457-f5422f84747f\" (UID: \"bf7cec83-7d5c-48fb-a457-f5422f84747f\") "
Jun 03 01:46:47.751297 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:47.751149    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf7cec83-7d5c-48fb-a457-f5422f84747f-bundle\") pod \"bf7cec83-7d5c-48fb-a457-f5422f84747f\" (UID: \"bf7cec83-7d5c-48fb-a457-f5422f84747f\") "
Jun 03 01:46:47.751297 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:47.751179    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tqrr\" (UniqueName: \"kubernetes.io/projected/bf7cec83-7d5c-48fb-a457-f5422f84747f-kube-api-access-8tqrr\") pod \"bf7cec83-7d5c-48fb-a457-f5422f84747f\" (UID: \"bf7cec83-7d5c-48fb-a457-f5422f84747f\") "
Jun 03 01:46:47.752242 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:47.752208    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf7cec83-7d5c-48fb-a457-f5422f84747f-bundle" (OuterVolumeSpecName: "bundle") pod "bf7cec83-7d5c-48fb-a457-f5422f84747f" (UID: "bf7cec83-7d5c-48fb-a457-f5422f84747f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 01:46:47.753382 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:47.753358    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf7cec83-7d5c-48fb-a457-f5422f84747f-kube-api-access-8tqrr" (OuterVolumeSpecName: "kube-api-access-8tqrr") pod "bf7cec83-7d5c-48fb-a457-f5422f84747f" (UID: "bf7cec83-7d5c-48fb-a457-f5422f84747f"). InnerVolumeSpecName "kube-api-access-8tqrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:46:47.755522 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:47.755485    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf7cec83-7d5c-48fb-a457-f5422f84747f-util" (OuterVolumeSpecName: "util") pod "bf7cec83-7d5c-48fb-a457-f5422f84747f" (UID: "bf7cec83-7d5c-48fb-a457-f5422f84747f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 01:46:47.852223 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:47.852188    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf7cec83-7d5c-48fb-a457-f5422f84747f-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:46:47.852223 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:47.852218    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tqrr\" (UniqueName: \"kubernetes.io/projected/bf7cec83-7d5c-48fb-a457-f5422f84747f-kube-api-access-8tqrr\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:46:47.852223 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:47.852227    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf7cec83-7d5c-48fb-a457-f5422f84747f-util\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:46:48.502267 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:48.502237    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7"
Jun 03 01:46:48.502439 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:48.502239    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5lvp7" event={"ID":"bf7cec83-7d5c-48fb-a457-f5422f84747f","Type":"ContainerDied","Data":"6a1f2da699d2361cf6629ab3d14a92605450d28c75b9606a63f245e7311052b4"}
Jun 03 01:46:48.502439 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:48.502334    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a1f2da699d2361cf6629ab3d14a92605450d28c75b9606a63f245e7311052b4"
Jun 03 01:46:55.451420 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.451383    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"]
Jun 03 01:46:55.451935 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.451797    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf7cec83-7d5c-48fb-a457-f5422f84747f" containerName="util"
Jun 03 01:46:55.451935 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.451809    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf7cec83-7d5c-48fb-a457-f5422f84747f" containerName="util"
Jun 03 01:46:55.451935 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.451817    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf7cec83-7d5c-48fb-a457-f5422f84747f" containerName="pull"
Jun 03 01:46:55.451935 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.451824    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf7cec83-7d5c-48fb-a457-f5422f84747f" containerName="pull"
Jun 03 01:46:55.451935 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.451830    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf7cec83-7d5c-48fb-a457-f5422f84747f" containerName="extract"
Jun 03 01:46:55.451935 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.451837    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf7cec83-7d5c-48fb-a457-f5422f84747f" containerName="extract"
Jun 03 01:46:55.451935 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.451896    2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="bf7cec83-7d5c-48fb-a457-f5422f84747f" containerName="extract"
Jun 03 01:46:55.456396 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.456377    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"
Jun 03 01:46:55.458996 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.458971    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jun 03 01:46:55.458996 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.458972    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jun 03 01:46:55.459176 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.458979    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jun 03 01:46:55.459176 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.458975    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jun 03 01:46:55.459176 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.459082    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zsqts\""
Jun 03 01:46:55.467250 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.467225    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"]
Jun 03 01:46:55.519997 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.519964    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/320700f9-b5e3-46bf-94c4-eacd95b37173-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-dc6ng\" (UID: \"320700f9-b5e3-46bf-94c4-eacd95b37173\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"
Jun 03 01:46:55.520176 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.520002    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/320700f9-b5e3-46bf-94c4-eacd95b37173-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-dc6ng\" (UID: \"320700f9-b5e3-46bf-94c4-eacd95b37173\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"
Jun 03 01:46:55.520176 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.520037    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/320700f9-b5e3-46bf-94c4-eacd95b37173-cacerts\") pod \"istiod-openshift-gateway-798958bb55-dc6ng\" (UID: \"320700f9-b5e3-46bf-94c4-eacd95b37173\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"
Jun 03 01:46:55.520176 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.520080    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/320700f9-b5e3-46bf-94c4-eacd95b37173-istio-token\") pod \"istiod-openshift-gateway-798958bb55-dc6ng\" (UID: \"320700f9-b5e3-46bf-94c4-eacd95b37173\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"
Jun 03 01:46:55.520176 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.520101    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpg2r\" (UniqueName: \"kubernetes.io/projected/320700f9-b5e3-46bf-94c4-eacd95b37173-kube-api-access-tpg2r\") pod \"istiod-openshift-gateway-798958bb55-dc6ng\" (UID: \"320700f9-b5e3-46bf-94c4-eacd95b37173\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"
Jun 03 01:46:55.520342 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.520174    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/320700f9-b5e3-46bf-94c4-eacd95b37173-local-certs\") pod \"istiod-openshift-gateway-798958bb55-dc6ng\" (UID: \"320700f9-b5e3-46bf-94c4-eacd95b37173\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"
Jun 03 01:46:55.520342 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.520226    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/320700f9-b5e3-46bf-94c4-eacd95b37173-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-dc6ng\" (UID: \"320700f9-b5e3-46bf-94c4-eacd95b37173\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"
Jun 03 01:46:55.622513 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.622474    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/320700f9-b5e3-46bf-94c4-eacd95b37173-local-certs\") pod \"istiod-openshift-gateway-798958bb55-dc6ng\" (UID: \"320700f9-b5e3-46bf-94c4-eacd95b37173\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"
Jun 03 01:46:55.622739 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.622529    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/320700f9-b5e3-46bf-94c4-eacd95b37173-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-dc6ng\" (UID: \"320700f9-b5e3-46bf-94c4-eacd95b37173\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"
Jun 03 01:46:55.622739 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.622666    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/320700f9-b5e3-46bf-94c4-eacd95b37173-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-dc6ng\" (UID: \"320700f9-b5e3-46bf-94c4-eacd95b37173\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"
Jun 03 01:46:55.622739 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.622716    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/320700f9-b5e3-46bf-94c4-eacd95b37173-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-dc6ng\" (UID: \"320700f9-b5e3-46bf-94c4-eacd95b37173\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"
Jun 03 01:46:55.622916 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.622752    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/320700f9-b5e3-46bf-94c4-eacd95b37173-cacerts\") pod \"istiod-openshift-gateway-798958bb55-dc6ng\" (UID: \"320700f9-b5e3-46bf-94c4-eacd95b37173\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"
Jun 03 01:46:55.622916 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.622805    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/320700f9-b5e3-46bf-94c4-eacd95b37173-istio-token\") pod \"istiod-openshift-gateway-798958bb55-dc6ng\" (UID: \"320700f9-b5e3-46bf-94c4-eacd95b37173\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"
Jun 03 01:46:55.622916 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.622840    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tpg2r\" (UniqueName: \"kubernetes.io/projected/320700f9-b5e3-46bf-94c4-eacd95b37173-kube-api-access-tpg2r\") pod \"istiod-openshift-gateway-798958bb55-dc6ng\" (UID: \"320700f9-b5e3-46bf-94c4-eacd95b37173\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"
Jun 03 01:46:55.623397 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.623330    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/320700f9-b5e3-46bf-94c4-eacd95b37173-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-dc6ng\" (UID: \"320700f9-b5e3-46bf-94c4-eacd95b37173\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"
Jun 03 01:46:55.625572 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.625545    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/320700f9-b5e3-46bf-94c4-eacd95b37173-cacerts\") pod \"istiod-openshift-gateway-798958bb55-dc6ng\" (UID: \"320700f9-b5e3-46bf-94c4-eacd95b37173\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"
Jun 03 01:46:55.625691 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.625575    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/320700f9-b5e3-46bf-94c4-eacd95b37173-local-certs\") pod \"istiod-openshift-gateway-798958bb55-dc6ng\" (UID: \"320700f9-b5e3-46bf-94c4-eacd95b37173\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"
Jun 03 01:46:55.625691 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.625573    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/320700f9-b5e3-46bf-94c4-eacd95b37173-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-dc6ng\" (UID: \"320700f9-b5e3-46bf-94c4-eacd95b37173\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"
Jun 03 01:46:55.625691 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.625648    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/320700f9-b5e3-46bf-94c4-eacd95b37173-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-dc6ng\" (UID: \"320700f9-b5e3-46bf-94c4-eacd95b37173\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"
Jun 03 01:46:55.630639 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.630609    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/320700f9-b5e3-46bf-94c4-eacd95b37173-istio-token\") pod \"istiod-openshift-gateway-798958bb55-dc6ng\" (UID: \"320700f9-b5e3-46bf-94c4-eacd95b37173\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"
Jun 03 01:46:55.630743 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.630617    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpg2r\" (UniqueName: \"kubernetes.io/projected/320700f9-b5e3-46bf-94c4-eacd95b37173-kube-api-access-tpg2r\") pod \"istiod-openshift-gateway-798958bb55-dc6ng\" (UID: \"320700f9-b5e3-46bf-94c4-eacd95b37173\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"
Jun 03 01:46:55.766840 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.766728    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"
Jun 03 01:46:55.912413 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:55.912371    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"]
Jun 03 01:46:55.918424 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:46:55.918394    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod320700f9_b5e3_46bf_94c4_eacd95b37173.slice/crio-5b7903f06563a46f312600184b751267488d0b30f3f8129f17ec35679274c1b7 WatchSource:0}: Error finding container 5b7903f06563a46f312600184b751267488d0b30f3f8129f17ec35679274c1b7: Status 404 returned error can't find the container with id 5b7903f06563a46f312600184b751267488d0b30f3f8129f17ec35679274c1b7
Jun 03 01:46:56.533256 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:56.533218    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng" event={"ID":"320700f9-b5e3-46bf-94c4-eacd95b37173","Type":"ContainerStarted","Data":"5b7903f06563a46f312600184b751267488d0b30f3f8129f17ec35679274c1b7"}
Jun 03 01:46:57.499122 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:57.499087    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xshmk"
Jun 03 01:46:58.518605 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:58.518552    2577 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jun 03 01:46:58.518906 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:58.518637    2577 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jun 03 01:46:59.547305 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:59.547273    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng" event={"ID":"320700f9-b5e3-46bf-94c4-eacd95b37173","Type":"ContainerStarted","Data":"f9883dff3b3e0bc50c5b92131c3ac942caeeb25ed3805b0af709babf19f8a6ce"}
Jun 03 01:46:59.547758 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:59.547461    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"
Jun 03 01:46:59.549175 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:59.549143    2577 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-dc6ng container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jun 03 01:46:59.549296 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:59.549202    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng" podUID="320700f9-b5e3-46bf-94c4-eacd95b37173" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 01:46:59.566261 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:46:59.566209    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng" podStartSLOduration=1.9683709710000001 podStartE2EDuration="4.566190777s" podCreationTimestamp="2026-06-03 01:46:55 +0000 UTC" firstStartedPulling="2026-06-03 01:46:55.920461926 +0000 UTC m=+385.484857715" lastFinishedPulling="2026-06-03 01:46:58.518281718 +0000 UTC m=+388.082677521" observedRunningTime="2026-06-03 01:46:59.56543771 +0000 UTC m=+389.129833526" watchObservedRunningTime="2026-06-03 01:46:59.566190777 +0000 UTC m=+389.130586589"
Jun 03 01:47:00.551882 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:00.551854    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dc6ng"
Jun 03 01:47:00.900106 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:00.900075    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7b94c665b4-8jbrx"]
Jun 03 01:47:00.903872 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:00.903848    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7b94c665b4-8jbrx"
Jun 03 01:47:00.906554 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:00.906316    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\""
Jun 03 01:47:00.906706 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:00.906620    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-55gst\""
Jun 03 01:47:00.916516 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:00.916438    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7b94c665b4-8jbrx"]
Jun 03 01:47:00.983219 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:00.983182    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/637bf8fb-391b-493c-94b9-1299f18b3e66-redirect-config\") pod \"dashboard-redirect-7b94c665b4-8jbrx\" (UID: \"637bf8fb-391b-493c-94b9-1299f18b3e66\") " pod="opendatahub/dashboard-redirect-7b94c665b4-8jbrx"
Jun 03 01:47:00.983379 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:00.983293    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkcr7\" (UniqueName: \"kubernetes.io/projected/637bf8fb-391b-493c-94b9-1299f18b3e66-kube-api-access-jkcr7\") pod \"dashboard-redirect-7b94c665b4-8jbrx\" (UID: \"637bf8fb-391b-493c-94b9-1299f18b3e66\") " pod="opendatahub/dashboard-redirect-7b94c665b4-8jbrx"
Jun 03 01:47:01.084830 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:01.084792    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jkcr7\" (UniqueName: \"kubernetes.io/projected/637bf8fb-391b-493c-94b9-1299f18b3e66-kube-api-access-jkcr7\") pod \"dashboard-redirect-7b94c665b4-8jbrx\" (UID: \"637bf8fb-391b-493c-94b9-1299f18b3e66\") " pod="opendatahub/dashboard-redirect-7b94c665b4-8jbrx"
Jun 03 01:47:01.085046 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:01.084908    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/637bf8fb-391b-493c-94b9-1299f18b3e66-redirect-config\") pod \"dashboard-redirect-7b94c665b4-8jbrx\" (UID: \"637bf8fb-391b-493c-94b9-1299f18b3e66\") " pod="opendatahub/dashboard-redirect-7b94c665b4-8jbrx"
Jun 03 01:47:01.085764 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:01.085728    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/637bf8fb-391b-493c-94b9-1299f18b3e66-redirect-config\") pod \"dashboard-redirect-7b94c665b4-8jbrx\" (UID: \"637bf8fb-391b-493c-94b9-1299f18b3e66\") " pod="opendatahub/dashboard-redirect-7b94c665b4-8jbrx"
Jun 03 01:47:01.093307 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:01.093277    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkcr7\" (UniqueName: \"kubernetes.io/projected/637bf8fb-391b-493c-94b9-1299f18b3e66-kube-api-access-jkcr7\") pod \"dashboard-redirect-7b94c665b4-8jbrx\" (UID: \"637bf8fb-391b-493c-94b9-1299f18b3e66\") " pod="opendatahub/dashboard-redirect-7b94c665b4-8jbrx"
Jun 03 01:47:01.218374 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:01.218272    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7b94c665b4-8jbrx"
Jun 03 01:47:01.382522 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:01.382474    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7b94c665b4-8jbrx"]
Jun 03 01:47:01.384096 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:47:01.384066    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod637bf8fb_391b_493c_94b9_1299f18b3e66.slice/crio-5988e7c877dced97522942f401ac3a237053f07832fcf49c3b204c61240dcc73 WatchSource:0}: Error finding container 5988e7c877dced97522942f401ac3a237053f07832fcf49c3b204c61240dcc73: Status 404 returned error can't find the container with id 5988e7c877dced97522942f401ac3a237053f07832fcf49c3b204c61240dcc73
Jun 03 01:47:01.556041 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:01.555941    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7b94c665b4-8jbrx" event={"ID":"637bf8fb-391b-493c-94b9-1299f18b3e66","Type":"ContainerStarted","Data":"5988e7c877dced97522942f401ac3a237053f07832fcf49c3b204c61240dcc73"}
Jun 03 01:47:04.573111 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:04.573074    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7b94c665b4-8jbrx" event={"ID":"637bf8fb-391b-493c-94b9-1299f18b3e66","Type":"ContainerStarted","Data":"e153a91e0b0b4598df8e0bc3fd8fd8068e12d322fa1be9411fa7c3ec3eefb88f"}
Jun 03 01:47:04.589057 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:04.588991    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7b94c665b4-8jbrx" podStartSLOduration=2.487318199 podStartE2EDuration="4.588974501s" podCreationTimestamp="2026-06-03 01:47:00 +0000 UTC" firstStartedPulling="2026-06-03 01:47:01.385603059 +0000 UTC m=+390.949998848" lastFinishedPulling="2026-06-03 01:47:03.487259353 +0000 UTC m=+393.051655150" observedRunningTime="2026-06-03 01:47:04.587210714 +0000 UTC m=+394.151606527" watchObservedRunningTime="2026-06-03 01:47:04.588974501 +0000 UTC m=+394.153370311"
Jun 03 01:47:10.463389 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:10.463354    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-69dns"
Jun 03 01:47:10.466276 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:10.466248    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-lngwz"
Jun 03 01:47:41.543405 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:41.543317    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf"]
Jun 03 01:47:41.566139 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:41.566090    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf"]
Jun 03 01:47:41.566335 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:41.566253    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf"
Jun 03 01:47:41.569011 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:41.568986    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 03 01:47:41.569171 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:41.569151    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 03 01:47:41.570092 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:41.570065    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9jrmt\""
Jun 03 01:47:41.638774 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:41.638733    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c79b6b70-7e57-450f-ae5e-4bceb24132db-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf\" (UID: \"c79b6b70-7e57-450f-ae5e-4bceb24132db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf"
Jun 03 01:47:41.638948 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:41.638857    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzzkt\" (UniqueName: \"kubernetes.io/projected/c79b6b70-7e57-450f-ae5e-4bceb24132db-kube-api-access-nzzkt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf\" (UID: \"c79b6b70-7e57-450f-ae5e-4bceb24132db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf"
Jun 03 01:47:41.638948 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:41.638901    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c79b6b70-7e57-450f-ae5e-4bceb24132db-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf\" (UID: \"c79b6b70-7e57-450f-ae5e-4bceb24132db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf"
Jun 03 01:47:41.739736 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:41.739701    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nzzkt\" (UniqueName: \"kubernetes.io/projected/c79b6b70-7e57-450f-ae5e-4bceb24132db-kube-api-access-nzzkt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf\" (UID: \"c79b6b70-7e57-450f-ae5e-4bceb24132db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf"
Jun 03 01:47:41.739913 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:41.739749    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c79b6b70-7e57-450f-ae5e-4bceb24132db-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf\" (UID: \"c79b6b70-7e57-450f-ae5e-4bceb24132db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf"
Jun 03 01:47:41.739913 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:41.739804    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c79b6b70-7e57-450f-ae5e-4bceb24132db-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf\" (UID: \"c79b6b70-7e57-450f-ae5e-4bceb24132db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf"
Jun 03 01:47:41.740239 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:41.740219    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c79b6b70-7e57-450f-ae5e-4bceb24132db-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf\" (UID: \"c79b6b70-7e57-450f-ae5e-4bceb24132db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf"
Jun 03 01:47:41.740281 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:41.740226    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c79b6b70-7e57-450f-ae5e-4bceb24132db-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf\" (UID: \"c79b6b70-7e57-450f-ae5e-4bceb24132db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf"
Jun 03 01:47:41.748114 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:41.748077    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzzkt\" (UniqueName: \"kubernetes.io/projected/c79b6b70-7e57-450f-ae5e-4bceb24132db-kube-api-access-nzzkt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf\" (UID: \"c79b6b70-7e57-450f-ae5e-4bceb24132db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf"
Jun 03 01:47:41.876647 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:41.876612    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf"
Jun 03 01:47:42.021169 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.021135    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf"]
Jun 03 01:47:42.030007 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:47:42.029973    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc79b6b70_7e57_450f_ae5e_4bceb24132db.slice/crio-a936d4f9a461405e9a16e645a25fcccf573955186f92acc6da83b1781d2c6d0b WatchSource:0}: Error finding container a936d4f9a461405e9a16e645a25fcccf573955186f92acc6da83b1781d2c6d0b: Status 404 returned error can't find the container with id a936d4f9a461405e9a16e645a25fcccf573955186f92acc6da83b1781d2c6d0b
Jun 03 01:47:42.142949 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.142864    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr"]
Jun 03 01:47:42.146688 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.146663    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr"
Jun 03 01:47:42.153092 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.153067    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr"]
Jun 03 01:47:42.245372 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.245331    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-928pc\" (UniqueName: \"kubernetes.io/projected/c8dd0d01-8219-42d9-9ec6-3bc2af2decef-kube-api-access-928pc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr\" (UID: \"c8dd0d01-8219-42d9-9ec6-3bc2af2decef\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr"
Jun 03 01:47:42.245566 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.245410    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8dd0d01-8219-42d9-9ec6-3bc2af2decef-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr\" (UID: \"c8dd0d01-8219-42d9-9ec6-3bc2af2decef\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr"
Jun 03 01:47:42.245566 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.245471    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8dd0d01-8219-42d9-9ec6-3bc2af2decef-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr\" (UID: \"c8dd0d01-8219-42d9-9ec6-3bc2af2decef\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr"
Jun 03 01:47:42.346773 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.346730    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8dd0d01-8219-42d9-9ec6-3bc2af2decef-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr\" (UID: \"c8dd0d01-8219-42d9-9ec6-3bc2af2decef\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr"
Jun 03 01:47:42.346977 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.346806    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8dd0d01-8219-42d9-9ec6-3bc2af2decef-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr\" (UID: \"c8dd0d01-8219-42d9-9ec6-3bc2af2decef\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr"
Jun 03 01:47:42.346977 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.346830    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-928pc\" (UniqueName: \"kubernetes.io/projected/c8dd0d01-8219-42d9-9ec6-3bc2af2decef-kube-api-access-928pc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr\" (UID: \"c8dd0d01-8219-42d9-9ec6-3bc2af2decef\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr"
Jun 03 01:47:42.347124 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.347102    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8dd0d01-8219-42d9-9ec6-3bc2af2decef-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr\" (UID: \"c8dd0d01-8219-42d9-9ec6-3bc2af2decef\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr"
Jun 03 01:47:42.347229 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.347210    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8dd0d01-8219-42d9-9ec6-3bc2af2decef-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr\" (UID: \"c8dd0d01-8219-42d9-9ec6-3bc2af2decef\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr"
Jun 03 01:47:42.355381 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.355351    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-928pc\" (UniqueName: \"kubernetes.io/projected/c8dd0d01-8219-42d9-9ec6-3bc2af2decef-kube-api-access-928pc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr\" (UID: \"c8dd0d01-8219-42d9-9ec6-3bc2af2decef\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr"
Jun 03 01:47:42.511726 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.511626    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr"
Jun 03 01:47:42.642853 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.642827    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr"]
Jun 03 01:47:42.645007 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:47:42.644980    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8dd0d01_8219_42d9_9ec6_3bc2af2decef.slice/crio-7ab7a919619789a891de4c9a21086ec614eda37a63a07e5713c11578ce93cd6b WatchSource:0}: Error finding container 7ab7a919619789a891de4c9a21086ec614eda37a63a07e5713c11578ce93cd6b: Status 404 returned error can't find the container with id 7ab7a919619789a891de4c9a21086ec614eda37a63a07e5713c11578ce93cd6b
Jun 03 01:47:42.717280 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.717242    2577 generic.go:358] "Generic (PLEG): container finished" podID="c79b6b70-7e57-450f-ae5e-4bceb24132db" containerID="bd90492b3164ea922afd439fad43ee4e4a479b7dbd31f57aefc7e0689f29f188" exitCode=0
Jun 03 01:47:42.717445 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.717379    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf" event={"ID":"c79b6b70-7e57-450f-ae5e-4bceb24132db","Type":"ContainerDied","Data":"bd90492b3164ea922afd439fad43ee4e4a479b7dbd31f57aefc7e0689f29f188"}
Jun 03 01:47:42.717445 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.717421    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf" event={"ID":"c79b6b70-7e57-450f-ae5e-4bceb24132db","Type":"ContainerStarted","Data":"a936d4f9a461405e9a16e645a25fcccf573955186f92acc6da83b1781d2c6d0b"}
Jun 03 01:47:42.718704 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.718672    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr" event={"ID":"c8dd0d01-8219-42d9-9ec6-3bc2af2decef","Type":"ContainerStarted","Data":"7ab7a919619789a891de4c9a21086ec614eda37a63a07e5713c11578ce93cd6b"}
Jun 03 01:47:42.743697 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.743663    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl"]
Jun 03 01:47:42.747229 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.747211    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl"
Jun 03 01:47:42.754799 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.754760    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl"]
Jun 03 01:47:42.851340 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.851298    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7efc779-17d2-4c64-b6a6-a24374f80990-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl\" (UID: \"c7efc779-17d2-4c64-b6a6-a24374f80990\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl"
Jun 03 01:47:42.851509 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.851362    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7efc779-17d2-4c64-b6a6-a24374f80990-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl\" (UID: \"c7efc779-17d2-4c64-b6a6-a24374f80990\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl"
Jun 03 01:47:42.851509 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.851494    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltpmd\" (UniqueName: \"kubernetes.io/projected/c7efc779-17d2-4c64-b6a6-a24374f80990-kube-api-access-ltpmd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl\" (UID: \"c7efc779-17d2-4c64-b6a6-a24374f80990\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl"
Jun 03 01:47:42.952875 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.952822    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7efc779-17d2-4c64-b6a6-a24374f80990-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl\" (UID: \"c7efc779-17d2-4c64-b6a6-a24374f80990\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl"
Jun 03 01:47:42.953034 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.952900    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7efc779-17d2-4c64-b6a6-a24374f80990-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl\" (UID: \"c7efc779-17d2-4c64-b6a6-a24374f80990\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl"
Jun 03 01:47:42.953034 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.952936    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ltpmd\" (UniqueName: \"kubernetes.io/projected/c7efc779-17d2-4c64-b6a6-a24374f80990-kube-api-access-ltpmd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl\" (UID: \"c7efc779-17d2-4c64-b6a6-a24374f80990\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl"
Jun 03 01:47:42.953253 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.953230    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7efc779-17d2-4c64-b6a6-a24374f80990-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl\" (UID: \"c7efc779-17d2-4c64-b6a6-a24374f80990\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl"
Jun 03 01:47:42.953328 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.953251    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7efc779-17d2-4c64-b6a6-a24374f80990-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl\" (UID: \"c7efc779-17d2-4c64-b6a6-a24374f80990\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl"
Jun 03 01:47:42.961494 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:42.961460    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltpmd\" (UniqueName: \"kubernetes.io/projected/c7efc779-17d2-4c64-b6a6-a24374f80990-kube-api-access-ltpmd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl\" (UID: \"c7efc779-17d2-4c64-b6a6-a24374f80990\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl"
Jun 03 01:47:43.124812 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.124777    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl"
Jun 03 01:47:43.145301 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.145267    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72"]
Jun 03 01:47:43.151172 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.151120    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72"
Jun 03 01:47:43.153431 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.153400    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72"]
Jun 03 01:47:43.254985 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.254946    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4clz\" (UniqueName: \"kubernetes.io/projected/48b1644c-85bc-476f-b241-b0e52a86761d-kube-api-access-x4clz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72\" (UID: \"48b1644c-85bc-476f-b241-b0e52a86761d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72"
Jun 03 01:47:43.255156 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.254994    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48b1644c-85bc-476f-b241-b0e52a86761d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72\" (UID: \"48b1644c-85bc-476f-b241-b0e52a86761d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72"
Jun 03 01:47:43.255156 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.255073    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48b1644c-85bc-476f-b241-b0e52a86761d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72\" (UID: \"48b1644c-85bc-476f-b241-b0e52a86761d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72"
Jun 03 01:47:43.264740 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.264708    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl"]
Jun 03 01:47:43.266189 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:47:43.266159    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7efc779_17d2_4c64_b6a6_a24374f80990.slice/crio-8e450171fc040d46cf5e35d2278126ecf845e98e855426f7689806c33a4e0347 WatchSource:0}: Error finding container 8e450171fc040d46cf5e35d2278126ecf845e98e855426f7689806c33a4e0347: Status 404 returned error can't find the container with id 8e450171fc040d46cf5e35d2278126ecf845e98e855426f7689806c33a4e0347
Jun 03 01:47:43.355925 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.355869    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x4clz\" (UniqueName: \"kubernetes.io/projected/48b1644c-85bc-476f-b241-b0e52a86761d-kube-api-access-x4clz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72\" (UID: \"48b1644c-85bc-476f-b241-b0e52a86761d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72"
Jun 03 01:47:43.355925 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.355924    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48b1644c-85bc-476f-b241-b0e52a86761d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72\" (UID: \"48b1644c-85bc-476f-b241-b0e52a86761d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72"
Jun 03 01:47:43.356184 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.355963    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48b1644c-85bc-476f-b241-b0e52a86761d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72\" (UID: \"48b1644c-85bc-476f-b241-b0e52a86761d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72"
Jun 03 01:47:43.356373 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.356353    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48b1644c-85bc-476f-b241-b0e52a86761d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72\" (UID: \"48b1644c-85bc-476f-b241-b0e52a86761d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72"
Jun 03 01:47:43.356453 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.356428    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48b1644c-85bc-476f-b241-b0e52a86761d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72\" (UID: \"48b1644c-85bc-476f-b241-b0e52a86761d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72"
Jun 03 01:47:43.363814 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.363780    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4clz\" (UniqueName: \"kubernetes.io/projected/48b1644c-85bc-476f-b241-b0e52a86761d-kube-api-access-x4clz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72\" (UID: \"48b1644c-85bc-476f-b241-b0e52a86761d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72"
Jun 03 01:47:43.463303 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.463272    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72"
Jun 03 01:47:43.600211 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.600183    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72"]
Jun 03 01:47:43.602001 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:47:43.601963    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48b1644c_85bc_476f_b241_b0e52a86761d.slice/crio-7f65a295f4f6fb24d4bd6eb01a1b8b348302fb720c2ec4214dbf166c764b7a77 WatchSource:0}: Error finding container 7f65a295f4f6fb24d4bd6eb01a1b8b348302fb720c2ec4214dbf166c764b7a77: Status 404 returned error can't find the container with id 7f65a295f4f6fb24d4bd6eb01a1b8b348302fb720c2ec4214dbf166c764b7a77
Jun 03 01:47:43.724392 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.724356    2577 generic.go:358] "Generic (PLEG): container finished" podID="c79b6b70-7e57-450f-ae5e-4bceb24132db" containerID="42d80c3a2f3b29ac1888ff55e06f210eb2302bfa833f126b5a695e7bfa17ffcd" exitCode=0
Jun 03 01:47:43.724846 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.724433    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf" event={"ID":"c79b6b70-7e57-450f-ae5e-4bceb24132db","Type":"ContainerDied","Data":"42d80c3a2f3b29ac1888ff55e06f210eb2302bfa833f126b5a695e7bfa17ffcd"}
Jun 03 01:47:43.725758 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.725731    2577 generic.go:358] "Generic (PLEG): container finished" podID="48b1644c-85bc-476f-b241-b0e52a86761d" containerID="05b4fd3ef3f152d8ef24bb34383f721e0b12a93f84fd2b737479a3473a6e65cc" exitCode=0
Jun 03 01:47:43.725876 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.725761    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72" event={"ID":"48b1644c-85bc-476f-b241-b0e52a86761d","Type":"ContainerDied","Data":"05b4fd3ef3f152d8ef24bb34383f721e0b12a93f84fd2b737479a3473a6e65cc"}
Jun 03 01:47:43.725876 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.725798    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72" event={"ID":"48b1644c-85bc-476f-b241-b0e52a86761d","Type":"ContainerStarted","Data":"7f65a295f4f6fb24d4bd6eb01a1b8b348302fb720c2ec4214dbf166c764b7a77"}
Jun 03 01:47:43.727160 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.727134    2577 generic.go:358] "Generic (PLEG): container finished" podID="c7efc779-17d2-4c64-b6a6-a24374f80990" containerID="ef2d8f744182528b2fa35563ced3d6ca27c77ef1f27d7dcaa4018e85d25ed381" exitCode=0
Jun 03 01:47:43.727278 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.727214    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl" event={"ID":"c7efc779-17d2-4c64-b6a6-a24374f80990","Type":"ContainerDied","Data":"ef2d8f744182528b2fa35563ced3d6ca27c77ef1f27d7dcaa4018e85d25ed381"}
Jun 03 01:47:43.727278 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.727248    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl" event={"ID":"c7efc779-17d2-4c64-b6a6-a24374f80990","Type":"ContainerStarted","Data":"8e450171fc040d46cf5e35d2278126ecf845e98e855426f7689806c33a4e0347"}
Jun 03 01:47:43.728669 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.728650    2577 generic.go:358] "Generic (PLEG): container finished" podID="c8dd0d01-8219-42d9-9ec6-3bc2af2decef" containerID="0cc013556d045b951ffdefb30101a9fc3341c318c872552cfa38e7c6eac67e6b" exitCode=0
Jun 03 01:47:43.728742 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:43.728710    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr" event={"ID":"c8dd0d01-8219-42d9-9ec6-3bc2af2decef","Type":"ContainerDied","Data":"0cc013556d045b951ffdefb30101a9fc3341c318c872552cfa38e7c6eac67e6b"}
Jun 03 01:47:44.737752 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:44.737721    2577 generic.go:358] "Generic (PLEG): container finished" podID="c79b6b70-7e57-450f-ae5e-4bceb24132db" containerID="cc29d12bce3912209a5073b118630212e7897ad2d1acf65d29d40b10a3dbffd1" exitCode=0
Jun 03 01:47:44.738127 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:44.737798    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf" event={"ID":"c79b6b70-7e57-450f-ae5e-4bceb24132db","Type":"ContainerDied","Data":"cc29d12bce3912209a5073b118630212e7897ad2d1acf65d29d40b10a3dbffd1"}
Jun 03 01:47:45.743763 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:45.743725    2577 generic.go:358] "Generic (PLEG): container finished" podID="48b1644c-85bc-476f-b241-b0e52a86761d" containerID="f1e16f202d1d58dd11224fbe6271fe8c2d608e91cfdd2531d310796a8da876f8" exitCode=0
Jun 03 01:47:45.744219 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:45.743814    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72" event={"ID":"48b1644c-85bc-476f-b241-b0e52a86761d","Type":"ContainerDied","Data":"f1e16f202d1d58dd11224fbe6271fe8c2d608e91cfdd2531d310796a8da876f8"}
Jun 03 01:47:45.745662 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:45.745548    2577 generic.go:358] "Generic (PLEG): container finished" podID="c7efc779-17d2-4c64-b6a6-a24374f80990" containerID="ccfd8a43a3eec72553cd37879fec2330bdb3890a94f0460d7ba6cc8c72c33f8a" exitCode=0
Jun 03 01:47:45.745712 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:45.745658    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl" event={"ID":"c7efc779-17d2-4c64-b6a6-a24374f80990","Type":"ContainerDied","Data":"ccfd8a43a3eec72553cd37879fec2330bdb3890a94f0460d7ba6cc8c72c33f8a"}
Jun 03 01:47:45.747502 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:45.747485    2577 generic.go:358] "Generic (PLEG): container finished" podID="c8dd0d01-8219-42d9-9ec6-3bc2af2decef" containerID="64798bde92f8b2eef6d19bf6c8271a9638242222b4de21912444288f1ee9fd75" exitCode=0
Jun 03 01:47:45.747608 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:45.747567    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr" event={"ID":"c8dd0d01-8219-42d9-9ec6-3bc2af2decef","Type":"ContainerDied","Data":"64798bde92f8b2eef6d19bf6c8271a9638242222b4de21912444288f1ee9fd75"}
Jun 03 01:47:45.906742 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:45.906716    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf"
Jun 03 01:47:45.980943 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:45.980909    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c79b6b70-7e57-450f-ae5e-4bceb24132db-util\") pod \"c79b6b70-7e57-450f-ae5e-4bceb24132db\" (UID: \"c79b6b70-7e57-450f-ae5e-4bceb24132db\") "
Jun 03 01:47:45.980943 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:45.980958    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzzkt\" (UniqueName: \"kubernetes.io/projected/c79b6b70-7e57-450f-ae5e-4bceb24132db-kube-api-access-nzzkt\") pod \"c79b6b70-7e57-450f-ae5e-4bceb24132db\" (UID: \"c79b6b70-7e57-450f-ae5e-4bceb24132db\") "
Jun 03 01:47:45.981213 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:45.980975    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c79b6b70-7e57-450f-ae5e-4bceb24132db-bundle\") pod \"c79b6b70-7e57-450f-ae5e-4bceb24132db\" (UID: \"c79b6b70-7e57-450f-ae5e-4bceb24132db\") "
Jun 03 01:47:45.981601 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:45.981556    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c79b6b70-7e57-450f-ae5e-4bceb24132db-bundle" (OuterVolumeSpecName: "bundle") pod "c79b6b70-7e57-450f-ae5e-4bceb24132db" (UID: "c79b6b70-7e57-450f-ae5e-4bceb24132db"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 01:47:45.983250 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:45.983226    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c79b6b70-7e57-450f-ae5e-4bceb24132db-kube-api-access-nzzkt" (OuterVolumeSpecName: "kube-api-access-nzzkt") pod "c79b6b70-7e57-450f-ae5e-4bceb24132db" (UID: "c79b6b70-7e57-450f-ae5e-4bceb24132db"). InnerVolumeSpecName "kube-api-access-nzzkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:47:45.985966 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:45.985937    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c79b6b70-7e57-450f-ae5e-4bceb24132db-util" (OuterVolumeSpecName: "util") pod "c79b6b70-7e57-450f-ae5e-4bceb24132db" (UID: "c79b6b70-7e57-450f-ae5e-4bceb24132db"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 01:47:46.082649 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:46.082615    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c79b6b70-7e57-450f-ae5e-4bceb24132db-util\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:47:46.082649 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:46.082647    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzzkt\" (UniqueName: \"kubernetes.io/projected/c79b6b70-7e57-450f-ae5e-4bceb24132db-kube-api-access-nzzkt\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:47:46.082845 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:46.082661    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c79b6b70-7e57-450f-ae5e-4bceb24132db-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:47:46.753189 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:46.753155    2577 generic.go:358] "Generic (PLEG): container finished" podID="c7efc779-17d2-4c64-b6a6-a24374f80990" containerID="4ed1832ba54dba1c0da6a0a62ba0125b4922a80276d5209f44e8f27fa62798e8" exitCode=0
Jun 03 01:47:46.753682 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:46.753239    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl" event={"ID":"c7efc779-17d2-4c64-b6a6-a24374f80990","Type":"ContainerDied","Data":"4ed1832ba54dba1c0da6a0a62ba0125b4922a80276d5209f44e8f27fa62798e8"}
Jun 03 01:47:46.755015 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:46.754987    2577 generic.go:358] "Generic (PLEG): container finished" podID="c8dd0d01-8219-42d9-9ec6-3bc2af2decef" containerID="ff00691bf614f8ba0bd35dd5b11e3e44e7cee3761d4d046b16b62df920cda342" exitCode=0
Jun 03 01:47:46.755113 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:46.755072    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr" event={"ID":"c8dd0d01-8219-42d9-9ec6-3bc2af2decef","Type":"ContainerDied","Data":"ff00691bf614f8ba0bd35dd5b11e3e44e7cee3761d4d046b16b62df920cda342"}
Jun 03 01:47:46.756641 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:46.756620    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf" event={"ID":"c79b6b70-7e57-450f-ae5e-4bceb24132db","Type":"ContainerDied","Data":"a936d4f9a461405e9a16e645a25fcccf573955186f92acc6da83b1781d2c6d0b"}
Jun 03 01:47:46.756737 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:46.756646    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a936d4f9a461405e9a16e645a25fcccf573955186f92acc6da83b1781d2c6d0b"
Jun 03 01:47:46.756737 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:46.756703    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf"
Jun 03 01:47:46.758629 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:46.758610    2577 generic.go:358] "Generic (PLEG): container finished" podID="48b1644c-85bc-476f-b241-b0e52a86761d" containerID="5f82742476408ae096dbac2ae2548f530107a5fd1105998ace3d82f9281026ff" exitCode=0
Jun 03 01:47:46.758721 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:46.758642    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72" event={"ID":"48b1644c-85bc-476f-b241-b0e52a86761d","Type":"ContainerDied","Data":"5f82742476408ae096dbac2ae2548f530107a5fd1105998ace3d82f9281026ff"}
Jun 03 01:47:47.921363 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:47.921334    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72"
Jun 03 01:47:47.963037 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:47.963010    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr"
Jun 03 01:47:47.966511 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:47.966482    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl"
Jun 03 01:47:48.000818 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.000778    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48b1644c-85bc-476f-b241-b0e52a86761d-util\") pod \"48b1644c-85bc-476f-b241-b0e52a86761d\" (UID: \"48b1644c-85bc-476f-b241-b0e52a86761d\") "
Jun 03 01:47:48.001013 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.000857    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48b1644c-85bc-476f-b241-b0e52a86761d-bundle\") pod \"48b1644c-85bc-476f-b241-b0e52a86761d\" (UID: \"48b1644c-85bc-476f-b241-b0e52a86761d\") "
Jun 03 01:47:48.001013 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.000939    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4clz\" (UniqueName: \"kubernetes.io/projected/48b1644c-85bc-476f-b241-b0e52a86761d-kube-api-access-x4clz\") pod \"48b1644c-85bc-476f-b241-b0e52a86761d\" (UID: \"48b1644c-85bc-476f-b241-b0e52a86761d\") "
Jun 03 01:47:48.001423 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.001359    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48b1644c-85bc-476f-b241-b0e52a86761d-bundle" (OuterVolumeSpecName: "bundle") pod "48b1644c-85bc-476f-b241-b0e52a86761d" (UID: "48b1644c-85bc-476f-b241-b0e52a86761d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 01:47:48.003183 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.003152    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48b1644c-85bc-476f-b241-b0e52a86761d-kube-api-access-x4clz" (OuterVolumeSpecName: "kube-api-access-x4clz") pod "48b1644c-85bc-476f-b241-b0e52a86761d" (UID: "48b1644c-85bc-476f-b241-b0e52a86761d"). InnerVolumeSpecName "kube-api-access-x4clz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:47:48.007604 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.007556    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48b1644c-85bc-476f-b241-b0e52a86761d-util" (OuterVolumeSpecName: "util") pod "48b1644c-85bc-476f-b241-b0e52a86761d" (UID: "48b1644c-85bc-476f-b241-b0e52a86761d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 01:47:48.102280 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.102190    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8dd0d01-8219-42d9-9ec6-3bc2af2decef-util\") pod \"c8dd0d01-8219-42d9-9ec6-3bc2af2decef\" (UID: \"c8dd0d01-8219-42d9-9ec6-3bc2af2decef\") "
Jun 03 01:47:48.102431 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.102284    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8dd0d01-8219-42d9-9ec6-3bc2af2decef-bundle\") pod \"c8dd0d01-8219-42d9-9ec6-3bc2af2decef\" (UID: \"c8dd0d01-8219-42d9-9ec6-3bc2af2decef\") "
Jun 03 01:47:48.102431 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.102334    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-928pc\" (UniqueName: \"kubernetes.io/projected/c8dd0d01-8219-42d9-9ec6-3bc2af2decef-kube-api-access-928pc\") pod \"c8dd0d01-8219-42d9-9ec6-3bc2af2decef\" (UID: \"c8dd0d01-8219-42d9-9ec6-3bc2af2decef\") "
Jun 03 01:47:48.102431 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.102353    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7efc779-17d2-4c64-b6a6-a24374f80990-bundle\") pod \"c7efc779-17d2-4c64-b6a6-a24374f80990\" (UID: \"c7efc779-17d2-4c64-b6a6-a24374f80990\") "
Jun 03 01:47:48.102431 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.102368    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7efc779-17d2-4c64-b6a6-a24374f80990-util\") pod \"c7efc779-17d2-4c64-b6a6-a24374f80990\" (UID: \"c7efc779-17d2-4c64-b6a6-a24374f80990\") "
Jun 03 01:47:48.102431 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.102383    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltpmd\" (UniqueName: \"kubernetes.io/projected/c7efc779-17d2-4c64-b6a6-a24374f80990-kube-api-access-ltpmd\") pod \"c7efc779-17d2-4c64-b6a6-a24374f80990\" (UID: \"c7efc779-17d2-4c64-b6a6-a24374f80990\") "
Jun 03 01:47:48.102752 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.102655    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4clz\" (UniqueName: \"kubernetes.io/projected/48b1644c-85bc-476f-b241-b0e52a86761d-kube-api-access-x4clz\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:47:48.102752 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.102678    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48b1644c-85bc-476f-b241-b0e52a86761d-util\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:47:48.102752 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.102695    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48b1644c-85bc-476f-b241-b0e52a86761d-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:47:48.102909 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.102871    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8dd0d01-8219-42d9-9ec6-3bc2af2decef-bundle" (OuterVolumeSpecName: "bundle") pod "c8dd0d01-8219-42d9-9ec6-3bc2af2decef" (UID: "c8dd0d01-8219-42d9-9ec6-3bc2af2decef"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 01:47:48.102909 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.102871    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7efc779-17d2-4c64-b6a6-a24374f80990-bundle" (OuterVolumeSpecName: "bundle") pod "c7efc779-17d2-4c64-b6a6-a24374f80990" (UID: "c7efc779-17d2-4c64-b6a6-a24374f80990"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 01:47:48.104550 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.104523    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7efc779-17d2-4c64-b6a6-a24374f80990-kube-api-access-ltpmd" (OuterVolumeSpecName: "kube-api-access-ltpmd") pod "c7efc779-17d2-4c64-b6a6-a24374f80990" (UID: "c7efc779-17d2-4c64-b6a6-a24374f80990"). InnerVolumeSpecName "kube-api-access-ltpmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:47:48.104846 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.104829    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8dd0d01-8219-42d9-9ec6-3bc2af2decef-kube-api-access-928pc" (OuterVolumeSpecName: "kube-api-access-928pc") pod "c8dd0d01-8219-42d9-9ec6-3bc2af2decef" (UID: "c8dd0d01-8219-42d9-9ec6-3bc2af2decef"). InnerVolumeSpecName "kube-api-access-928pc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:47:48.107398 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.107375    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8dd0d01-8219-42d9-9ec6-3bc2af2decef-util" (OuterVolumeSpecName: "util") pod "c8dd0d01-8219-42d9-9ec6-3bc2af2decef" (UID: "c8dd0d01-8219-42d9-9ec6-3bc2af2decef"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 01:47:48.109040 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.109016    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7efc779-17d2-4c64-b6a6-a24374f80990-util" (OuterVolumeSpecName: "util") pod "c7efc779-17d2-4c64-b6a6-a24374f80990" (UID: "c7efc779-17d2-4c64-b6a6-a24374f80990"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 01:47:48.204406 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.204371    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8dd0d01-8219-42d9-9ec6-3bc2af2decef-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:47:48.204406 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.204402    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-928pc\" (UniqueName: \"kubernetes.io/projected/c8dd0d01-8219-42d9-9ec6-3bc2af2decef-kube-api-access-928pc\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:47:48.204406 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.204412    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7efc779-17d2-4c64-b6a6-a24374f80990-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:47:48.204406 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.204422    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7efc779-17d2-4c64-b6a6-a24374f80990-util\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:47:48.204784 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.204435    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltpmd\" (UniqueName: \"kubernetes.io/projected/c7efc779-17d2-4c64-b6a6-a24374f80990-kube-api-access-ltpmd\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:47:48.204784 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.204447    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8dd0d01-8219-42d9-9ec6-3bc2af2decef-util\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:47:48.769009 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.768976    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr"
Jun 03 01:47:48.769009 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.768989    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr" event={"ID":"c8dd0d01-8219-42d9-9ec6-3bc2af2decef","Type":"ContainerDied","Data":"7ab7a919619789a891de4c9a21086ec614eda37a63a07e5713c11578ce93cd6b"}
Jun 03 01:47:48.769258 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.769024    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ab7a919619789a891de4c9a21086ec614eda37a63a07e5713c11578ce93cd6b"
Jun 03 01:47:48.770724 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.770698    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72" event={"ID":"48b1644c-85bc-476f-b241-b0e52a86761d","Type":"ContainerDied","Data":"7f65a295f4f6fb24d4bd6eb01a1b8b348302fb720c2ec4214dbf166c764b7a77"}
Jun 03 01:47:48.770724 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.770717    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72"
Jun 03 01:47:48.770724 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.770726    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f65a295f4f6fb24d4bd6eb01a1b8b348302fb720c2ec4214dbf166c764b7a77"
Jun 03 01:47:48.772527 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.772506    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl" event={"ID":"c7efc779-17d2-4c64-b6a6-a24374f80990","Type":"ContainerDied","Data":"8e450171fc040d46cf5e35d2278126ecf845e98e855426f7689806c33a4e0347"}
Jun 03 01:47:48.772527 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.772526    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e450171fc040d46cf5e35d2278126ecf845e98e855426f7689806c33a4e0347"
Jun 03 01:47:48.772722 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:47:48.772556    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl"
Jun 03 01:48:05.138111 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138072    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d858dc746-sj9bd"]
Jun 03 01:48:05.138630 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138608    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7efc779-17d2-4c64-b6a6-a24374f80990" containerName="util"
Jun 03 01:48:05.138737 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138634    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7efc779-17d2-4c64-b6a6-a24374f80990" containerName="util"
Jun 03 01:48:05.138737 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138649    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8dd0d01-8219-42d9-9ec6-3bc2af2decef" containerName="pull"
Jun 03 01:48:05.138737 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138657    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8dd0d01-8219-42d9-9ec6-3bc2af2decef" containerName="pull"
Jun 03 01:48:05.138737 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138668    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c79b6b70-7e57-450f-ae5e-4bceb24132db" containerName="extract"
Jun 03 01:48:05.138737 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138676    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c79b6b70-7e57-450f-ae5e-4bceb24132db" containerName="extract"
Jun 03 01:48:05.138737 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138689    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7efc779-17d2-4c64-b6a6-a24374f80990" containerName="pull"
Jun 03 01:48:05.138737 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138697    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7efc779-17d2-4c64-b6a6-a24374f80990" containerName="pull"
Jun 03 01:48:05.138737 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138707    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7efc779-17d2-4c64-b6a6-a24374f80990" containerName="extract"
Jun 03 01:48:05.138737 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138715    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7efc779-17d2-4c64-b6a6-a24374f80990" containerName="extract"
Jun 03 01:48:05.138737 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138736    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c79b6b70-7e57-450f-ae5e-4bceb24132db" containerName="util"
Jun 03 01:48:05.139221 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138745    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c79b6b70-7e57-450f-ae5e-4bceb24132db" containerName="util"
Jun 03 01:48:05.139221 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138755    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8dd0d01-8219-42d9-9ec6-3bc2af2decef" containerName="util"
Jun 03 01:48:05.139221 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138764    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8dd0d01-8219-42d9-9ec6-3bc2af2decef" containerName="util"
Jun 03 01:48:05.139221 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138774    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b1644c-85bc-476f-b241-b0e52a86761d" containerName="pull"
Jun 03 01:48:05.139221 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138782    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b1644c-85bc-476f-b241-b0e52a86761d" containerName="pull"
Jun 03 01:48:05.139221 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138791    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b1644c-85bc-476f-b241-b0e52a86761d" containerName="extract"
Jun 03 01:48:05.139221 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138800    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b1644c-85bc-476f-b241-b0e52a86761d" containerName="extract"
Jun 03 01:48:05.139221 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138811    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b1644c-85bc-476f-b241-b0e52a86761d" containerName="util"
Jun 03 01:48:05.139221 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138819    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b1644c-85bc-476f-b241-b0e52a86761d" containerName="util"
Jun 03 01:48:05.139221 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138831    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8dd0d01-8219-42d9-9ec6-3bc2af2decef" containerName="extract"
Jun 03 01:48:05.139221 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138839    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8dd0d01-8219-42d9-9ec6-3bc2af2decef" containerName="extract"
Jun 03 01:48:05.139221 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138857    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c79b6b70-7e57-450f-ae5e-4bceb24132db" containerName="pull"
Jun 03 01:48:05.139221 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138865    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c79b6b70-7e57-450f-ae5e-4bceb24132db" containerName="pull"
Jun 03 01:48:05.139221 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138964    2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="c7efc779-17d2-4c64-b6a6-a24374f80990" containerName="extract"
Jun 03 01:48:05.139221 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138979    2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="c8dd0d01-8219-42d9-9ec6-3bc2af2decef" containerName="extract"
Jun 03 01:48:05.139221 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.138996    2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="48b1644c-85bc-476f-b241-b0e52a86761d" containerName="extract"
Jun 03 01:48:05.139221 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.139006    2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="c79b6b70-7e57-450f-ae5e-4bceb24132db" containerName="extract"
Jun 03 01:48:05.144727 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.144699    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:05.157189 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.157154    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d858dc746-sj9bd"]
Jun 03 01:48:05.255709 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.255666    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af6fcd5b-5367-44b3-a1bf-56396bf6a9c5-service-ca\") pod \"console-6d858dc746-sj9bd\" (UID: \"af6fcd5b-5367-44b3-a1bf-56396bf6a9c5\") " pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:05.255883 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.255715    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af6fcd5b-5367-44b3-a1bf-56396bf6a9c5-console-serving-cert\") pod \"console-6d858dc746-sj9bd\" (UID: \"af6fcd5b-5367-44b3-a1bf-56396bf6a9c5\") " pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:05.255883 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.255775    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af6fcd5b-5367-44b3-a1bf-56396bf6a9c5-console-oauth-config\") pod \"console-6d858dc746-sj9bd\" (UID: \"af6fcd5b-5367-44b3-a1bf-56396bf6a9c5\") " pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:05.255883 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.255868    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af6fcd5b-5367-44b3-a1bf-56396bf6a9c5-oauth-serving-cert\") pod \"console-6d858dc746-sj9bd\" (UID: \"af6fcd5b-5367-44b3-a1bf-56396bf6a9c5\") " pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:05.256047 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.255914    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af6fcd5b-5367-44b3-a1bf-56396bf6a9c5-trusted-ca-bundle\") pod \"console-6d858dc746-sj9bd\" (UID: \"af6fcd5b-5367-44b3-a1bf-56396bf6a9c5\") " pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:05.256047 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.255984    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af6fcd5b-5367-44b3-a1bf-56396bf6a9c5-console-config\") pod \"console-6d858dc746-sj9bd\" (UID: \"af6fcd5b-5367-44b3-a1bf-56396bf6a9c5\") " pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:05.256047 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.256020    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbx8r\" (UniqueName: \"kubernetes.io/projected/af6fcd5b-5367-44b3-a1bf-56396bf6a9c5-kube-api-access-mbx8r\") pod \"console-6d858dc746-sj9bd\" (UID: \"af6fcd5b-5367-44b3-a1bf-56396bf6a9c5\") " pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:05.356544 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.356501    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mbx8r\" (UniqueName: \"kubernetes.io/projected/af6fcd5b-5367-44b3-a1bf-56396bf6a9c5-kube-api-access-mbx8r\") pod \"console-6d858dc746-sj9bd\" (UID: \"af6fcd5b-5367-44b3-a1bf-56396bf6a9c5\") " pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:05.356762 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.356556    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af6fcd5b-5367-44b3-a1bf-56396bf6a9c5-service-ca\") pod \"console-6d858dc746-sj9bd\" (UID: \"af6fcd5b-5367-44b3-a1bf-56396bf6a9c5\") " pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:05.356762 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.356577    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af6fcd5b-5367-44b3-a1bf-56396bf6a9c5-console-serving-cert\") pod \"console-6d858dc746-sj9bd\" (UID: \"af6fcd5b-5367-44b3-a1bf-56396bf6a9c5\") " pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:05.356762 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.356626    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af6fcd5b-5367-44b3-a1bf-56396bf6a9c5-console-oauth-config\") pod \"console-6d858dc746-sj9bd\" (UID: \"af6fcd5b-5367-44b3-a1bf-56396bf6a9c5\") " pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:05.356762 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.356671    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af6fcd5b-5367-44b3-a1bf-56396bf6a9c5-oauth-serving-cert\") pod \"console-6d858dc746-sj9bd\" (UID: \"af6fcd5b-5367-44b3-a1bf-56396bf6a9c5\") " pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:05.356762 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.356714    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af6fcd5b-5367-44b3-a1bf-56396bf6a9c5-trusted-ca-bundle\") pod \"console-6d858dc746-sj9bd\" (UID: \"af6fcd5b-5367-44b3-a1bf-56396bf6a9c5\") " pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:05.356762 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.356761    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af6fcd5b-5367-44b3-a1bf-56396bf6a9c5-console-config\") pod \"console-6d858dc746-sj9bd\" (UID: \"af6fcd5b-5367-44b3-a1bf-56396bf6a9c5\") " pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:05.357448 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.357421    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af6fcd5b-5367-44b3-a1bf-56396bf6a9c5-service-ca\") pod \"console-6d858dc746-sj9bd\" (UID: \"af6fcd5b-5367-44b3-a1bf-56396bf6a9c5\") " pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:05.357448 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.357437    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af6fcd5b-5367-44b3-a1bf-56396bf6a9c5-oauth-serving-cert\") pod \"console-6d858dc746-sj9bd\" (UID: \"af6fcd5b-5367-44b3-a1bf-56396bf6a9c5\") " pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:05.357626 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.357463    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af6fcd5b-5367-44b3-a1bf-56396bf6a9c5-console-config\") pod \"console-6d858dc746-sj9bd\" (UID: \"af6fcd5b-5367-44b3-a1bf-56396bf6a9c5\") " pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:05.357678 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.357623    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af6fcd5b-5367-44b3-a1bf-56396bf6a9c5-trusted-ca-bundle\") pod \"console-6d858dc746-sj9bd\" (UID: \"af6fcd5b-5367-44b3-a1bf-56396bf6a9c5\") " pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:05.359202 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.359175    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af6fcd5b-5367-44b3-a1bf-56396bf6a9c5-console-serving-cert\") pod \"console-6d858dc746-sj9bd\" (UID: \"af6fcd5b-5367-44b3-a1bf-56396bf6a9c5\") " pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:05.359302 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.359280    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af6fcd5b-5367-44b3-a1bf-56396bf6a9c5-console-oauth-config\") pod \"console-6d858dc746-sj9bd\" (UID: \"af6fcd5b-5367-44b3-a1bf-56396bf6a9c5\") " pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:05.364932 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.364911    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbx8r\" (UniqueName: \"kubernetes.io/projected/af6fcd5b-5367-44b3-a1bf-56396bf6a9c5-kube-api-access-mbx8r\") pod \"console-6d858dc746-sj9bd\" (UID: \"af6fcd5b-5367-44b3-a1bf-56396bf6a9c5\") " pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:05.456340 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.456240    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:05.596385 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.596350    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d858dc746-sj9bd"]
Jun 03 01:48:05.598047 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:48:05.598019    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf6fcd5b_5367_44b3_a1bf_56396bf6a9c5.slice/crio-72c217ea1bcfaffb79caa373ee2d853ea4ac700f48573cbe51556cbc742a7e44 WatchSource:0}: Error finding container 72c217ea1bcfaffb79caa373ee2d853ea4ac700f48573cbe51556cbc742a7e44: Status 404 returned error can't find the container with id 72c217ea1bcfaffb79caa373ee2d853ea4ac700f48573cbe51556cbc742a7e44
Jun 03 01:48:05.839248 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.839134    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d858dc746-sj9bd" event={"ID":"af6fcd5b-5367-44b3-a1bf-56396bf6a9c5","Type":"ContainerStarted","Data":"aeafd58d9faa266f423e7b0bd7662019edf86fbd4b87ccf2198db10d03cdf61b"}
Jun 03 01:48:05.839248 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.839180    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d858dc746-sj9bd" event={"ID":"af6fcd5b-5367-44b3-a1bf-56396bf6a9c5","Type":"ContainerStarted","Data":"72c217ea1bcfaffb79caa373ee2d853ea4ac700f48573cbe51556cbc742a7e44"}
Jun 03 01:48:05.859247 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:05.859190    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6d858dc746-sj9bd" podStartSLOduration=0.859174428 podStartE2EDuration="859.174428ms" podCreationTimestamp="2026-06-03 01:48:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:48:05.856645184 +0000 UTC m=+455.421040997" watchObservedRunningTime="2026-06-03 01:48:05.859174428 +0000 UTC m=+455.423570238"
Jun 03 01:48:06.765419 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:06.765384    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7"]
Jun 03 01:48:06.769022 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:06.769001    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7"
Jun 03 01:48:06.771655 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:06.771631    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 03 01:48:06.771788 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:06.771636    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 03 01:48:06.771788 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:06.771637    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vsx6t\""
Jun 03 01:48:06.780760 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:06.780734    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7"]
Jun 03 01:48:06.872383 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:06.872338    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-plmm7\" (UID: \"850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7"
Jun 03 01:48:06.872532 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:06.872476    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfxfk\" (UniqueName: \"kubernetes.io/projected/850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5-kube-api-access-gfxfk\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-plmm7\" (UID: \"850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7"
Jun 03 01:48:06.973499 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:06.973446    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gfxfk\" (UniqueName: \"kubernetes.io/projected/850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5-kube-api-access-gfxfk\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-plmm7\" (UID: \"850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7"
Jun 03 01:48:06.973706 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:06.973537    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-plmm7\" (UID: \"850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7"
Jun 03 01:48:06.974018 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:06.973993    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-plmm7\" (UID: \"850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7"
Jun 03 01:48:06.981940 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:06.981918    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfxfk\" (UniqueName: \"kubernetes.io/projected/850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5-kube-api-access-gfxfk\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-plmm7\" (UID: \"850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7"
Jun 03 01:48:07.081777 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:07.081679    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7"
Jun 03 01:48:07.221314 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:07.221275    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7"]
Jun 03 01:48:07.224436 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:48:07.224397    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod850b9153_f2b7_4a8e_a897_b3b8cf0cb9b5.slice/crio-c5c5abb42da589402613329f766c4e43c220df05fa33bdfc49a769ea5c85d8d9 WatchSource:0}: Error finding container c5c5abb42da589402613329f766c4e43c220df05fa33bdfc49a769ea5c85d8d9: Status 404 returned error can't find the container with id c5c5abb42da589402613329f766c4e43c220df05fa33bdfc49a769ea5c85d8d9
Jun 03 01:48:07.851348 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:07.851314    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7" event={"ID":"850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5","Type":"ContainerStarted","Data":"c5c5abb42da589402613329f766c4e43c220df05fa33bdfc49a769ea5c85d8d9"}
Jun 03 01:48:12.877035 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:12.876989    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7" event={"ID":"850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5","Type":"ContainerStarted","Data":"d52a1e7df1954cf76c159fcbcef7ceb70c5cf7180ad0ba66d8b0ebb9e25dd887"}
Jun 03 01:48:12.877548 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:12.877085    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7"
Jun 03 01:48:12.906063 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:12.902639    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7" podStartSLOduration=1.655501082 podStartE2EDuration="6.902619954s" podCreationTimestamp="2026-06-03 01:48:06 +0000 UTC" firstStartedPulling="2026-06-03 01:48:07.226728295 +0000 UTC m=+456.791124083" lastFinishedPulling="2026-06-03 01:48:12.473847162 +0000 UTC m=+462.038242955" observedRunningTime="2026-06-03 01:48:12.897207772 +0000 UTC m=+462.461603574" watchObservedRunningTime="2026-06-03 01:48:12.902619954 +0000 UTC m=+462.467015766"
Jun 03 01:48:15.456983 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:15.456937    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:15.457426 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:15.457098    2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:15.462544 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:15.462457    2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:15.892351 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:15.892321    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d858dc746-sj9bd"
Jun 03 01:48:15.943298 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:15.943250    2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-94f69bbc4-sk8p2"]
Jun 03 01:48:23.883298 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:23.883266    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7"
Jun 03 01:48:25.664182 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.664148    2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7"]
Jun 03 01:48:25.664717 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.664529    2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7" podUID="850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5" containerName="manager" containerID="cri-o://d52a1e7df1954cf76c159fcbcef7ceb70c5cf7180ad0ba66d8b0ebb9e25dd887" gracePeriod=2
Jun 03 01:48:25.666528 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.666484    2577 status_manager.go:895] "Failed to get status for pod" podUID="850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-plmm7\" is forbidden: User \"system:node:ip-10-0-137-62.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-62.ec2.internal' and this object"
Jun 03 01:48:25.667899 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.667869    2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7"]
Jun 03 01:48:25.683686 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.683643    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jkj57"]
Jun 03 01:48:25.684287 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.684267    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5" containerName="manager"
Jun 03 01:48:25.684331 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.684293    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5" containerName="manager"
Jun 03 01:48:25.684404 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.684391    2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5" containerName="manager"
Jun 03 01:48:25.687995 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.687976    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jkj57"
Jun 03 01:48:25.690075 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.690041    2577 status_manager.go:895] "Failed to get status for pod" podUID="850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-plmm7\" is forbidden: User \"system:node:ip-10-0-137-62.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-62.ec2.internal' and this object"
Jun 03 01:48:25.698851 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.698818    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jkj57"]
Jun 03 01:48:25.748530 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.748499    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8ptr\" (UniqueName: \"kubernetes.io/projected/ab448351-e834-418b-b3f6-4d16401a0e23-kube-api-access-k8ptr\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-jkj57\" (UID: \"ab448351-e834-418b-b3f6-4d16401a0e23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jkj57"
Jun 03 01:48:25.748791 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.748739    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab448351-e834-418b-b3f6-4d16401a0e23-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-jkj57\" (UID: \"ab448351-e834-418b-b3f6-4d16401a0e23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jkj57"
Jun 03 01:48:25.850198 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.850164    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab448351-e834-418b-b3f6-4d16401a0e23-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-jkj57\" (UID: \"ab448351-e834-418b-b3f6-4d16401a0e23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jkj57"
Jun 03 01:48:25.850373 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.850232    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8ptr\" (UniqueName: \"kubernetes.io/projected/ab448351-e834-418b-b3f6-4d16401a0e23-kube-api-access-k8ptr\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-jkj57\" (UID: \"ab448351-e834-418b-b3f6-4d16401a0e23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jkj57"
Jun 03 01:48:25.850606 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.850565    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab448351-e834-418b-b3f6-4d16401a0e23-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-jkj57\" (UID: \"ab448351-e834-418b-b3f6-4d16401a0e23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jkj57"
Jun 03 01:48:25.861522 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.861495    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8ptr\" (UniqueName: \"kubernetes.io/projected/ab448351-e834-418b-b3f6-4d16401a0e23-kube-api-access-k8ptr\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-jkj57\" (UID: \"ab448351-e834-418b-b3f6-4d16401a0e23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jkj57"
Jun 03 01:48:25.905096 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.905072    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7"
Jun 03 01:48:25.907147 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.907111    2577 status_manager.go:895] "Failed to get status for pod" podUID="850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-plmm7\" is forbidden: User \"system:node:ip-10-0-137-62.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-62.ec2.internal' and this object"
Jun 03 01:48:25.931241 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.931146    2577 generic.go:358] "Generic (PLEG): container finished" podID="850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5" containerID="d52a1e7df1954cf76c159fcbcef7ceb70c5cf7180ad0ba66d8b0ebb9e25dd887" exitCode=0
Jun 03 01:48:25.931241 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.931194    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7"
Jun 03 01:48:25.931241 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.931222    2577 scope.go:117] "RemoveContainer" containerID="d52a1e7df1954cf76c159fcbcef7ceb70c5cf7180ad0ba66d8b0ebb9e25dd887"
Jun 03 01:48:25.933388 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.933363    2577 status_manager.go:895] "Failed to get status for pod" podUID="850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-plmm7\" is forbidden: User \"system:node:ip-10-0-137-62.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-62.ec2.internal' and this object"
Jun 03 01:48:25.939742 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.939719    2577 scope.go:117] "RemoveContainer" containerID="d52a1e7df1954cf76c159fcbcef7ceb70c5cf7180ad0ba66d8b0ebb9e25dd887"
Jun 03 01:48:25.940022 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:48:25.940005    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d52a1e7df1954cf76c159fcbcef7ceb70c5cf7180ad0ba66d8b0ebb9e25dd887\": container with ID starting with d52a1e7df1954cf76c159fcbcef7ceb70c5cf7180ad0ba66d8b0ebb9e25dd887 not found: ID does not exist" containerID="d52a1e7df1954cf76c159fcbcef7ceb70c5cf7180ad0ba66d8b0ebb9e25dd887"
Jun 03 01:48:25.940075 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.940030    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d52a1e7df1954cf76c159fcbcef7ceb70c5cf7180ad0ba66d8b0ebb9e25dd887"} err="failed to get container status \"d52a1e7df1954cf76c159fcbcef7ceb70c5cf7180ad0ba66d8b0ebb9e25dd887\": rpc error: code = NotFound desc = could not find container \"d52a1e7df1954cf76c159fcbcef7ceb70c5cf7180ad0ba66d8b0ebb9e25dd887\": container with ID starting with d52a1e7df1954cf76c159fcbcef7ceb70c5cf7180ad0ba66d8b0ebb9e25dd887 not found: ID does not exist"
Jun 03 01:48:25.951389 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.951364    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5-extensions-socket-volume\") pod \"850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5\" (UID: \"850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5\") "
Jun 03 01:48:25.951504 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.951455    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfxfk\" (UniqueName: \"kubernetes.io/projected/850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5-kube-api-access-gfxfk\") pod \"850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5\" (UID: \"850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5\") "
Jun 03 01:48:25.951844 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.951821    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5" (UID: "850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 01:48:25.953392 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:25.953366    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5-kube-api-access-gfxfk" (OuterVolumeSpecName: "kube-api-access-gfxfk") pod "850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5" (UID: "850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5"). InnerVolumeSpecName "kube-api-access-gfxfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:48:26.052034 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:26.051995    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jkj57"
Jun 03 01:48:26.052226 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:26.052203    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfxfk\" (UniqueName: \"kubernetes.io/projected/850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5-kube-api-access-gfxfk\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:48:26.052273 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:26.052231    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5-extensions-socket-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:48:26.198383 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:26.198204    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jkj57"]
Jun 03 01:48:26.201555 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:48:26.201526    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab448351_e834_418b_b3f6_4d16401a0e23.slice/crio-5ce56814e3e8eed94854203a1c6cbc484264882a68bfb64375026472bd8bb2a3 WatchSource:0}: Error finding container 5ce56814e3e8eed94854203a1c6cbc484264882a68bfb64375026472bd8bb2a3: Status 404 returned error can't find the container with id 5ce56814e3e8eed94854203a1c6cbc484264882a68bfb64375026472bd8bb2a3
Jun 03 01:48:26.243848 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:26.243816    2577 status_manager.go:895] "Failed to get status for pod" podUID="850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-plmm7\" is forbidden: User \"system:node:ip-10-0-137-62.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-62.ec2.internal' and this object"
Jun 03 01:48:26.937752 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:26.937717    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jkj57" event={"ID":"ab448351-e834-418b-b3f6-4d16401a0e23","Type":"ContainerStarted","Data":"27c21674329a6275458c6ea50d0e0f87ffb79ad65251fe2b2691861532cf6b6f"}
Jun 03 01:48:26.937752 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:26.937752    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jkj57" event={"ID":"ab448351-e834-418b-b3f6-4d16401a0e23","Type":"ContainerStarted","Data":"5ce56814e3e8eed94854203a1c6cbc484264882a68bfb64375026472bd8bb2a3"}
Jun 03 01:48:26.938206 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:26.937826    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jkj57"
Jun 03 01:48:26.939750 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:26.939728    2577 status_manager.go:895] "Failed to get status for pod" podUID="850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-plmm7" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-plmm7\" is forbidden: User \"system:node:ip-10-0-137-62.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-62.ec2.internal' and this object"
Jun 03 01:48:26.959834 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:26.959774    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jkj57" podStartSLOduration=1.9597589499999999 podStartE2EDuration="1.95975895s" podCreationTimestamp="2026-06-03 01:48:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:48:26.956993283 +0000 UTC m=+476.521389097" watchObservedRunningTime="2026-06-03 01:48:26.95975895 +0000 UTC m=+476.524154800"
Jun 03 01:48:27.079510 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:27.079472    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5" path="/var/lib/kubelet/pods/850b9153-f2b7-4a8e-a897-b3b8cf0cb9b5/volumes"
Jun 03 01:48:37.944948 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:37.944913    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jkj57"
Jun 03 01:48:40.965477 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:40.965430    2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-94f69bbc4-sk8p2" podUID="baa381b8-9b05-4db2-a167-8970680d3751" containerName="console" containerID="cri-o://c658e2e8b22157c9bf678204ae6a35944318c16b390cd61a42cdfccbb43359df" gracePeriod=15
Jun 03 01:48:41.232162 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.232133    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-94f69bbc4-sk8p2_baa381b8-9b05-4db2-a167-8970680d3751/console/0.log"
Jun 03 01:48:41.232280 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.232193    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:48:41.393265 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.393226    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/baa381b8-9b05-4db2-a167-8970680d3751-console-serving-cert\") pod \"baa381b8-9b05-4db2-a167-8970680d3751\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") "
Jun 03 01:48:41.393265 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.393274    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tphz6\" (UniqueName: \"kubernetes.io/projected/baa381b8-9b05-4db2-a167-8970680d3751-kube-api-access-tphz6\") pod \"baa381b8-9b05-4db2-a167-8970680d3751\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") "
Jun 03 01:48:41.393543 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.393291    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/baa381b8-9b05-4db2-a167-8970680d3751-service-ca\") pod \"baa381b8-9b05-4db2-a167-8970680d3751\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") "
Jun 03 01:48:41.393543 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.393316    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/baa381b8-9b05-4db2-a167-8970680d3751-console-oauth-config\") pod \"baa381b8-9b05-4db2-a167-8970680d3751\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") "
Jun 03 01:48:41.393543 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.393372    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/baa381b8-9b05-4db2-a167-8970680d3751-console-config\") pod \"baa381b8-9b05-4db2-a167-8970680d3751\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") "
Jun 03 01:48:41.393543 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.393422    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baa381b8-9b05-4db2-a167-8970680d3751-trusted-ca-bundle\") pod \"baa381b8-9b05-4db2-a167-8970680d3751\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") "
Jun 03 01:48:41.393543 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.393522    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/baa381b8-9b05-4db2-a167-8970680d3751-oauth-serving-cert\") pod \"baa381b8-9b05-4db2-a167-8970680d3751\" (UID: \"baa381b8-9b05-4db2-a167-8970680d3751\") "
Jun 03 01:48:41.393941 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.393909    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/baa381b8-9b05-4db2-a167-8970680d3751-console-config" (OuterVolumeSpecName: "console-config") pod "baa381b8-9b05-4db2-a167-8970680d3751" (UID: "baa381b8-9b05-4db2-a167-8970680d3751"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 01:48:41.394070 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.393938    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/baa381b8-9b05-4db2-a167-8970680d3751-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "baa381b8-9b05-4db2-a167-8970680d3751" (UID: "baa381b8-9b05-4db2-a167-8970680d3751"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 01:48:41.394070 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.393959    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/baa381b8-9b05-4db2-a167-8970680d3751-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "baa381b8-9b05-4db2-a167-8970680d3751" (UID: "baa381b8-9b05-4db2-a167-8970680d3751"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 01:48:41.394070 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.393993    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/baa381b8-9b05-4db2-a167-8970680d3751-service-ca" (OuterVolumeSpecName: "service-ca") pod "baa381b8-9b05-4db2-a167-8970680d3751" (UID: "baa381b8-9b05-4db2-a167-8970680d3751"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 01:48:41.395555 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.395533    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baa381b8-9b05-4db2-a167-8970680d3751-kube-api-access-tphz6" (OuterVolumeSpecName: "kube-api-access-tphz6") pod "baa381b8-9b05-4db2-a167-8970680d3751" (UID: "baa381b8-9b05-4db2-a167-8970680d3751"). InnerVolumeSpecName "kube-api-access-tphz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:48:41.395694 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.395532    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baa381b8-9b05-4db2-a167-8970680d3751-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "baa381b8-9b05-4db2-a167-8970680d3751" (UID: "baa381b8-9b05-4db2-a167-8970680d3751"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 01:48:41.395694 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.395601    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baa381b8-9b05-4db2-a167-8970680d3751-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "baa381b8-9b05-4db2-a167-8970680d3751" (UID: "baa381b8-9b05-4db2-a167-8970680d3751"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 01:48:41.494808 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.494717    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/baa381b8-9b05-4db2-a167-8970680d3751-oauth-serving-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:48:41.494808 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.494748    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/baa381b8-9b05-4db2-a167-8970680d3751-console-serving-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:48:41.494808 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.494758    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tphz6\" (UniqueName: \"kubernetes.io/projected/baa381b8-9b05-4db2-a167-8970680d3751-kube-api-access-tphz6\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:48:41.494808 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.494768    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/baa381b8-9b05-4db2-a167-8970680d3751-service-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:48:41.494808 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.494779    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/baa381b8-9b05-4db2-a167-8970680d3751-console-oauth-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:48:41.494808 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.494787    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/baa381b8-9b05-4db2-a167-8970680d3751-console-config\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:48:41.494808 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.494797    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baa381b8-9b05-4db2-a167-8970680d3751-trusted-ca-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:48:41.998043 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.998009    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-94f69bbc4-sk8p2_baa381b8-9b05-4db2-a167-8970680d3751/console/0.log"
Jun 03 01:48:41.998496 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.998056    2577 generic.go:358] "Generic (PLEG): container finished" podID="baa381b8-9b05-4db2-a167-8970680d3751" containerID="c658e2e8b22157c9bf678204ae6a35944318c16b390cd61a42cdfccbb43359df" exitCode=2
Jun 03 01:48:41.998496 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.998112    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-94f69bbc4-sk8p2" event={"ID":"baa381b8-9b05-4db2-a167-8970680d3751","Type":"ContainerDied","Data":"c658e2e8b22157c9bf678204ae6a35944318c16b390cd61a42cdfccbb43359df"}
Jun 03 01:48:41.998496 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.998120    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-94f69bbc4-sk8p2"
Jun 03 01:48:41.998496 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.998151    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-94f69bbc4-sk8p2" event={"ID":"baa381b8-9b05-4db2-a167-8970680d3751","Type":"ContainerDied","Data":"b96b6d3a86eebac888a4cd803c679d2077ee45fd9d006f5331a30131a13faedd"}
Jun 03 01:48:41.998496 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:41.998173    2577 scope.go:117] "RemoveContainer" containerID="c658e2e8b22157c9bf678204ae6a35944318c16b390cd61a42cdfccbb43359df"
Jun 03 01:48:42.015800 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:42.015771    2577 scope.go:117] "RemoveContainer" containerID="c658e2e8b22157c9bf678204ae6a35944318c16b390cd61a42cdfccbb43359df"
Jun 03 01:48:42.016166 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:48:42.016141    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c658e2e8b22157c9bf678204ae6a35944318c16b390cd61a42cdfccbb43359df\": container with ID starting with c658e2e8b22157c9bf678204ae6a35944318c16b390cd61a42cdfccbb43359df not found: ID does not exist" containerID="c658e2e8b22157c9bf678204ae6a35944318c16b390cd61a42cdfccbb43359df"
Jun 03 01:48:42.016266 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:42.016178    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c658e2e8b22157c9bf678204ae6a35944318c16b390cd61a42cdfccbb43359df"} err="failed to get container status \"c658e2e8b22157c9bf678204ae6a35944318c16b390cd61a42cdfccbb43359df\": rpc error: code = NotFound desc = could not find container \"c658e2e8b22157c9bf678204ae6a35944318c16b390cd61a42cdfccbb43359df\": container with ID starting with c658e2e8b22157c9bf678204ae6a35944318c16b390cd61a42cdfccbb43359df not found: ID does not exist"
Jun 03 01:48:42.027756 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:42.027654    2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-94f69bbc4-sk8p2"]
Jun 03 01:48:42.030928 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:42.030904    2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-94f69bbc4-sk8p2"]
Jun 03 01:48:42.766329 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:42.766294    2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jkj57"]
Jun 03 01:48:42.766541 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:42.766518    2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jkj57" podUID="ab448351-e834-418b-b3f6-4d16401a0e23" containerName="manager" containerID="cri-o://27c21674329a6275458c6ea50d0e0f87ffb79ad65251fe2b2691861532cf6b6f" gracePeriod=10
Jun 03 01:48:43.006714 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.006684    2577 generic.go:358] "Generic (PLEG): container finished" podID="ab448351-e834-418b-b3f6-4d16401a0e23" containerID="27c21674329a6275458c6ea50d0e0f87ffb79ad65251fe2b2691861532cf6b6f" exitCode=0
Jun 03 01:48:43.007066 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.006762    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jkj57" event={"ID":"ab448351-e834-418b-b3f6-4d16401a0e23","Type":"ContainerDied","Data":"27c21674329a6275458c6ea50d0e0f87ffb79ad65251fe2b2691861532cf6b6f"}
Jun 03 01:48:43.007066 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.006807    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jkj57" event={"ID":"ab448351-e834-418b-b3f6-4d16401a0e23","Type":"ContainerDied","Data":"5ce56814e3e8eed94854203a1c6cbc484264882a68bfb64375026472bd8bb2a3"}
Jun 03 01:48:43.007066 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.006821    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ce56814e3e8eed94854203a1c6cbc484264882a68bfb64375026472bd8bb2a3"
Jun 03 01:48:43.017253 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.017180    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jkj57"
Jun 03 01:48:43.018709 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.018688    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-24bzf"]
Jun 03 01:48:43.019072 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.019060    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab448351-e834-418b-b3f6-4d16401a0e23" containerName="manager"
Jun 03 01:48:43.019119 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.019073    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab448351-e834-418b-b3f6-4d16401a0e23" containerName="manager"
Jun 03 01:48:43.019119 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.019084    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baa381b8-9b05-4db2-a167-8970680d3751" containerName="console"
Jun 03 01:48:43.019119 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.019090    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="baa381b8-9b05-4db2-a167-8970680d3751" containerName="console"
Jun 03 01:48:43.019209 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.019154    2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="ab448351-e834-418b-b3f6-4d16401a0e23" containerName="manager"
Jun 03 01:48:43.019209 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.019162    2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="baa381b8-9b05-4db2-a167-8970680d3751" containerName="console"
Jun 03 01:48:43.022263 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.022248    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-24bzf"
Jun 03 01:48:43.039049 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.039017    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-24bzf"]
Jun 03 01:48:43.079543 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.079508    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baa381b8-9b05-4db2-a167-8970680d3751" path="/var/lib/kubelet/pods/baa381b8-9b05-4db2-a167-8970680d3751/volumes"
Jun 03 01:48:43.108440 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.108401    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab448351-e834-418b-b3f6-4d16401a0e23-extensions-socket-volume\") pod \"ab448351-e834-418b-b3f6-4d16401a0e23\" (UID: \"ab448351-e834-418b-b3f6-4d16401a0e23\") "
Jun 03 01:48:43.108662 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.108537    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8ptr\" (UniqueName: \"kubernetes.io/projected/ab448351-e834-418b-b3f6-4d16401a0e23-kube-api-access-k8ptr\") pod \"ab448351-e834-418b-b3f6-4d16401a0e23\" (UID: \"ab448351-e834-418b-b3f6-4d16401a0e23\") "
Jun 03 01:48:43.108747 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.108731    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzpmb\" (UniqueName: \"kubernetes.io/projected/74fc8de3-0f09-40db-8184-7c9106985afb-kube-api-access-wzpmb\") pod \"kuadrant-operator-controller-manager-55c7f4c975-24bzf\" (UID: \"74fc8de3-0f09-40db-8184-7c9106985afb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-24bzf"
Jun 03 01:48:43.108809 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.108775    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74fc8de3-0f09-40db-8184-7c9106985afb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-24bzf\" (UID: \"74fc8de3-0f09-40db-8184-7c9106985afb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-24bzf"
Jun 03 01:48:43.108909 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.108882    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab448351-e834-418b-b3f6-4d16401a0e23-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ab448351-e834-418b-b3f6-4d16401a0e23" (UID: "ab448351-e834-418b-b3f6-4d16401a0e23"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 01:48:43.110755 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.110729    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab448351-e834-418b-b3f6-4d16401a0e23-kube-api-access-k8ptr" (OuterVolumeSpecName: "kube-api-access-k8ptr") pod "ab448351-e834-418b-b3f6-4d16401a0e23" (UID: "ab448351-e834-418b-b3f6-4d16401a0e23"). InnerVolumeSpecName "kube-api-access-k8ptr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:48:43.210062 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.210008    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wzpmb\" (UniqueName: \"kubernetes.io/projected/74fc8de3-0f09-40db-8184-7c9106985afb-kube-api-access-wzpmb\") pod \"kuadrant-operator-controller-manager-55c7f4c975-24bzf\" (UID: \"74fc8de3-0f09-40db-8184-7c9106985afb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-24bzf"
Jun 03 01:48:43.210263 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.210076    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74fc8de3-0f09-40db-8184-7c9106985afb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-24bzf\" (UID: \"74fc8de3-0f09-40db-8184-7c9106985afb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-24bzf"
Jun 03 01:48:43.210263 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.210211    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8ptr\" (UniqueName: \"kubernetes.io/projected/ab448351-e834-418b-b3f6-4d16401a0e23-kube-api-access-k8ptr\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:48:43.210263 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.210230    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab448351-e834-418b-b3f6-4d16401a0e23-extensions-socket-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:48:43.210490 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.210465    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74fc8de3-0f09-40db-8184-7c9106985afb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-24bzf\" (UID: \"74fc8de3-0f09-40db-8184-7c9106985afb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-24bzf"
Jun 03 01:48:43.218208 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.218180    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzpmb\" (UniqueName: \"kubernetes.io/projected/74fc8de3-0f09-40db-8184-7c9106985afb-kube-api-access-wzpmb\") pod \"kuadrant-operator-controller-manager-55c7f4c975-24bzf\" (UID: \"74fc8de3-0f09-40db-8184-7c9106985afb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-24bzf"
Jun 03 01:48:43.334422 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.334329    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-24bzf"
Jun 03 01:48:43.482838 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:43.482808    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-24bzf"]
Jun 03 01:48:43.485189 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:48:43.485160    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74fc8de3_0f09_40db_8184_7c9106985afb.slice/crio-96acbb289d2a4aebe2f0d969604fed5aae49bebba64bc10171810a71f2d0f430 WatchSource:0}: Error finding container 96acbb289d2a4aebe2f0d969604fed5aae49bebba64bc10171810a71f2d0f430: Status 404 returned error can't find the container with id 96acbb289d2a4aebe2f0d969604fed5aae49bebba64bc10171810a71f2d0f430
Jun 03 01:48:44.016173 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:44.016136    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-24bzf" event={"ID":"74fc8de3-0f09-40db-8184-7c9106985afb","Type":"ContainerStarted","Data":"5f4ca95e4e620419973c29b3e8e88d04aecafdfeadff09409b8ee9182ea48b3f"}
Jun 03 01:48:44.016173 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:44.016174    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-24bzf" event={"ID":"74fc8de3-0f09-40db-8184-7c9106985afb","Type":"ContainerStarted","Data":"96acbb289d2a4aebe2f0d969604fed5aae49bebba64bc10171810a71f2d0f430"}
Jun 03 01:48:44.016716 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:44.016330    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-24bzf"
Jun 03 01:48:44.016716 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:44.016376    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jkj57"
Jun 03 01:48:44.065039 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:44.064984    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-24bzf" podStartSLOduration=2.064968958 podStartE2EDuration="2.064968958s" podCreationTimestamp="2026-06-03 01:48:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:48:44.060461191 +0000 UTC m=+493.624857001" watchObservedRunningTime="2026-06-03 01:48:44.064968958 +0000 UTC m=+493.629364798"
Jun 03 01:48:44.098459 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:44.098425    2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jkj57"]
Jun 03 01:48:44.103257 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:44.103223    2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jkj57"]
Jun 03 01:48:45.085713 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:45.085678    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab448351-e834-418b-b3f6-4d16401a0e23" path="/var/lib/kubelet/pods/ab448351-e834-418b-b3f6-4d16401a0e23/volumes"
Jun 03 01:48:55.022461 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:48:55.022424    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-24bzf"
Jun 03 01:49:12.709549 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:12.709455    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2gpzd"]
Jun 03 01:49:12.714242 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:12.714218    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-2gpzd"
Jun 03 01:49:12.717165 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:12.717132    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jun 03 01:49:12.717412 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:12.717391    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9jrmt\""
Jun 03 01:49:12.720245 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:12.720214    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2gpzd"]
Jun 03 01:49:12.775770 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:12.775734    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b2dbe360-67d6-438c-8703-065276da9576-config-file\") pod \"limitador-limitador-7d549b5b-2gpzd\" (UID: \"b2dbe360-67d6-438c-8703-065276da9576\") " pod="kuadrant-system/limitador-limitador-7d549b5b-2gpzd"
Jun 03 01:49:12.775990 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:12.775793    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnkrx\" (UniqueName: \"kubernetes.io/projected/b2dbe360-67d6-438c-8703-065276da9576-kube-api-access-bnkrx\") pod \"limitador-limitador-7d549b5b-2gpzd\" (UID: \"b2dbe360-67d6-438c-8703-065276da9576\") " pod="kuadrant-system/limitador-limitador-7d549b5b-2gpzd"
Jun 03 01:49:12.814098 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:12.814061    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2gpzd"]
Jun 03 01:49:12.876631 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:12.876574    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b2dbe360-67d6-438c-8703-065276da9576-config-file\") pod \"limitador-limitador-7d549b5b-2gpzd\" (UID: \"b2dbe360-67d6-438c-8703-065276da9576\") " pod="kuadrant-system/limitador-limitador-7d549b5b-2gpzd"
Jun 03 01:49:12.876810 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:12.876677    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bnkrx\" (UniqueName: \"kubernetes.io/projected/b2dbe360-67d6-438c-8703-065276da9576-kube-api-access-bnkrx\") pod \"limitador-limitador-7d549b5b-2gpzd\" (UID: \"b2dbe360-67d6-438c-8703-065276da9576\") " pod="kuadrant-system/limitador-limitador-7d549b5b-2gpzd"
Jun 03 01:49:12.877254 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:12.877233    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b2dbe360-67d6-438c-8703-065276da9576-config-file\") pod \"limitador-limitador-7d549b5b-2gpzd\" (UID: \"b2dbe360-67d6-438c-8703-065276da9576\") " pod="kuadrant-system/limitador-limitador-7d549b5b-2gpzd"
Jun 03 01:49:12.884499 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:12.884470    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnkrx\" (UniqueName: \"kubernetes.io/projected/b2dbe360-67d6-438c-8703-065276da9576-kube-api-access-bnkrx\") pod \"limitador-limitador-7d549b5b-2gpzd\" (UID: \"b2dbe360-67d6-438c-8703-065276da9576\") " pod="kuadrant-system/limitador-limitador-7d549b5b-2gpzd"
Jun 03 01:49:13.025851 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:13.025759    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-2gpzd"
Jun 03 01:49:13.167322 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:13.167292    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2gpzd"]
Jun 03 01:49:13.169781 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:49:13.169748    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2dbe360_67d6_438c_8703_065276da9576.slice/crio-3bf5672a239377e6b002fcfbd5f30ca2d94ad1824d7f7421c670dcd4f703d4ea WatchSource:0}: Error finding container 3bf5672a239377e6b002fcfbd5f30ca2d94ad1824d7f7421c670dcd4f703d4ea: Status 404 returned error can't find the container with id 3bf5672a239377e6b002fcfbd5f30ca2d94ad1824d7f7421c670dcd4f703d4ea
Jun 03 01:49:14.143174 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:14.143113    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-2gpzd" event={"ID":"b2dbe360-67d6-438c-8703-065276da9576","Type":"ContainerStarted","Data":"3bf5672a239377e6b002fcfbd5f30ca2d94ad1824d7f7421c670dcd4f703d4ea"}
Jun 03 01:49:16.158100 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:16.158062    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-2gpzd" event={"ID":"b2dbe360-67d6-438c-8703-065276da9576","Type":"ContainerStarted","Data":"c02b41f1de31c793436c0bd0f848fb859e8180e20c01c4706c162c9599ea430b"}
Jun 03 01:49:16.158521 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:16.158209    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-2gpzd"
Jun 03 01:49:16.174966 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:16.174915    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-2gpzd" podStartSLOduration=1.485441271 podStartE2EDuration="4.174899718s" podCreationTimestamp="2026-06-03 01:49:12 +0000 UTC" firstStartedPulling="2026-06-03 01:49:13.171565267 +0000 UTC m=+522.735961061" lastFinishedPulling="2026-06-03 01:49:15.861023715 +0000 UTC m=+525.425419508" observedRunningTime="2026-06-03 01:49:16.172166099 +0000 UTC m=+525.736562070" watchObservedRunningTime="2026-06-03 01:49:16.174899718 +0000 UTC m=+525.739295528"
Jun 03 01:49:27.163909 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:27.163880    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-2gpzd"
Jun 03 01:49:30.075735 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:30.075693    2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2gpzd"]
Jun 03 01:49:30.076119 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:30.075928    2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-2gpzd" podUID="b2dbe360-67d6-438c-8703-065276da9576" containerName="limitador" containerID="cri-o://c02b41f1de31c793436c0bd0f848fb859e8180e20c01c4706c162c9599ea430b" gracePeriod=30
Jun 03 01:49:30.634307 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:30.634282    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-2gpzd"
Jun 03 01:49:30.735103 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:30.735005    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnkrx\" (UniqueName: \"kubernetes.io/projected/b2dbe360-67d6-438c-8703-065276da9576-kube-api-access-bnkrx\") pod \"b2dbe360-67d6-438c-8703-065276da9576\" (UID: \"b2dbe360-67d6-438c-8703-065276da9576\") "
Jun 03 01:49:30.735275 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:30.735144    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b2dbe360-67d6-438c-8703-065276da9576-config-file\") pod \"b2dbe360-67d6-438c-8703-065276da9576\" (UID: \"b2dbe360-67d6-438c-8703-065276da9576\") "
Jun 03 01:49:30.735484 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:30.735458    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2dbe360-67d6-438c-8703-065276da9576-config-file" (OuterVolumeSpecName: "config-file") pod "b2dbe360-67d6-438c-8703-065276da9576" (UID: "b2dbe360-67d6-438c-8703-065276da9576"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 01:49:30.737185 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:30.737146    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2dbe360-67d6-438c-8703-065276da9576-kube-api-access-bnkrx" (OuterVolumeSpecName: "kube-api-access-bnkrx") pod "b2dbe360-67d6-438c-8703-065276da9576" (UID: "b2dbe360-67d6-438c-8703-065276da9576"). InnerVolumeSpecName "kube-api-access-bnkrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:49:30.836639 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:30.836603    2577 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b2dbe360-67d6-438c-8703-065276da9576-config-file\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:49:30.836639 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:30.836635    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnkrx\" (UniqueName: \"kubernetes.io/projected/b2dbe360-67d6-438c-8703-065276da9576-kube-api-access-bnkrx\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:49:31.220317 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:31.220283    2577 generic.go:358] "Generic (PLEG): container finished" podID="b2dbe360-67d6-438c-8703-065276da9576" containerID="c02b41f1de31c793436c0bd0f848fb859e8180e20c01c4706c162c9599ea430b" exitCode=0
Jun 03 01:49:31.220778 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:31.220364    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-2gpzd"
Jun 03 01:49:31.220778 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:31.220364    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-2gpzd" event={"ID":"b2dbe360-67d6-438c-8703-065276da9576","Type":"ContainerDied","Data":"c02b41f1de31c793436c0bd0f848fb859e8180e20c01c4706c162c9599ea430b"}
Jun 03 01:49:31.220778 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:31.220401    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-2gpzd" event={"ID":"b2dbe360-67d6-438c-8703-065276da9576","Type":"ContainerDied","Data":"3bf5672a239377e6b002fcfbd5f30ca2d94ad1824d7f7421c670dcd4f703d4ea"}
Jun 03 01:49:31.220778 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:31.220416    2577 scope.go:117] "RemoveContainer" containerID="c02b41f1de31c793436c0bd0f848fb859e8180e20c01c4706c162c9599ea430b"
Jun 03 01:49:31.228777 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:31.228759    2577 scope.go:117] "RemoveContainer" containerID="c02b41f1de31c793436c0bd0f848fb859e8180e20c01c4706c162c9599ea430b"
Jun 03 01:49:31.229029 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:49:31.229009    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c02b41f1de31c793436c0bd0f848fb859e8180e20c01c4706c162c9599ea430b\": container with ID starting with c02b41f1de31c793436c0bd0f848fb859e8180e20c01c4706c162c9599ea430b not found: ID does not exist" containerID="c02b41f1de31c793436c0bd0f848fb859e8180e20c01c4706c162c9599ea430b"
Jun 03 01:49:31.229076 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:31.229041    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c02b41f1de31c793436c0bd0f848fb859e8180e20c01c4706c162c9599ea430b"} err="failed to get container status \"c02b41f1de31c793436c0bd0f848fb859e8180e20c01c4706c162c9599ea430b\": rpc error: code = NotFound desc = could not find container \"c02b41f1de31c793436c0bd0f848fb859e8180e20c01c4706c162c9599ea430b\": container with ID starting with c02b41f1de31c793436c0bd0f848fb859e8180e20c01c4706c162c9599ea430b not found: ID does not exist"
Jun 03 01:49:31.237114 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:31.237088    2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2gpzd"]
Jun 03 01:49:31.240654 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:31.240628    2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2gpzd"]
Jun 03 01:49:33.078989 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:33.078955    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2dbe360-67d6-438c-8703-065276da9576" path="/var/lib/kubelet/pods/b2dbe360-67d6-438c-8703-065276da9576/volumes"
Jun 03 01:49:34.559312 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:34.559272    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-8zhds"]
Jun 03 01:49:34.559727 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:34.559661    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2dbe360-67d6-438c-8703-065276da9576" containerName="limitador"
Jun 03 01:49:34.559727 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:34.559674    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2dbe360-67d6-438c-8703-065276da9576" containerName="limitador"
Jun 03 01:49:34.559808 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:34.559758    2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="b2dbe360-67d6-438c-8703-065276da9576" containerName="limitador"
Jun 03 01:49:34.566517 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:34.566484    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-8zhds"
Jun 03 01:49:34.569063 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:34.569037    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jun 03 01:49:34.571041 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:34.571012    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-8zhds"]
Jun 03 01:49:34.673332 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:34.673288    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlg4m\" (UniqueName: \"kubernetes.io/projected/1ebcebd3-f875-414a-9a68-8d794aee429d-kube-api-access-nlg4m\") pod \"postgres-68c4fbbd6f-8zhds\" (UID: \"1ebcebd3-f875-414a-9a68-8d794aee429d\") " pod="opendatahub/postgres-68c4fbbd6f-8zhds"
Jun 03 01:49:34.673533 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:34.673369    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1ebcebd3-f875-414a-9a68-8d794aee429d-data\") pod \"postgres-68c4fbbd6f-8zhds\" (UID: \"1ebcebd3-f875-414a-9a68-8d794aee429d\") " pod="opendatahub/postgres-68c4fbbd6f-8zhds"
Jun 03 01:49:34.774971 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:34.774933    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nlg4m\" (UniqueName: \"kubernetes.io/projected/1ebcebd3-f875-414a-9a68-8d794aee429d-kube-api-access-nlg4m\") pod \"postgres-68c4fbbd6f-8zhds\" (UID: \"1ebcebd3-f875-414a-9a68-8d794aee429d\") " pod="opendatahub/postgres-68c4fbbd6f-8zhds"
Jun 03 01:49:34.775199 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:34.774994    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1ebcebd3-f875-414a-9a68-8d794aee429d-data\") pod \"postgres-68c4fbbd6f-8zhds\" (UID: \"1ebcebd3-f875-414a-9a68-8d794aee429d\") " pod="opendatahub/postgres-68c4fbbd6f-8zhds"
Jun 03 01:49:34.775359 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:34.775339    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1ebcebd3-f875-414a-9a68-8d794aee429d-data\") pod \"postgres-68c4fbbd6f-8zhds\" (UID: \"1ebcebd3-f875-414a-9a68-8d794aee429d\") " pod="opendatahub/postgres-68c4fbbd6f-8zhds"
Jun 03 01:49:34.783516 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:34.783484    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlg4m\" (UniqueName: \"kubernetes.io/projected/1ebcebd3-f875-414a-9a68-8d794aee429d-kube-api-access-nlg4m\") pod \"postgres-68c4fbbd6f-8zhds\" (UID: \"1ebcebd3-f875-414a-9a68-8d794aee429d\") " pod="opendatahub/postgres-68c4fbbd6f-8zhds"
Jun 03 01:49:34.879670 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:34.879630    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-8zhds"
Jun 03 01:49:35.014165 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:35.014133    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-8zhds"]
Jun 03 01:49:35.015467 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:49:35.015439    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ebcebd3_f875_414a_9a68_8d794aee429d.slice/crio-c241f144960ba5b70b472fe2da206ebd11c0540e2bd02765bc3878215a81f240 WatchSource:0}: Error finding container c241f144960ba5b70b472fe2da206ebd11c0540e2bd02765bc3878215a81f240: Status 404 returned error can't find the container with id c241f144960ba5b70b472fe2da206ebd11c0540e2bd02765bc3878215a81f240
Jun 03 01:49:35.238178 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:35.238085    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-8zhds" event={"ID":"1ebcebd3-f875-414a-9a68-8d794aee429d","Type":"ContainerStarted","Data":"c241f144960ba5b70b472fe2da206ebd11c0540e2bd02765bc3878215a81f240"}
Jun 03 01:49:39.257096 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:39.257059    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-8zhds" event={"ID":"1ebcebd3-f875-414a-9a68-8d794aee429d","Type":"ContainerStarted","Data":"9b44a86fdc9fdf3f7a35911c12d9713389dd9d13ebe709be42b50c67eb0c160b"}
Jun 03 01:49:39.257539 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:39.257177    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-8zhds"
Jun 03 01:49:39.272529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:39.272474    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-8zhds" podStartSLOduration=1.823119599 podStartE2EDuration="5.272460964s" podCreationTimestamp="2026-06-03 01:49:34 +0000 UTC" firstStartedPulling="2026-06-03 01:49:35.016849484 +0000 UTC m=+544.581245276" lastFinishedPulling="2026-06-03 01:49:38.46619084 +0000 UTC m=+548.030586641" observedRunningTime="2026-06-03 01:49:39.271216647 +0000 UTC m=+548.835612458" watchObservedRunningTime="2026-06-03 01:49:39.272460964 +0000 UTC m=+548.836856774"
Jun 03 01:49:45.292863 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:45.292831    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-8zhds"
Jun 03 01:49:46.718473 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:46.718434    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d"]
Jun 03 01:49:46.722146 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:46.722126    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d"
Jun 03 01:49:46.724792 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:46.724768    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 03 01:49:46.724908 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:46.724769    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 03 01:49:46.725555 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:46.725536    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qh4d6\""
Jun 03 01:49:46.730012 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:46.729991    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d"]
Jun 03 01:49:46.888172 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:46.888132    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8f7q\" (UniqueName: \"kubernetes.io/projected/54d02e73-37bb-449e-8928-533d5c5c1c02-kube-api-access-w8f7q\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d\" (UID: \"54d02e73-37bb-449e-8928-533d5c5c1c02\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d"
Jun 03 01:49:46.888172 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:46.888176    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54d02e73-37bb-449e-8928-533d5c5c1c02-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d\" (UID: \"54d02e73-37bb-449e-8928-533d5c5c1c02\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d"
Jun 03 01:49:46.888386 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:46.888264    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54d02e73-37bb-449e-8928-533d5c5c1c02-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d\" (UID: \"54d02e73-37bb-449e-8928-533d5c5c1c02\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d"
Jun 03 01:49:46.989323 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:46.989223    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w8f7q\" (UniqueName: \"kubernetes.io/projected/54d02e73-37bb-449e-8928-533d5c5c1c02-kube-api-access-w8f7q\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d\" (UID: \"54d02e73-37bb-449e-8928-533d5c5c1c02\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d"
Jun 03 01:49:46.989323 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:46.989271    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54d02e73-37bb-449e-8928-533d5c5c1c02-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d\" (UID: \"54d02e73-37bb-449e-8928-533d5c5c1c02\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d"
Jun 03 01:49:46.989323 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:46.989312    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54d02e73-37bb-449e-8928-533d5c5c1c02-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d\" (UID: \"54d02e73-37bb-449e-8928-533d5c5c1c02\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d"
Jun 03 01:49:46.989729 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:46.989713    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54d02e73-37bb-449e-8928-533d5c5c1c02-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d\" (UID: \"54d02e73-37bb-449e-8928-533d5c5c1c02\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d"
Jun 03 01:49:46.989780 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:46.989760    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54d02e73-37bb-449e-8928-533d5c5c1c02-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d\" (UID: \"54d02e73-37bb-449e-8928-533d5c5c1c02\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d"
Jun 03 01:49:46.997950 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:46.997919    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8f7q\" (UniqueName: \"kubernetes.io/projected/54d02e73-37bb-449e-8928-533d5c5c1c02-kube-api-access-w8f7q\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d\" (UID: \"54d02e73-37bb-449e-8928-533d5c5c1c02\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d"
Jun 03 01:49:47.032535 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:47.032478    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d"
Jun 03 01:49:47.171881 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:47.171851    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d"]
Jun 03 01:49:47.174109 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:49:47.174080    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54d02e73_37bb_449e_8928_533d5c5c1c02.slice/crio-9f317f21e18ae3e883d06db385154b5a765b65a8080f681174fa0d574d8d7b3c WatchSource:0}: Error finding container 9f317f21e18ae3e883d06db385154b5a765b65a8080f681174fa0d574d8d7b3c: Status 404 returned error can't find the container with id 9f317f21e18ae3e883d06db385154b5a765b65a8080f681174fa0d574d8d7b3c
Jun 03 01:49:47.290950 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:47.290916    2577 generic.go:358] "Generic (PLEG): container finished" podID="54d02e73-37bb-449e-8928-533d5c5c1c02" containerID="6d09b64e2332275a68c72b5adf0d8d5801c1c0ae4a549be0f2a93d93964cf6da" exitCode=0
Jun 03 01:49:47.291097 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:47.290990    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d" event={"ID":"54d02e73-37bb-449e-8928-533d5c5c1c02","Type":"ContainerDied","Data":"6d09b64e2332275a68c72b5adf0d8d5801c1c0ae4a549be0f2a93d93964cf6da"}
Jun 03 01:49:47.291097 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:47.291023    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d" event={"ID":"54d02e73-37bb-449e-8928-533d5c5c1c02","Type":"ContainerStarted","Data":"9f317f21e18ae3e883d06db385154b5a765b65a8080f681174fa0d574d8d7b3c"}
Jun 03 01:49:48.296577 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:48.296488    2577 generic.go:358] "Generic (PLEG): container finished" podID="54d02e73-37bb-449e-8928-533d5c5c1c02" containerID="959895880c8de11ce1864fe26640c4e1c4eccaf355fe9037927722c3fc2e658a" exitCode=0
Jun 03 01:49:48.296577 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:48.296519    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d" event={"ID":"54d02e73-37bb-449e-8928-533d5c5c1c02","Type":"ContainerDied","Data":"959895880c8de11ce1864fe26640c4e1c4eccaf355fe9037927722c3fc2e658a"}
Jun 03 01:49:49.302166 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:49.302129    2577 generic.go:358] "Generic (PLEG): container finished" podID="54d02e73-37bb-449e-8928-533d5c5c1c02" containerID="0c266684d4edf156ac8ab18cacbd48fb2f9f23ce3b5ee8b799b17902b7ebf92e" exitCode=0
Jun 03 01:49:49.302524 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:49.302210    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d" event={"ID":"54d02e73-37bb-449e-8928-533d5c5c1c02","Type":"ContainerDied","Data":"0c266684d4edf156ac8ab18cacbd48fb2f9f23ce3b5ee8b799b17902b7ebf92e"}
Jun 03 01:49:50.444186 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:50.444162    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d"
Jun 03 01:49:50.623067 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:50.623037    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54d02e73-37bb-449e-8928-533d5c5c1c02-util\") pod \"54d02e73-37bb-449e-8928-533d5c5c1c02\" (UID: \"54d02e73-37bb-449e-8928-533d5c5c1c02\") "
Jun 03 01:49:50.623244 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:50.623103    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54d02e73-37bb-449e-8928-533d5c5c1c02-bundle\") pod \"54d02e73-37bb-449e-8928-533d5c5c1c02\" (UID: \"54d02e73-37bb-449e-8928-533d5c5c1c02\") "
Jun 03 01:49:50.623244 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:50.623186    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8f7q\" (UniqueName: \"kubernetes.io/projected/54d02e73-37bb-449e-8928-533d5c5c1c02-kube-api-access-w8f7q\") pod \"54d02e73-37bb-449e-8928-533d5c5c1c02\" (UID: \"54d02e73-37bb-449e-8928-533d5c5c1c02\") "
Jun 03 01:49:50.623643 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:50.623616    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54d02e73-37bb-449e-8928-533d5c5c1c02-bundle" (OuterVolumeSpecName: "bundle") pod "54d02e73-37bb-449e-8928-533d5c5c1c02" (UID: "54d02e73-37bb-449e-8928-533d5c5c1c02"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 01:49:50.625204 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:50.625180    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54d02e73-37bb-449e-8928-533d5c5c1c02-kube-api-access-w8f7q" (OuterVolumeSpecName: "kube-api-access-w8f7q") pod "54d02e73-37bb-449e-8928-533d5c5c1c02" (UID: "54d02e73-37bb-449e-8928-533d5c5c1c02"). InnerVolumeSpecName "kube-api-access-w8f7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:49:50.628592 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:50.628543    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54d02e73-37bb-449e-8928-533d5c5c1c02-util" (OuterVolumeSpecName: "util") pod "54d02e73-37bb-449e-8928-533d5c5c1c02" (UID: "54d02e73-37bb-449e-8928-533d5c5c1c02"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 01:49:50.724409 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:50.724368    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54d02e73-37bb-449e-8928-533d5c5c1c02-util\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:49:50.724409 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:50.724403    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54d02e73-37bb-449e-8928-533d5c5c1c02-bundle\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:49:50.724409 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:50.724413    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8f7q\" (UniqueName: \"kubernetes.io/projected/54d02e73-37bb-449e-8928-533d5c5c1c02-kube-api-access-w8f7q\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:49:51.311501 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:51.311465    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d" event={"ID":"54d02e73-37bb-449e-8928-533d5c5c1c02","Type":"ContainerDied","Data":"9f317f21e18ae3e883d06db385154b5a765b65a8080f681174fa0d574d8d7b3c"}
Jun 03 01:49:51.311501 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:51.311501    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f317f21e18ae3e883d06db385154b5a765b65a8080f681174fa0d574d8d7b3c"
Jun 03 01:49:51.311744 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:49:51.311525    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707sr2d"
Jun 03 01:50:09.837638 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:09.837599    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 01:50:09.838040 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:09.837970    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54d02e73-37bb-449e-8928-533d5c5c1c02" containerName="util"
Jun 03 01:50:09.838040 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:09.837981    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="54d02e73-37bb-449e-8928-533d5c5c1c02" containerName="util"
Jun 03 01:50:09.838040 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:09.837993    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54d02e73-37bb-449e-8928-533d5c5c1c02" containerName="extract"
Jun 03 01:50:09.838040 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:09.837999    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="54d02e73-37bb-449e-8928-533d5c5c1c02" containerName="extract"
Jun 03 01:50:09.838040 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:09.838010    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54d02e73-37bb-449e-8928-533d5c5c1c02" containerName="pull"
Jun 03 01:50:09.838040 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:09.838015    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="54d02e73-37bb-449e-8928-533d5c5c1c02" containerName="pull"
Jun 03 01:50:09.838240 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:09.838073    2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="54d02e73-37bb-449e-8928-533d5c5c1c02" containerName="extract"
Jun 03 01:50:09.842366 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:09.842348    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 01:50:09.844747 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:09.844720    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
Jun 03 01:50:09.844747 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:09.844752    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
Jun 03 01:50:09.844976 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:09.844826    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
Jun 03 01:50:09.845698 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:09.845676    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-b2c8j\""
Jun 03 01:50:09.849154 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:09.849124    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 01:50:09.889262 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:09.889221    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkb2x\" (UniqueName: \"kubernetes.io/projected/be07c6fe-5f9c-4d0c-b7f4-ac86b020b951-kube-api-access-pkb2x\") pod \"maas-keycloak-0\" (UID: \"be07c6fe-5f9c-4d0c-b7f4-ac86b020b951\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 01:50:09.990134 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:09.990089    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pkb2x\" (UniqueName: \"kubernetes.io/projected/be07c6fe-5f9c-4d0c-b7f4-ac86b020b951-kube-api-access-pkb2x\") pod \"maas-keycloak-0\" (UID: \"be07c6fe-5f9c-4d0c-b7f4-ac86b020b951\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 01:50:09.997896 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:09.997872    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkb2x\" (UniqueName: \"kubernetes.io/projected/be07c6fe-5f9c-4d0c-b7f4-ac86b020b951-kube-api-access-pkb2x\") pod \"maas-keycloak-0\" (UID: \"be07c6fe-5f9c-4d0c-b7f4-ac86b020b951\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 01:50:10.154693 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:10.154660    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 01:50:10.325424 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:10.325385    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 01:50:10.327049 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:50:10.327017    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe07c6fe_5f9c_4d0c_b7f4_ac86b020b951.slice/crio-f6626394028fec4a2ac1c6187c8fc9077897354915c105403cb7c2d3f10ae3eb WatchSource:0}: Error finding container f6626394028fec4a2ac1c6187c8fc9077897354915c105403cb7c2d3f10ae3eb: Status 404 returned error can't find the container with id f6626394028fec4a2ac1c6187c8fc9077897354915c105403cb7c2d3f10ae3eb
Jun 03 01:50:10.388864 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:10.388827    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"be07c6fe-5f9c-4d0c-b7f4-ac86b020b951","Type":"ContainerStarted","Data":"f6626394028fec4a2ac1c6187c8fc9077897354915c105403cb7c2d3f10ae3eb"}
Jun 03 01:50:15.413543 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:15.413494    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"be07c6fe-5f9c-4d0c-b7f4-ac86b020b951","Type":"ContainerStarted","Data":"edbc478f5680a08189160b5b8b7c0391cf913a3e16a53b1edb3dbc21d07f77dc"}
Jun 03 01:50:15.432006 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:15.431942    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.7796130460000001 podStartE2EDuration="6.43192422s" podCreationTimestamp="2026-06-03 01:50:09 +0000 UTC" firstStartedPulling="2026-06-03 01:50:10.328325678 +0000 UTC m=+579.892721467" lastFinishedPulling="2026-06-03 01:50:14.980636839 +0000 UTC m=+584.545032641" observedRunningTime="2026-06-03 01:50:15.430908297 +0000 UTC m=+584.995304109" watchObservedRunningTime="2026-06-03 01:50:15.43192422 +0000 UTC m=+584.996320032"
Jun 03 01:50:16.155007 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:16.154963    2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
Jun 03 01:50:16.156606 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:16.156549    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="be07c6fe-5f9c-4d0c-b7f4-ac86b020b951" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused"
Jun 03 01:50:17.155684 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:17.155637    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="be07c6fe-5f9c-4d0c-b7f4-ac86b020b951" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused"
Jun 03 01:50:18.155725 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:18.155671    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="be07c6fe-5f9c-4d0c-b7f4-ac86b020b951" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused"
Jun 03 01:50:19.156137 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:19.156072    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="be07c6fe-5f9c-4d0c-b7f4-ac86b020b951" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused"
Jun 03 01:50:20.154878 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:20.154833    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
Jun 03 01:50:20.155248 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:20.155205    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="be07c6fe-5f9c-4d0c-b7f4-ac86b020b951" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused"
Jun 03 01:50:21.155824 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:21.155770    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="be07c6fe-5f9c-4d0c-b7f4-ac86b020b951" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused"
Jun 03 01:50:22.155728 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:22.155678    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="be07c6fe-5f9c-4d0c-b7f4-ac86b020b951" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused"
Jun 03 01:50:23.155767 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:23.155714    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="be07c6fe-5f9c-4d0c-b7f4-ac86b020b951" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused"
Jun 03 01:50:24.155560 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:24.155502    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="be07c6fe-5f9c-4d0c-b7f4-ac86b020b951" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused"
Jun 03 01:50:25.155172 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:25.155088    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="be07c6fe-5f9c-4d0c-b7f4-ac86b020b951" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused"
Jun 03 01:50:26.155504 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:26.155446    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="be07c6fe-5f9c-4d0c-b7f4-ac86b020b951" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused"
Jun 03 01:50:27.155884 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:27.155839    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="be07c6fe-5f9c-4d0c-b7f4-ac86b020b951" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused"
Jun 03 01:50:28.155980 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:28.155934    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="be07c6fe-5f9c-4d0c-b7f4-ac86b020b951" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused"
Jun 03 01:50:29.286661 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:29.286622    2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
Jun 03 01:50:29.306978 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:29.306911    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="be07c6fe-5f9c-4d0c-b7f4-ac86b020b951" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 01:50:31.045466 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:31.045417    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/ovn-acl-logging/0.log"
Jun 03 01:50:31.050883 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:31.050856    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/ovn-acl-logging/0.log"
Jun 03 01:50:39.293897 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:50:39.293858    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
Jun 03 01:51:19.396913 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:19.396877    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6479d59f95-lh72n"]
Jun 03 01:51:19.399342 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:19.399321    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6479d59f95-lh72n"
Jun 03 01:51:19.401660 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:19.401639    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jun 03 01:51:19.410814 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:19.410788    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6479d59f95-lh72n"]
Jun 03 01:51:19.475111 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:19.475068    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jnsh\" (UniqueName: \"kubernetes.io/projected/e5ad8095-8af4-4cee-971b-2c049ba21229-kube-api-access-7jnsh\") pod \"maas-api-6479d59f95-lh72n\" (UID: \"e5ad8095-8af4-4cee-971b-2c049ba21229\") " pod="opendatahub/maas-api-6479d59f95-lh72n"
Jun 03 01:51:19.475297 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:19.475177    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5ad8095-8af4-4cee-971b-2c049ba21229-maas-api-tls\") pod \"maas-api-6479d59f95-lh72n\" (UID: \"e5ad8095-8af4-4cee-971b-2c049ba21229\") " pod="opendatahub/maas-api-6479d59f95-lh72n"
Jun 03 01:51:19.575993 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:19.575955    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7jnsh\" (UniqueName: \"kubernetes.io/projected/e5ad8095-8af4-4cee-971b-2c049ba21229-kube-api-access-7jnsh\") pod \"maas-api-6479d59f95-lh72n\" (UID: \"e5ad8095-8af4-4cee-971b-2c049ba21229\") " pod="opendatahub/maas-api-6479d59f95-lh72n"
Jun 03 01:51:19.576177 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:19.576041    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5ad8095-8af4-4cee-971b-2c049ba21229-maas-api-tls\") pod \"maas-api-6479d59f95-lh72n\" (UID: \"e5ad8095-8af4-4cee-971b-2c049ba21229\") " pod="opendatahub/maas-api-6479d59f95-lh72n"
Jun 03 01:51:19.578470 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:19.578443    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5ad8095-8af4-4cee-971b-2c049ba21229-maas-api-tls\") pod \"maas-api-6479d59f95-lh72n\" (UID: \"e5ad8095-8af4-4cee-971b-2c049ba21229\") " pod="opendatahub/maas-api-6479d59f95-lh72n"
Jun 03 01:51:19.584484 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:19.584456    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jnsh\" (UniqueName: \"kubernetes.io/projected/e5ad8095-8af4-4cee-971b-2c049ba21229-kube-api-access-7jnsh\") pod \"maas-api-6479d59f95-lh72n\" (UID: \"e5ad8095-8af4-4cee-971b-2c049ba21229\") " pod="opendatahub/maas-api-6479d59f95-lh72n"
Jun 03 01:51:19.711255 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:19.711151    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6479d59f95-lh72n"
Jun 03 01:51:19.860944 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:19.860914    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6479d59f95-lh72n"]
Jun 03 01:51:19.862341 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:51:19.862312    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5ad8095_8af4_4cee_971b_2c049ba21229.slice/crio-328b9d8fac451539f13c73c01b09eadaf21067522dbc6b8fbd69b1d3cec2f746 WatchSource:0}: Error finding container 328b9d8fac451539f13c73c01b09eadaf21067522dbc6b8fbd69b1d3cec2f746: Status 404 returned error can't find the container with id 328b9d8fac451539f13c73c01b09eadaf21067522dbc6b8fbd69b1d3cec2f746
Jun 03 01:51:19.863709 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:19.863686    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 01:51:19.912511 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:19.912473    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-lk9cb"]
Jun 03 01:51:19.915410 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:19.915389    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-lk9cb"
Jun 03 01:51:19.917578 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:19.917553    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jun 03 01:51:19.917722 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:19.917577    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-p2n8v\""
Jun 03 01:51:19.925173 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:19.925144    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-lk9cb"]
Jun 03 01:51:19.979491 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:19.979386    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbn2c\" (UniqueName: \"kubernetes.io/projected/40cd08e3-65d5-4c91-9414-7341c2053e12-kube-api-access-fbn2c\") pod \"payload-processing-58b6c8fdc7-lk9cb\" (UID: \"40cd08e3-65d5-4c91-9414-7341c2053e12\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-lk9cb"
Jun 03 01:51:20.080232 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:20.080190    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fbn2c\" (UniqueName: \"kubernetes.io/projected/40cd08e3-65d5-4c91-9414-7341c2053e12-kube-api-access-fbn2c\") pod \"payload-processing-58b6c8fdc7-lk9cb\" (UID: \"40cd08e3-65d5-4c91-9414-7341c2053e12\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-lk9cb"
Jun 03 01:51:20.088117 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:20.088086    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbn2c\" (UniqueName: \"kubernetes.io/projected/40cd08e3-65d5-4c91-9414-7341c2053e12-kube-api-access-fbn2c\") pod \"payload-processing-58b6c8fdc7-lk9cb\" (UID: \"40cd08e3-65d5-4c91-9414-7341c2053e12\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-lk9cb"
Jun 03 01:51:20.227691 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:20.227654    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-lk9cb"
Jun 03 01:51:20.367544 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:20.367518    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-lk9cb"]
Jun 03 01:51:20.369364 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:51:20.369333    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40cd08e3_65d5_4c91_9414_7341c2053e12.slice/crio-11ca38e2049e9855f7a4b414494bc6f7e94aee3a6bb821e4f07751daa0828470 WatchSource:0}: Error finding container 11ca38e2049e9855f7a4b414494bc6f7e94aee3a6bb821e4f07751daa0828470: Status 404 returned error can't find the container with id 11ca38e2049e9855f7a4b414494bc6f7e94aee3a6bb821e4f07751daa0828470
Jun 03 01:51:20.722508 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:20.722434    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-lk9cb" event={"ID":"40cd08e3-65d5-4c91-9414-7341c2053e12","Type":"ContainerStarted","Data":"11ca38e2049e9855f7a4b414494bc6f7e94aee3a6bb821e4f07751daa0828470"}
Jun 03 01:51:20.724541 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:20.724508    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6479d59f95-lh72n" event={"ID":"e5ad8095-8af4-4cee-971b-2c049ba21229","Type":"ContainerStarted","Data":"328b9d8fac451539f13c73c01b09eadaf21067522dbc6b8fbd69b1d3cec2f746"}
Jun 03 01:51:23.740003 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:23.739970    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-lk9cb" event={"ID":"40cd08e3-65d5-4c91-9414-7341c2053e12","Type":"ContainerStarted","Data":"0f35811572991f4bf1f7af5b6a567afa8cb6b875c01de1f8fc2e80aa9a72919e"}
Jun 03 01:51:23.740474 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:23.740056    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-lk9cb"
Jun 03 01:51:23.741417 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:23.741394    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6479d59f95-lh72n" event={"ID":"e5ad8095-8af4-4cee-971b-2c049ba21229","Type":"ContainerStarted","Data":"c55658774eb58b120a27649443877c3d791739241bac43d5997abf7d8d7b516f"}
Jun 03 01:51:23.741533 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:23.741508    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6479d59f95-lh72n"
Jun 03 01:51:23.755391 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:23.755334    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-lk9cb" podStartSLOduration=1.8806988439999999 podStartE2EDuration="4.755314993s" podCreationTimestamp="2026-06-03 01:51:19 +0000 UTC" firstStartedPulling="2026-06-03 01:51:20.371079241 +0000 UTC m=+649.935475030" lastFinishedPulling="2026-06-03 01:51:23.245695376 +0000 UTC m=+652.810091179" observedRunningTime="2026-06-03 01:51:23.754297116 +0000 UTC m=+653.318692931" watchObservedRunningTime="2026-06-03 01:51:23.755314993 +0000 UTC m=+653.319710807"
Jun 03 01:51:23.769621 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:23.769560    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-6479d59f95-lh72n" podStartSLOduration=1.435090336 podStartE2EDuration="4.769537022s" podCreationTimestamp="2026-06-03 01:51:19 +0000 UTC" firstStartedPulling="2026-06-03 01:51:19.86383375 +0000 UTC m=+649.428229542" lastFinishedPulling="2026-06-03 01:51:23.198280436 +0000 UTC m=+652.762676228" observedRunningTime="2026-06-03 01:51:23.767208817 +0000 UTC m=+653.331604627" watchObservedRunningTime="2026-06-03 01:51:23.769537022 +0000 UTC m=+653.333932832"
Jun 03 01:51:29.750869 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:29.750838    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6479d59f95-lh72n"
Jun 03 01:51:31.525909 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:31.525865    2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 01:51:31.526375 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:31.526096    2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="be07c6fe-5f9c-4d0c-b7f4-ac86b020b951" containerName="keycloak" containerID="cri-o://edbc478f5680a08189160b5b8b7c0391cf913a3e16a53b1edb3dbc21d07f77dc" gracePeriod=30
Jun 03 01:51:33.572914 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.572887    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 01:51:33.607276 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.607242    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkb2x\" (UniqueName: \"kubernetes.io/projected/be07c6fe-5f9c-4d0c-b7f4-ac86b020b951-kube-api-access-pkb2x\") pod \"be07c6fe-5f9c-4d0c-b7f4-ac86b020b951\" (UID: \"be07c6fe-5f9c-4d0c-b7f4-ac86b020b951\") "
Jun 03 01:51:33.609520 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.609492    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be07c6fe-5f9c-4d0c-b7f4-ac86b020b951-kube-api-access-pkb2x" (OuterVolumeSpecName: "kube-api-access-pkb2x") pod "be07c6fe-5f9c-4d0c-b7f4-ac86b020b951" (UID: "be07c6fe-5f9c-4d0c-b7f4-ac86b020b951"). InnerVolumeSpecName "kube-api-access-pkb2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:51:33.709058 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.708959    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkb2x\" (UniqueName: \"kubernetes.io/projected/be07c6fe-5f9c-4d0c-b7f4-ac86b020b951-kube-api-access-pkb2x\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 01:51:33.783089 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.783055    2577 generic.go:358] "Generic (PLEG): container finished" podID="be07c6fe-5f9c-4d0c-b7f4-ac86b020b951" containerID="edbc478f5680a08189160b5b8b7c0391cf913a3e16a53b1edb3dbc21d07f77dc" exitCode=143
Jun 03 01:51:33.783264 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.783114    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 01:51:33.783264 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.783137    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"be07c6fe-5f9c-4d0c-b7f4-ac86b020b951","Type":"ContainerDied","Data":"edbc478f5680a08189160b5b8b7c0391cf913a3e16a53b1edb3dbc21d07f77dc"}
Jun 03 01:51:33.783264 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.783174    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"be07c6fe-5f9c-4d0c-b7f4-ac86b020b951","Type":"ContainerDied","Data":"f6626394028fec4a2ac1c6187c8fc9077897354915c105403cb7c2d3f10ae3eb"}
Jun 03 01:51:33.783264 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.783193    2577 scope.go:117] "RemoveContainer" containerID="edbc478f5680a08189160b5b8b7c0391cf913a3e16a53b1edb3dbc21d07f77dc"
Jun 03 01:51:33.792944 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.792928    2577 scope.go:117] "RemoveContainer" containerID="edbc478f5680a08189160b5b8b7c0391cf913a3e16a53b1edb3dbc21d07f77dc"
Jun 03 01:51:33.793191 ip-10-0-137-62 kubenswrapper[2577]: E0603 01:51:33.793172    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edbc478f5680a08189160b5b8b7c0391cf913a3e16a53b1edb3dbc21d07f77dc\": container with ID starting with edbc478f5680a08189160b5b8b7c0391cf913a3e16a53b1edb3dbc21d07f77dc not found: ID does not exist" containerID="edbc478f5680a08189160b5b8b7c0391cf913a3e16a53b1edb3dbc21d07f77dc"
Jun 03 01:51:33.793254 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.793204    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edbc478f5680a08189160b5b8b7c0391cf913a3e16a53b1edb3dbc21d07f77dc"} err="failed to get container status \"edbc478f5680a08189160b5b8b7c0391cf913a3e16a53b1edb3dbc21d07f77dc\": rpc error: code = NotFound desc = could not find container \"edbc478f5680a08189160b5b8b7c0391cf913a3e16a53b1edb3dbc21d07f77dc\": container with ID starting with edbc478f5680a08189160b5b8b7c0391cf913a3e16a53b1edb3dbc21d07f77dc not found: ID does not exist"
Jun 03 01:51:33.804719 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.804687    2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 01:51:33.808522 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.808496    2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 01:51:33.830026 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.829992    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 01:51:33.830414 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.830400    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be07c6fe-5f9c-4d0c-b7f4-ac86b020b951" containerName="keycloak"
Jun 03 01:51:33.830461 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.830416    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="be07c6fe-5f9c-4d0c-b7f4-ac86b020b951" containerName="keycloak"
Jun 03 01:51:33.830501 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.830482    2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="be07c6fe-5f9c-4d0c-b7f4-ac86b020b951" containerName="keycloak"
Jun 03 01:51:33.834933 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.834914    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 01:51:33.837339 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.837311    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
Jun 03 01:51:33.837469 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.837394    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
Jun 03 01:51:33.837552 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.837505    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\""
Jun 03 01:51:33.837626 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.837550    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-b2c8j\""
Jun 03 01:51:33.837735 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.837715    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
Jun 03 01:51:33.841848 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.841823    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 01:51:33.910861 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.910827    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/4385e45d-af94-4fe3-8580-9c6ae3ee50ce-test-realms\") pod \"maas-keycloak-0\" (UID: \"4385e45d-af94-4fe3-8580-9c6ae3ee50ce\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 01:51:33.911043 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:33.910879    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24lw9\" (UniqueName: \"kubernetes.io/projected/4385e45d-af94-4fe3-8580-9c6ae3ee50ce-kube-api-access-24lw9\") pod \"maas-keycloak-0\" (UID: \"4385e45d-af94-4fe3-8580-9c6ae3ee50ce\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 01:51:34.011952 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:34.011855    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/4385e45d-af94-4fe3-8580-9c6ae3ee50ce-test-realms\") pod \"maas-keycloak-0\" (UID: \"4385e45d-af94-4fe3-8580-9c6ae3ee50ce\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 01:51:34.011952 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:34.011912    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24lw9\" (UniqueName: \"kubernetes.io/projected/4385e45d-af94-4fe3-8580-9c6ae3ee50ce-kube-api-access-24lw9\") pod \"maas-keycloak-0\" (UID: \"4385e45d-af94-4fe3-8580-9c6ae3ee50ce\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 01:51:34.012627 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:34.012575    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/4385e45d-af94-4fe3-8580-9c6ae3ee50ce-test-realms\") pod \"maas-keycloak-0\" (UID: \"4385e45d-af94-4fe3-8580-9c6ae3ee50ce\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 01:51:34.019629 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:34.019569    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24lw9\" (UniqueName: \"kubernetes.io/projected/4385e45d-af94-4fe3-8580-9c6ae3ee50ce-kube-api-access-24lw9\") pod \"maas-keycloak-0\" (UID: \"4385e45d-af94-4fe3-8580-9c6ae3ee50ce\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 01:51:34.145996 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:34.145957    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 01:51:34.280063 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:34.280035    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 01:51:34.281823 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:51:34.281796    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4385e45d_af94_4fe3_8580_9c6ae3ee50ce.slice/crio-19ee04bd8353d460e47cc3758d1476a77d334da9d9ce7504ae81a9f60efc5970 WatchSource:0}: Error finding container 19ee04bd8353d460e47cc3758d1476a77d334da9d9ce7504ae81a9f60efc5970: Status 404 returned error can't find the container with id 19ee04bd8353d460e47cc3758d1476a77d334da9d9ce7504ae81a9f60efc5970
Jun 03 01:51:34.748216 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:34.748185    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-lk9cb"
Jun 03 01:51:34.799958 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:34.799926    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4385e45d-af94-4fe3-8580-9c6ae3ee50ce","Type":"ContainerStarted","Data":"19ee04bd8353d460e47cc3758d1476a77d334da9d9ce7504ae81a9f60efc5970"}
Jun 03 01:51:35.079848 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:35.079746    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be07c6fe-5f9c-4d0c-b7f4-ac86b020b951" path="/var/lib/kubelet/pods/be07c6fe-5f9c-4d0c-b7f4-ac86b020b951/volumes"
Jun 03 01:51:35.806854 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:35.806802    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4385e45d-af94-4fe3-8580-9c6ae3ee50ce","Type":"ContainerStarted","Data":"dcfaeca0129df3c3c00ef7ee6c30a27ebd61f1a28fd5f16c4c7fc393318d9940"}
Jun 03 01:51:35.825800 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:35.825732    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.37322936 podStartE2EDuration="2.825712307s" podCreationTimestamp="2026-06-03 01:51:33 +0000 UTC" firstStartedPulling="2026-06-03 01:51:34.283211402 +0000 UTC m=+663.847607192" lastFinishedPulling="2026-06-03 01:51:34.735694347 +0000 UTC m=+664.300090139" observedRunningTime="2026-06-03 01:51:35.823246387 +0000 UTC m=+665.387642223" watchObservedRunningTime="2026-06-03 01:51:35.825712307 +0000 UTC m=+665.390108118"
Jun 03 01:51:36.146814 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:36.146766    2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
Jun 03 01:51:36.148933 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:36.148896    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4385e45d-af94-4fe3-8580-9c6ae3ee50ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused"
Jun 03 01:51:37.146909 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:37.146854    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4385e45d-af94-4fe3-8580-9c6ae3ee50ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused"
Jun 03 01:51:38.147469 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:38.147418    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4385e45d-af94-4fe3-8580-9c6ae3ee50ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused"
Jun 03 01:51:39.146822 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:39.146764    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4385e45d-af94-4fe3-8580-9c6ae3ee50ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused"
Jun 03 01:51:40.146600 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:40.146531    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4385e45d-af94-4fe3-8580-9c6ae3ee50ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused"
Jun 03 01:51:41.147145 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:41.147089    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4385e45d-af94-4fe3-8580-9c6ae3ee50ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused"
Jun 03 01:51:42.147041 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:42.146989    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4385e45d-af94-4fe3-8580-9c6ae3ee50ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused"
Jun 03 01:51:43.147247 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:43.147187    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4385e45d-af94-4fe3-8580-9c6ae3ee50ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused"
Jun 03 01:51:44.146724 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:44.146672    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
Jun 03 01:51:44.147121 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:44.147080    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4385e45d-af94-4fe3-8580-9c6ae3ee50ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused"
Jun 03 01:51:45.146983 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:45.146939    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4385e45d-af94-4fe3-8580-9c6ae3ee50ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused"
Jun 03 01:51:46.147462 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:46.147407    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4385e45d-af94-4fe3-8580-9c6ae3ee50ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused"
Jun 03 01:51:47.146723 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:47.146671    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4385e45d-af94-4fe3-8580-9c6ae3ee50ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused"
Jun 03 01:51:48.146396 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:48.146348    2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4385e45d-af94-4fe3-8580-9c6ae3ee50ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused"
Jun 03 01:51:49.277998 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:49.277568    2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
Jun 03 01:51:49.296956 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:49.296568    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="4385e45d-af94-4fe3-8580-9c6ae3ee50ce" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 01:51:59.285196 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:51:59.285152    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
Jun 03 01:52:17.674124 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.674064    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"]
Jun 03 01:52:17.678704 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.678673    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"
Jun 03 01:52:17.681527 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.681506    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jun 03 01:52:17.681676 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.681555    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jun 03 01:52:17.682359 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.682339    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-msbjn\""
Jun 03 01:52:17.682462 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.682341    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jun 03 01:52:17.688145 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.688115    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"]
Jun 03 01:52:17.755529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.755497    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23218354-3966-4ea8-934c-c2948a0e0244-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt\" (UID: \"23218354-3966-4ea8-934c-c2948a0e0244\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"
Jun 03 01:52:17.755741 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.755554    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23218354-3966-4ea8-934c-c2948a0e0244-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt\" (UID: \"23218354-3966-4ea8-934c-c2948a0e0244\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"
Jun 03 01:52:17.755741 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.755643    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cxhg\" (UniqueName: \"kubernetes.io/projected/23218354-3966-4ea8-934c-c2948a0e0244-kube-api-access-8cxhg\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt\" (UID: \"23218354-3966-4ea8-934c-c2948a0e0244\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"
Jun 03 01:52:17.755741 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.755679    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23218354-3966-4ea8-934c-c2948a0e0244-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt\" (UID: \"23218354-3966-4ea8-934c-c2948a0e0244\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"
Jun 03 01:52:17.755741 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.755706    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/23218354-3966-4ea8-934c-c2948a0e0244-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt\" (UID: \"23218354-3966-4ea8-934c-c2948a0e0244\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"
Jun 03 01:52:17.755943 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.755785    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23218354-3966-4ea8-934c-c2948a0e0244-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt\" (UID: \"23218354-3966-4ea8-934c-c2948a0e0244\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"
Jun 03 01:52:17.857124 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.857082    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23218354-3966-4ea8-934c-c2948a0e0244-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt\" (UID: \"23218354-3966-4ea8-934c-c2948a0e0244\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"
Jun 03 01:52:17.857316 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.857165    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23218354-3966-4ea8-934c-c2948a0e0244-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt\" (UID: \"23218354-3966-4ea8-934c-c2948a0e0244\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"
Jun 03 01:52:17.857316 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.857212    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23218354-3966-4ea8-934c-c2948a0e0244-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt\" (UID: \"23218354-3966-4ea8-934c-c2948a0e0244\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"
Jun 03 01:52:17.857316 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.857249    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8cxhg\" (UniqueName: \"kubernetes.io/projected/23218354-3966-4ea8-934c-c2948a0e0244-kube-api-access-8cxhg\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt\" (UID: \"23218354-3966-4ea8-934c-c2948a0e0244\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"
Jun 03 01:52:17.857316 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.857283    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23218354-3966-4ea8-934c-c2948a0e0244-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt\" (UID: \"23218354-3966-4ea8-934c-c2948a0e0244\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"
Jun 03 01:52:17.857316 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.857313    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/23218354-3966-4ea8-934c-c2948a0e0244-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt\" (UID: \"23218354-3966-4ea8-934c-c2948a0e0244\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"
Jun 03 01:52:17.857766 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.857738    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/23218354-3966-4ea8-934c-c2948a0e0244-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt\" (UID: \"23218354-3966-4ea8-934c-c2948a0e0244\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"
Jun 03 01:52:17.857916 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.857744    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23218354-3966-4ea8-934c-c2948a0e0244-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt\" (UID: \"23218354-3966-4ea8-934c-c2948a0e0244\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"
Jun 03 01:52:17.858011 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.857931    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23218354-3966-4ea8-934c-c2948a0e0244-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt\" (UID: \"23218354-3966-4ea8-934c-c2948a0e0244\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"
Jun 03 01:52:17.859797 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.859773    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23218354-3966-4ea8-934c-c2948a0e0244-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt\" (UID: \"23218354-3966-4ea8-934c-c2948a0e0244\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"
Jun 03 01:52:17.859922 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.859905    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23218354-3966-4ea8-934c-c2948a0e0244-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt\" (UID: \"23218354-3966-4ea8-934c-c2948a0e0244\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"
Jun 03 01:52:17.864836 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.864817    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cxhg\" (UniqueName: \"kubernetes.io/projected/23218354-3966-4ea8-934c-c2948a0e0244-kube-api-access-8cxhg\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt\" (UID: \"23218354-3966-4ea8-934c-c2948a0e0244\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"
Jun 03 01:52:17.993008 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:17.992914    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"
Jun 03 01:52:18.142905 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:18.142872    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"]
Jun 03 01:52:18.144251 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:52:18.144216    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23218354_3966_4ea8_934c_c2948a0e0244.slice/crio-41ccaa996cb3229c59715bea366232e3a51af7b61e3efee6cde3ac1357cf462c WatchSource:0}: Error finding container 41ccaa996cb3229c59715bea366232e3a51af7b61e3efee6cde3ac1357cf462c: Status 404 returned error can't find the container with id 41ccaa996cb3229c59715bea366232e3a51af7b61e3efee6cde3ac1357cf462c
Jun 03 01:52:19.014013 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:19.013974    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt" event={"ID":"23218354-3966-4ea8-934c-c2948a0e0244","Type":"ContainerStarted","Data":"41ccaa996cb3229c59715bea366232e3a51af7b61e3efee6cde3ac1357cf462c"}
Jun 03 01:52:23.036894 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:23.036854    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt" event={"ID":"23218354-3966-4ea8-934c-c2948a0e0244","Type":"ContainerStarted","Data":"0a8b21f1487223380925b323f4a743864af22d8bf166ce60278efad080d3901a"}
Jun 03 01:52:25.046742 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:25.046703    2577 generic.go:358] "Generic (PLEG): container finished" podID="23218354-3966-4ea8-934c-c2948a0e0244" containerID="0a8b21f1487223380925b323f4a743864af22d8bf166ce60278efad080d3901a" exitCode=0
Jun 03 01:52:25.047162 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:25.046760    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt" event={"ID":"23218354-3966-4ea8-934c-c2948a0e0244","Type":"ContainerDied","Data":"0a8b21f1487223380925b323f4a743864af22d8bf166ce60278efad080d3901a"}
Jun 03 01:52:27.061539 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:27.061493    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt" event={"ID":"23218354-3966-4ea8-934c-c2948a0e0244","Type":"ContainerStarted","Data":"1b372955797956e0f71fc49f31acb171e3648f497f55d04934d17050b9cea165"}
Jun 03 01:52:27.079120 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:27.079068    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt" podStartSLOduration=2.03000723 podStartE2EDuration="10.079053831s" podCreationTimestamp="2026-06-03 01:52:17 +0000 UTC" firstStartedPulling="2026-06-03 01:52:18.146019335 +0000 UTC m=+707.710415125" lastFinishedPulling="2026-06-03 01:52:26.195065937 +0000 UTC m=+715.759461726" observedRunningTime="2026-06-03 01:52:27.078311674 +0000 UTC m=+716.642707510" watchObservedRunningTime="2026-06-03 01:52:27.079053831 +0000 UTC m=+716.643449643"
Jun 03 01:52:27.993347 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:27.993310    2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"
Jun 03 01:52:27.993536 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:27.993361    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"
Jun 03 01:52:28.006005 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:28.005970    2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"
Jun 03 01:52:28.077301 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:28.077264    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt"
Jun 03 01:52:43.887367 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:43.887325    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"]
Jun 03 01:52:43.899932 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:43.899899    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"]
Jun 03 01:52:43.900088 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:43.900064    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"
Jun 03 01:52:43.902774 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:43.902748    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jun 03 01:52:44.000685 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:44.000647    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b6m6\" (UniqueName: \"kubernetes.io/projected/f4dba0a7-ba60-47f2-878b-ca15f700c7fc-kube-api-access-2b6m6\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s\" (UID: \"f4dba0a7-ba60-47f2-878b-ca15f700c7fc\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"
Jun 03 01:52:44.000685 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:44.000691    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f4dba0a7-ba60-47f2-878b-ca15f700c7fc-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s\" (UID: \"f4dba0a7-ba60-47f2-878b-ca15f700c7fc\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"
Jun 03 01:52:44.000913 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:44.000831    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4dba0a7-ba60-47f2-878b-ca15f700c7fc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s\" (UID: \"f4dba0a7-ba60-47f2-878b-ca15f700c7fc\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"
Jun 03 01:52:44.000913 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:44.000875    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4dba0a7-ba60-47f2-878b-ca15f700c7fc-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s\" (UID: \"f4dba0a7-ba60-47f2-878b-ca15f700c7fc\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"
Jun 03 01:52:44.000993 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:44.000947    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4dba0a7-ba60-47f2-878b-ca15f700c7fc-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s\" (UID: \"f4dba0a7-ba60-47f2-878b-ca15f700c7fc\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"
Jun 03 01:52:44.000993 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:44.000986    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4dba0a7-ba60-47f2-878b-ca15f700c7fc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s\" (UID: \"f4dba0a7-ba60-47f2-878b-ca15f700c7fc\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"
Jun 03 01:52:44.102395 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:44.102350    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4dba0a7-ba60-47f2-878b-ca15f700c7fc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s\" (UID: \"f4dba0a7-ba60-47f2-878b-ca15f700c7fc\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"
Jun 03 01:52:44.102395 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:44.102401    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4dba0a7-ba60-47f2-878b-ca15f700c7fc-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s\" (UID: \"f4dba0a7-ba60-47f2-878b-ca15f700c7fc\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"
Jun 03 01:52:44.102717 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:44.102444    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4dba0a7-ba60-47f2-878b-ca15f700c7fc-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s\" (UID: \"f4dba0a7-ba60-47f2-878b-ca15f700c7fc\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"
Jun 03 01:52:44.102717 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:44.102470    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4dba0a7-ba60-47f2-878b-ca15f700c7fc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s\" (UID: \"f4dba0a7-ba60-47f2-878b-ca15f700c7fc\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"
Jun 03 01:52:44.102717 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:44.102501    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2b6m6\" (UniqueName: \"kubernetes.io/projected/f4dba0a7-ba60-47f2-878b-ca15f700c7fc-kube-api-access-2b6m6\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s\" (UID: \"f4dba0a7-ba60-47f2-878b-ca15f700c7fc\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"
Jun 03 01:52:44.102717 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:44.102530    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f4dba0a7-ba60-47f2-878b-ca15f700c7fc-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s\" (UID: \"f4dba0a7-ba60-47f2-878b-ca15f700c7fc\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"
Jun 03 01:52:44.102993 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:44.102963    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4dba0a7-ba60-47f2-878b-ca15f700c7fc-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s\" (UID: \"f4dba0a7-ba60-47f2-878b-ca15f700c7fc\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"
Jun 03 01:52:44.103054 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:44.103010    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f4dba0a7-ba60-47f2-878b-ca15f700c7fc-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s\" (UID: \"f4dba0a7-ba60-47f2-878b-ca15f700c7fc\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"
Jun 03 01:52:44.103054 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:44.103015    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4dba0a7-ba60-47f2-878b-ca15f700c7fc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s\" (UID: \"f4dba0a7-ba60-47f2-878b-ca15f700c7fc\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"
Jun 03 01:52:44.104852 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:44.104820    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4dba0a7-ba60-47f2-878b-ca15f700c7fc-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s\" (UID: \"f4dba0a7-ba60-47f2-878b-ca15f700c7fc\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"
Jun 03 01:52:44.105370 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:44.105352    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4dba0a7-ba60-47f2-878b-ca15f700c7fc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s\" (UID: \"f4dba0a7-ba60-47f2-878b-ca15f700c7fc\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"
Jun 03 01:52:44.110262 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:44.110234    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b6m6\" (UniqueName: \"kubernetes.io/projected/f4dba0a7-ba60-47f2-878b-ca15f700c7fc-kube-api-access-2b6m6\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s\" (UID: \"f4dba0a7-ba60-47f2-878b-ca15f700c7fc\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"
Jun 03 01:52:44.211981 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:44.211889    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"
Jun 03 01:52:44.365874 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:44.365841    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"]
Jun 03 01:52:44.367770 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:52:44.367739    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4dba0a7_ba60_47f2_878b_ca15f700c7fc.slice/crio-a3790eadd0f44b20f43b8745bd08afc6bb36f9edea25e935a410fd0f3b4844f5 WatchSource:0}: Error finding container a3790eadd0f44b20f43b8745bd08afc6bb36f9edea25e935a410fd0f3b4844f5: Status 404 returned error can't find the container with id a3790eadd0f44b20f43b8745bd08afc6bb36f9edea25e935a410fd0f3b4844f5
Jun 03 01:52:45.142656 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:45.142616    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s" event={"ID":"f4dba0a7-ba60-47f2-878b-ca15f700c7fc","Type":"ContainerStarted","Data":"4be2dcbf9a69e616cd5e63754dfd00731c74f35181dbf1315664830cfa55727f"}
Jun 03 01:52:45.142656 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:45.142658    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s" event={"ID":"f4dba0a7-ba60-47f2-878b-ca15f700c7fc","Type":"ContainerStarted","Data":"a3790eadd0f44b20f43b8745bd08afc6bb36f9edea25e935a410fd0f3b4844f5"}
Jun 03 01:52:47.152102 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:47.152067    2577 generic.go:358] "Generic (PLEG): container finished" podID="f4dba0a7-ba60-47f2-878b-ca15f700c7fc" containerID="4be2dcbf9a69e616cd5e63754dfd00731c74f35181dbf1315664830cfa55727f" exitCode=0
Jun 03 01:52:47.152490 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:47.152144    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s" event={"ID":"f4dba0a7-ba60-47f2-878b-ca15f700c7fc","Type":"ContainerDied","Data":"4be2dcbf9a69e616cd5e63754dfd00731c74f35181dbf1315664830cfa55727f"}
Jun 03 01:52:48.159547 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:48.159510    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s" event={"ID":"f4dba0a7-ba60-47f2-878b-ca15f700c7fc","Type":"ContainerStarted","Data":"cdc4d25a5d09d15309e82f9dc8a774c6477c715048f2749e18fd7ff589191f92"}
Jun 03 01:52:48.177403 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:48.177346    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s" podStartSLOduration=4.999679449 podStartE2EDuration="5.177332722s" podCreationTimestamp="2026-06-03 01:52:43 +0000 UTC" firstStartedPulling="2026-06-03 01:52:47.152848721 +0000 UTC m=+736.717244510" lastFinishedPulling="2026-06-03 01:52:47.330501989 +0000 UTC m=+736.894897783" observedRunningTime="2026-06-03 01:52:48.176039613 +0000 UTC m=+737.740435418" watchObservedRunningTime="2026-06-03 01:52:48.177332722 +0000 UTC m=+737.741728532"
Jun 03 01:52:54.212045 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:54.212009    2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"
Jun 03 01:52:54.212045 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:54.212055    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"
Jun 03 01:52:54.227869 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:54.227841    2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"
Jun 03 01:52:55.205019 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:52:55.204990    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s"
Jun 03 01:53:19.867144 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:19.867103    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"]
Jun 03 01:53:19.871062 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:19.871034    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"
Jun 03 01:53:19.873698 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:19.873674    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jun 03 01:53:19.881514 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:19.881473    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"]
Jun 03 01:53:19.953791 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:19.953749    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x7xm\" (UniqueName: \"kubernetes.io/projected/f7de8f50-7387-40dc-a20e-bf546331c21c-kube-api-access-2x7xm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg\" (UID: \"f7de8f50-7387-40dc-a20e-bf546331c21c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"
Jun 03 01:53:19.953973 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:19.953800    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7de8f50-7387-40dc-a20e-bf546331c21c-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg\" (UID: \"f7de8f50-7387-40dc-a20e-bf546331c21c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"
Jun 03 01:53:19.953973 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:19.953877    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f7de8f50-7387-40dc-a20e-bf546331c21c-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg\" (UID: \"f7de8f50-7387-40dc-a20e-bf546331c21c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"
Jun 03 01:53:19.953973 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:19.953919    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7de8f50-7387-40dc-a20e-bf546331c21c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg\" (UID: \"f7de8f50-7387-40dc-a20e-bf546331c21c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"
Jun 03 01:53:19.954082 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:19.953983    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7de8f50-7387-40dc-a20e-bf546331c21c-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg\" (UID: \"f7de8f50-7387-40dc-a20e-bf546331c21c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"
Jun 03 01:53:19.954082 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:19.954004    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7de8f50-7387-40dc-a20e-bf546331c21c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg\" (UID: \"f7de8f50-7387-40dc-a20e-bf546331c21c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"
Jun 03 01:53:20.054869 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:20.054828    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2x7xm\" (UniqueName: \"kubernetes.io/projected/f7de8f50-7387-40dc-a20e-bf546331c21c-kube-api-access-2x7xm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg\" (UID: \"f7de8f50-7387-40dc-a20e-bf546331c21c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"
Jun 03 01:53:20.054869 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:20.054875    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7de8f50-7387-40dc-a20e-bf546331c21c-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg\" (UID: \"f7de8f50-7387-40dc-a20e-bf546331c21c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"
Jun 03 01:53:20.055130 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:20.054906    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f7de8f50-7387-40dc-a20e-bf546331c21c-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg\" (UID: \"f7de8f50-7387-40dc-a20e-bf546331c21c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"
Jun 03 01:53:20.055130 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:20.054930    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7de8f50-7387-40dc-a20e-bf546331c21c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg\" (UID: \"f7de8f50-7387-40dc-a20e-bf546331c21c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"
Jun 03 01:53:20.055130 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:20.054966    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7de8f50-7387-40dc-a20e-bf546331c21c-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg\" (UID: \"f7de8f50-7387-40dc-a20e-bf546331c21c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"
Jun 03 01:53:20.055130 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:20.054986    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7de8f50-7387-40dc-a20e-bf546331c21c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg\" (UID: \"f7de8f50-7387-40dc-a20e-bf546331c21c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"
Jun 03 01:53:20.055402 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:20.055369    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7de8f50-7387-40dc-a20e-bf546331c21c-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg\" (UID: \"f7de8f50-7387-40dc-a20e-bf546331c21c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"
Jun 03 01:53:20.055518 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:20.055428    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f7de8f50-7387-40dc-a20e-bf546331c21c-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg\" (UID: \"f7de8f50-7387-40dc-a20e-bf546331c21c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"
Jun 03 01:53:20.055518 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:20.055448    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7de8f50-7387-40dc-a20e-bf546331c21c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg\" (UID: \"f7de8f50-7387-40dc-a20e-bf546331c21c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"
Jun 03 01:53:20.057348 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:20.057327    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7de8f50-7387-40dc-a20e-bf546331c21c-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg\" (UID: \"f7de8f50-7387-40dc-a20e-bf546331c21c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"
Jun 03 01:53:20.057644 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:20.057627    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7de8f50-7387-40dc-a20e-bf546331c21c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg\" (UID: \"f7de8f50-7387-40dc-a20e-bf546331c21c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"
Jun 03 01:53:20.062280 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:20.062258    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x7xm\" (UniqueName: \"kubernetes.io/projected/f7de8f50-7387-40dc-a20e-bf546331c21c-kube-api-access-2x7xm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg\" (UID: \"f7de8f50-7387-40dc-a20e-bf546331c21c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"
Jun 03 01:53:20.184303 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:20.184258    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"
Jun 03 01:53:20.328427 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:20.328392    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"]
Jun 03 01:53:20.328942 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:53:20.328907    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7de8f50_7387_40dc_a20e_bf546331c21c.slice/crio-8782672516f2a98f5144c3041d471bb4b72cfae3904f05f96f2ec332d5115996 WatchSource:0}: Error finding container 8782672516f2a98f5144c3041d471bb4b72cfae3904f05f96f2ec332d5115996: Status 404 returned error can't find the container with id 8782672516f2a98f5144c3041d471bb4b72cfae3904f05f96f2ec332d5115996
Jun 03 01:53:21.316981 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:21.316937    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg" event={"ID":"f7de8f50-7387-40dc-a20e-bf546331c21c","Type":"ContainerStarted","Data":"c57858cf81e563d1613a070e6ff32c698c186aebf71fab3c23d5dade62ca5815"}
Jun 03 01:53:21.316981 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:21.316978    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg" event={"ID":"f7de8f50-7387-40dc-a20e-bf546331c21c","Type":"ContainerStarted","Data":"8782672516f2a98f5144c3041d471bb4b72cfae3904f05f96f2ec332d5115996"}
Jun 03 01:53:22.322883 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:22.322845    2577 generic.go:358] "Generic (PLEG): container finished" podID="f7de8f50-7387-40dc-a20e-bf546331c21c" containerID="c57858cf81e563d1613a070e6ff32c698c186aebf71fab3c23d5dade62ca5815" exitCode=0
Jun 03 01:53:22.323283 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:22.322925    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg" event={"ID":"f7de8f50-7387-40dc-a20e-bf546331c21c","Type":"ContainerDied","Data":"c57858cf81e563d1613a070e6ff32c698c186aebf71fab3c23d5dade62ca5815"}
Jun 03 01:53:23.329296 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:23.329253    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg" event={"ID":"f7de8f50-7387-40dc-a20e-bf546331c21c","Type":"ContainerStarted","Data":"f6f9004630e640bb08ffa176e6a09a0da953a8e9e551f395fb954d33584599be"}
Jun 03 01:53:23.348455 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:23.348400    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg" podStartSLOduration=4.149175937 podStartE2EDuration="4.34838512s" podCreationTimestamp="2026-06-03 01:53:19 +0000 UTC" firstStartedPulling="2026-06-03 01:53:22.323504819 +0000 UTC m=+771.887900607" lastFinishedPulling="2026-06-03 01:53:22.522713997 +0000 UTC m=+772.087109790" observedRunningTime="2026-06-03 01:53:23.34646686 +0000 UTC m=+772.910862671" watchObservedRunningTime="2026-06-03 01:53:23.34838512 +0000 UTC m=+772.912780931"
Jun 03 01:53:27.087654 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:27.087621    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"]
Jun 03 01:53:27.093301 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:27.093274    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"
Jun 03 01:53:27.095766 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:27.095740    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jun 03 01:53:27.101292 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:27.101258    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"]
Jun 03 01:53:27.118036 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:27.117996    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/610e55b2-5281-403c-9b02-32668eec0b95-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h\" (UID: \"610e55b2-5281-403c-9b02-32668eec0b95\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"
Jun 03 01:53:27.118036 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:27.118038    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4q4v\" (UniqueName: \"kubernetes.io/projected/610e55b2-5281-403c-9b02-32668eec0b95-kube-api-access-c4q4v\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h\" (UID: \"610e55b2-5281-403c-9b02-32668eec0b95\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"
Jun 03 01:53:27.118259 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:27.118133    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/610e55b2-5281-403c-9b02-32668eec0b95-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h\" (UID: \"610e55b2-5281-403c-9b02-32668eec0b95\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"
Jun 03 01:53:27.118259 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:27.118208    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/610e55b2-5281-403c-9b02-32668eec0b95-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h\" (UID: \"610e55b2-5281-403c-9b02-32668eec0b95\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"
Jun 03 01:53:27.118335 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:27.118259    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/610e55b2-5281-403c-9b02-32668eec0b95-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h\" (UID: \"610e55b2-5281-403c-9b02-32668eec0b95\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"
Jun 03 01:53:27.118335 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:27.118323    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/610e55b2-5281-403c-9b02-32668eec0b95-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h\" (UID: \"610e55b2-5281-403c-9b02-32668eec0b95\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"
Jun 03 01:53:27.219144 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:27.219097    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/610e55b2-5281-403c-9b02-32668eec0b95-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h\" (UID: \"610e55b2-5281-403c-9b02-32668eec0b95\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"
Jun 03 01:53:27.219363 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:27.219209    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/610e55b2-5281-403c-9b02-32668eec0b95-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h\" (UID: \"610e55b2-5281-403c-9b02-32668eec0b95\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"
Jun 03 01:53:27.219363 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:27.219271    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/610e55b2-5281-403c-9b02-32668eec0b95-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h\" (UID: \"610e55b2-5281-403c-9b02-32668eec0b95\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"
Jun 03 01:53:27.219363 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:27.219305    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c4q4v\" (UniqueName: \"kubernetes.io/projected/610e55b2-5281-403c-9b02-32668eec0b95-kube-api-access-c4q4v\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h\" (UID: \"610e55b2-5281-403c-9b02-32668eec0b95\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"
Jun 03 01:53:27.219363 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:27.219359    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/610e55b2-5281-403c-9b02-32668eec0b95-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h\" (UID: \"610e55b2-5281-403c-9b02-32668eec0b95\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"
Jun 03 01:53:27.219630 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:27.219392    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/610e55b2-5281-403c-9b02-32668eec0b95-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h\" (UID: \"610e55b2-5281-403c-9b02-32668eec0b95\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"
Jun 03 01:53:27.220097 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:27.220069    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/610e55b2-5281-403c-9b02-32668eec0b95-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h\" (UID: \"610e55b2-5281-403c-9b02-32668eec0b95\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"
Jun 03 01:53:27.220269 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:27.220238    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/610e55b2-5281-403c-9b02-32668eec0b95-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h\" (UID: \"610e55b2-5281-403c-9b02-32668eec0b95\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"
Jun 03 01:53:27.220529 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:27.220503    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/610e55b2-5281-403c-9b02-32668eec0b95-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h\" (UID: \"610e55b2-5281-403c-9b02-32668eec0b95\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"
Jun 03 01:53:27.222358 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:27.222338    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/610e55b2-5281-403c-9b02-32668eec0b95-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h\" (UID: \"610e55b2-5281-403c-9b02-32668eec0b95\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"
Jun 03 01:53:27.222540 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:27.222519    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/610e55b2-5281-403c-9b02-32668eec0b95-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h\" (UID: \"610e55b2-5281-403c-9b02-32668eec0b95\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"
Jun 03 01:53:27.227678 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:27.227650    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4q4v\" (UniqueName: \"kubernetes.io/projected/610e55b2-5281-403c-9b02-32668eec0b95-kube-api-access-c4q4v\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h\" (UID: \"610e55b2-5281-403c-9b02-32668eec0b95\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"
Jun 03 01:53:27.405841 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:27.405794    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"
Jun 03 01:53:27.552732 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:27.552693    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"]
Jun 03 01:53:27.553137 ip-10-0-137-62 kubenswrapper[2577]: W0603 01:53:27.553100    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod610e55b2_5281_403c_9b02_32668eec0b95.slice/crio-2d9225bd21c3a71eab3e86488eecf6220932a7d8d73696480d93e0949658f9f3 WatchSource:0}: Error finding container 2d9225bd21c3a71eab3e86488eecf6220932a7d8d73696480d93e0949658f9f3: Status 404 returned error can't find the container with id 2d9225bd21c3a71eab3e86488eecf6220932a7d8d73696480d93e0949658f9f3
Jun 03 01:53:28.351469 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:28.351430    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h" event={"ID":"610e55b2-5281-403c-9b02-32668eec0b95","Type":"ContainerStarted","Data":"095e7653e1fd81bbae912e8563104d8938d48f1cfdf6aa3fb8d94adb8c828c36"}
Jun 03 01:53:28.351888 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:28.351477    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h" event={"ID":"610e55b2-5281-403c-9b02-32668eec0b95","Type":"ContainerStarted","Data":"2d9225bd21c3a71eab3e86488eecf6220932a7d8d73696480d93e0949658f9f3"}
Jun 03 01:53:30.185418 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:30.185359    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"
Jun 03 01:53:30.185418 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:30.185428    2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"
Jun 03 01:53:30.198906 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:30.198863    2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"
Jun 03 01:53:30.377228 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:30.377189    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg"
Jun 03 01:53:32.377835 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:32.377802    2577 generic.go:358] "Generic (PLEG): container finished" podID="610e55b2-5281-403c-9b02-32668eec0b95" containerID="095e7653e1fd81bbae912e8563104d8938d48f1cfdf6aa3fb8d94adb8c828c36" exitCode=0
Jun 03 01:53:32.378330 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:32.377883    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h" event={"ID":"610e55b2-5281-403c-9b02-32668eec0b95","Type":"ContainerDied","Data":"095e7653e1fd81bbae912e8563104d8938d48f1cfdf6aa3fb8d94adb8c828c36"}
Jun 03 01:53:33.384074 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:33.384038    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h" event={"ID":"610e55b2-5281-403c-9b02-32668eec0b95","Type":"ContainerStarted","Data":"506ba7c81b4723febd2f46b6a12104bb8ac46e8ea9ee16bc686c6a4416ccbe4c"}
Jun 03 01:53:33.404093 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:33.404034    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h" podStartSLOduration=6.22370252 podStartE2EDuration="6.404019897s" podCreationTimestamp="2026-06-03 01:53:27 +0000 UTC" firstStartedPulling="2026-06-03 01:53:32.378614976 +0000 UTC m=+781.943010765" lastFinishedPulling="2026-06-03 01:53:32.55893235 +0000 UTC m=+782.123328142" observedRunningTime="2026-06-03 01:53:33.403017698 +0000 UTC m=+782.967413508" watchObservedRunningTime="2026-06-03 01:53:33.404019897 +0000 UTC m=+782.968415707"
Jun 03 01:53:37.406501 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:37.406467    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"
Jun 03 01:53:37.407041 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:37.406563    2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"
Jun 03 01:53:37.419549 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:37.419517    2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"
Jun 03 01:53:38.417123 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:53:38.417089    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h"
Jun 03 01:54:31.064787 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:54:31.064748    2577 scope.go:117] "RemoveContainer" containerID="27c21674329a6275458c6ea50d0e0f87ffb79ad65251fe2b2691861532cf6b6f"
Jun 03 01:55:31.091539 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:55:31.091506    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/ovn-acl-logging/0.log"
Jun 03 01:55:31.100287 ip-10-0-137-62 kubenswrapper[2577]: I0603 01:55:31.100261    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/ovn-acl-logging/0.log"
Jun 03 02:00:31.131658 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:00:31.131625    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/ovn-acl-logging/0.log"
Jun 03 02:00:31.139320 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:00:31.139293    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/ovn-acl-logging/0.log"
Jun 03 02:05:31.173987 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:05:31.173951    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/ovn-acl-logging/0.log"
Jun 03 02:05:31.182036 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:05:31.182012    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/ovn-acl-logging/0.log"
Jun 03 02:06:12.030605 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:06:12.030500    2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-24bzf"]
Jun 03 02:06:12.031120 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:06:12.030792    2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-24bzf" podUID="74fc8de3-0f09-40db-8184-7c9106985afb" containerName="manager" containerID="cri-o://5f4ca95e4e620419973c29b3e8e88d04aecafdfeadff09409b8ee9182ea48b3f" gracePeriod=10
Jun 03 02:06:12.297993 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:06:12.297968    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-24bzf"
Jun 03 02:06:12.379029 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:06:12.378988    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzpmb\" (UniqueName: \"kubernetes.io/projected/74fc8de3-0f09-40db-8184-7c9106985afb-kube-api-access-wzpmb\") pod \"74fc8de3-0f09-40db-8184-7c9106985afb\" (UID: \"74fc8de3-0f09-40db-8184-7c9106985afb\") "
Jun 03 02:06:12.379215 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:06:12.379137    2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74fc8de3-0f09-40db-8184-7c9106985afb-extensions-socket-volume\") pod \"74fc8de3-0f09-40db-8184-7c9106985afb\" (UID: \"74fc8de3-0f09-40db-8184-7c9106985afb\") "
Jun 03 02:06:12.379569 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:06:12.379538    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74fc8de3-0f09-40db-8184-7c9106985afb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "74fc8de3-0f09-40db-8184-7c9106985afb" (UID: "74fc8de3-0f09-40db-8184-7c9106985afb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 02:06:12.381105 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:06:12.381081    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74fc8de3-0f09-40db-8184-7c9106985afb-kube-api-access-wzpmb" (OuterVolumeSpecName: "kube-api-access-wzpmb") pod "74fc8de3-0f09-40db-8184-7c9106985afb" (UID: "74fc8de3-0f09-40db-8184-7c9106985afb"). InnerVolumeSpecName "kube-api-access-wzpmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 02:06:12.480700 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:06:12.480659    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74fc8de3-0f09-40db-8184-7c9106985afb-extensions-socket-volume\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 02:06:12.480700 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:06:12.480690    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzpmb\" (UniqueName: \"kubernetes.io/projected/74fc8de3-0f09-40db-8184-7c9106985afb-kube-api-access-wzpmb\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jun 03 02:06:12.684038 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:06:12.684002    2577 generic.go:358] "Generic (PLEG): container finished" podID="74fc8de3-0f09-40db-8184-7c9106985afb" containerID="5f4ca95e4e620419973c29b3e8e88d04aecafdfeadff09409b8ee9182ea48b3f" exitCode=0
Jun 03 02:06:12.684224 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:06:12.684065    2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-24bzf"
Jun 03 02:06:12.684224 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:06:12.684089    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-24bzf" event={"ID":"74fc8de3-0f09-40db-8184-7c9106985afb","Type":"ContainerDied","Data":"5f4ca95e4e620419973c29b3e8e88d04aecafdfeadff09409b8ee9182ea48b3f"}
Jun 03 02:06:12.684224 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:06:12.684131    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-24bzf" event={"ID":"74fc8de3-0f09-40db-8184-7c9106985afb","Type":"ContainerDied","Data":"96acbb289d2a4aebe2f0d969604fed5aae49bebba64bc10171810a71f2d0f430"}
Jun 03 02:06:12.684224 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:06:12.684151    2577 scope.go:117] "RemoveContainer" containerID="5f4ca95e4e620419973c29b3e8e88d04aecafdfeadff09409b8ee9182ea48b3f"
Jun 03 02:06:12.695701 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:06:12.695678    2577 scope.go:117] "RemoveContainer" containerID="5f4ca95e4e620419973c29b3e8e88d04aecafdfeadff09409b8ee9182ea48b3f"
Jun 03 02:06:12.696011 ip-10-0-137-62 kubenswrapper[2577]: E0603 02:06:12.695985    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f4ca95e4e620419973c29b3e8e88d04aecafdfeadff09409b8ee9182ea48b3f\": container with ID starting with 5f4ca95e4e620419973c29b3e8e88d04aecafdfeadff09409b8ee9182ea48b3f not found: ID does not exist" containerID="5f4ca95e4e620419973c29b3e8e88d04aecafdfeadff09409b8ee9182ea48b3f"
Jun 03 02:06:12.696077 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:06:12.696023    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f4ca95e4e620419973c29b3e8e88d04aecafdfeadff09409b8ee9182ea48b3f"} err="failed to get container status \"5f4ca95e4e620419973c29b3e8e88d04aecafdfeadff09409b8ee9182ea48b3f\": rpc error: code = NotFound desc = could not find container \"5f4ca95e4e620419973c29b3e8e88d04aecafdfeadff09409b8ee9182ea48b3f\": container with ID starting with 5f4ca95e4e620419973c29b3e8e88d04aecafdfeadff09409b8ee9182ea48b3f not found: ID does not exist"
Jun 03 02:06:12.708345 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:06:12.708297    2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-24bzf"]
Jun 03 02:06:12.711420 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:06:12.711391    2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-24bzf"]
Jun 03 02:06:12.732903 ip-10-0-137-62 kubenswrapper[2577]: E0603 02:06:12.732861    2577 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74fc8de3_0f09_40db_8184_7c9106985afb.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74fc8de3_0f09_40db_8184_7c9106985afb.slice/crio-96acbb289d2a4aebe2f0d969604fed5aae49bebba64bc10171810a71f2d0f430\": RecentStats: unable to find data in memory cache]"
Jun 03 02:06:13.080081 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:06:13.079998    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74fc8de3-0f09-40db-8184-7c9106985afb" path="/var/lib/kubelet/pods/74fc8de3-0f09-40db-8184-7c9106985afb/volumes"
Jun 03 02:07:18.161207 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:07:18.161164    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7kvjx"]
Jun 03 02:07:18.161790 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:07:18.161667    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74fc8de3-0f09-40db-8184-7c9106985afb" containerName="manager"
Jun 03 02:07:18.161790 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:07:18.161691    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="74fc8de3-0f09-40db-8184-7c9106985afb" containerName="manager"
Jun 03 02:07:18.161790 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:07:18.161779    2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="74fc8de3-0f09-40db-8184-7c9106985afb" containerName="manager"
Jun 03 02:07:18.164942 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:07:18.164915    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7kvjx"
Jun 03 02:07:18.167645 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:07:18.167625    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 03 02:07:18.167771 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:07:18.167665    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 03 02:07:18.168185 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:07:18.168167    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vsx6t\""
Jun 03 02:07:18.176135 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:07:18.176104    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7kvjx"]
Jun 03 02:07:18.229962 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:07:18.229920    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9380bf3a-f8f8-482d-b198-4aa095a96a87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7kvjx\" (UID: \"9380bf3a-f8f8-482d-b198-4aa095a96a87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7kvjx"
Jun 03 02:07:18.230144 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:07:18.229973    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcgtd\" (UniqueName: \"kubernetes.io/projected/9380bf3a-f8f8-482d-b198-4aa095a96a87-kube-api-access-vcgtd\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7kvjx\" (UID: \"9380bf3a-f8f8-482d-b198-4aa095a96a87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7kvjx"
Jun 03 02:07:18.331053 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:07:18.331012    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9380bf3a-f8f8-482d-b198-4aa095a96a87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7kvjx\" (UID: \"9380bf3a-f8f8-482d-b198-4aa095a96a87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7kvjx"
Jun 03 02:07:18.331225 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:07:18.331089    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vcgtd\" (UniqueName: \"kubernetes.io/projected/9380bf3a-f8f8-482d-b198-4aa095a96a87-kube-api-access-vcgtd\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7kvjx\" (UID: \"9380bf3a-f8f8-482d-b198-4aa095a96a87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7kvjx"
Jun 03 02:07:18.331393 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:07:18.331372    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9380bf3a-f8f8-482d-b198-4aa095a96a87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7kvjx\" (UID: \"9380bf3a-f8f8-482d-b198-4aa095a96a87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7kvjx"
Jun 03 02:07:18.339152 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:07:18.339123    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcgtd\" (UniqueName: \"kubernetes.io/projected/9380bf3a-f8f8-482d-b198-4aa095a96a87-kube-api-access-vcgtd\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7kvjx\" (UID: \"9380bf3a-f8f8-482d-b198-4aa095a96a87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7kvjx"
Jun 03 02:07:18.476751 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:07:18.476655    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7kvjx"
Jun 03 02:07:18.620564 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:07:18.620529    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7kvjx"]
Jun 03 02:07:18.622273 ip-10-0-137-62 kubenswrapper[2577]: W0603 02:07:18.622247    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9380bf3a_f8f8_482d_b198_4aa095a96a87.slice/crio-2e0af18bce7d36929205d2a6d75b926c872099744bfee9d273c31a4b199d273e WatchSource:0}: Error finding container 2e0af18bce7d36929205d2a6d75b926c872099744bfee9d273c31a4b199d273e: Status 404 returned error can't find the container with id 2e0af18bce7d36929205d2a6d75b926c872099744bfee9d273c31a4b199d273e
Jun 03 02:07:18.624558 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:07:18.624541    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 02:07:18.969475 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:07:18.969431    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7kvjx" event={"ID":"9380bf3a-f8f8-482d-b198-4aa095a96a87","Type":"ContainerStarted","Data":"e461af487786b03f7c9427710796a2debbdf52f319fc202e24361ec4135315bc"}
Jun 03 02:07:18.969475 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:07:18.969477    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7kvjx" event={"ID":"9380bf3a-f8f8-482d-b198-4aa095a96a87","Type":"ContainerStarted","Data":"2e0af18bce7d36929205d2a6d75b926c872099744bfee9d273c31a4b199d273e"}
Jun 03 02:07:18.969756 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:07:18.969518    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7kvjx"
Jun 03 02:07:18.991158 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:07:18.991104    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7kvjx" podStartSLOduration=0.991089062 podStartE2EDuration="991.089062ms" podCreationTimestamp="2026-06-03 02:07:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 02:07:18.987981707 +0000 UTC m=+1608.552377518" watchObservedRunningTime="2026-06-03 02:07:18.991089062 +0000 UTC m=+1608.555484870"
Jun 03 02:07:29.977369 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:07:29.977330    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7kvjx"
Jun 03 02:10:31.211485 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:10:31.211457    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/ovn-acl-logging/0.log"
Jun 03 02:10:31.220357 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:10:31.220329    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/ovn-acl-logging/0.log"
Jun 03 02:15:31.251609 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:15:31.251553    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/ovn-acl-logging/0.log"
Jun 03 02:15:31.261882 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:15:31.261857    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/ovn-acl-logging/0.log"
Jun 03 02:17:28.366469 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:28.366437    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7b94c665b4-8jbrx_637bf8fb-391b-493c-94b9-1299f18b3e66/nginx/0.log"
Jun 03 02:17:28.600809 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:28.600781    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-lngwz_5945ffb4-861e-489c-ac58-07e0dfa8cb92/manager/0.log"
Jun 03 02:17:28.719094 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:28.719062    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-69dns_d99277bb-4449-4aa2-a1e2-40f61893d4a0/manager/0.log"
Jun 03 02:17:28.842234 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:28.842198    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6479d59f95-lh72n_e5ad8095-8af4-4cee-971b-2c049ba21229/maas-api/0.log"
Jun 03 02:17:29.284568 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:29.284538    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-nzznf_a2da778c-dbfc-4257-a01f-693abd213542/server/0.log"
Jun 03 02:17:29.405724 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:29.405694    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-d5dt8_33dc33a6-a326-4f70-bebd-d9b2479414f0/manager/0.log"
Jun 03 02:17:29.522071 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:29.522036    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7_f76882ed-aadb-44f4-84ae-f78bf86dec41/copy-manifests/0.log"
Jun 03 02:17:29.528739 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:29.528710    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7_f76882ed-aadb-44f4-84ae-f78bf86dec41/manager/0.log"
Jun 03 02:17:29.896996 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:29.896964    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-8zhds_1ebcebd3-f875-414a-9a68-8d794aee429d/postgres/0.log"
Jun 03 02:17:30.653830 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:30.653797    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl_c7efc779-17d2-4c64-b6a6-a24374f80990/util/0.log"
Jun 03 02:17:30.663811 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:30.663783    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl_c7efc779-17d2-4c64-b6a6-a24374f80990/pull/0.log"
Jun 03 02:17:30.669881 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:30.669861    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl_c7efc779-17d2-4c64-b6a6-a24374f80990/extract/0.log"
Jun 03 02:17:30.781940 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:30.781907    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr_c8dd0d01-8219-42d9-9ec6-3bc2af2decef/util/0.log"
Jun 03 02:17:30.789359 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:30.789336    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr_c8dd0d01-8219-42d9-9ec6-3bc2af2decef/pull/0.log"
Jun 03 02:17:30.797364 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:30.797344    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr_c8dd0d01-8219-42d9-9ec6-3bc2af2decef/extract/0.log"
Jun 03 02:17:30.902044 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:30.902015    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf_c79b6b70-7e57-450f-ae5e-4bceb24132db/util/0.log"
Jun 03 02:17:30.908958 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:30.908863    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf_c79b6b70-7e57-450f-ae5e-4bceb24132db/pull/0.log"
Jun 03 02:17:30.914606 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:30.914560    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf_c79b6b70-7e57-450f-ae5e-4bceb24132db/extract/0.log"
Jun 03 02:17:31.023735 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:31.023705    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72_48b1644c-85bc-476f-b241-b0e52a86761d/pull/0.log"
Jun 03 02:17:31.030316 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:31.030289    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72_48b1644c-85bc-476f-b241-b0e52a86761d/extract/0.log"
Jun 03 02:17:31.036686 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:31.036663    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72_48b1644c-85bc-476f-b241-b0e52a86761d/util/0.log"
Jun 03 02:17:31.739035 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:31.739003    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-7kvjx_9380bf3a-f8f8-482d-b198-4aa095a96a87/manager/0.log"
Jun 03 02:17:32.427785 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:32.427714    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-dc6ng_320700f9-b5e3-46bf-94c4-eacd95b37173/discovery/0.log"
Jun 03 02:17:32.656468 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:32.656413    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-889cb89c5-wsddf_75f8daf2-fbfd-4d99-b7f0-449dec047cc8/kube-auth-proxy/0.log"
Jun 03 02:17:33.017437 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:33.017405    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-lk9cb_40cd08e3-65d5-4c91-9414-7341c2053e12/payload-processing/0.log"
Jun 03 02:17:33.134033 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:33.134004    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6fd64f4d5f-4qdl5_c463f7df-73f3-4c28-906a-c62846ca8a4b/router/0.log"
Jun 03 02:17:33.470575 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:33.470547    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt_23218354-3966-4ea8-934c-c2948a0e0244/storage-initializer/0.log"
Jun 03 02:17:33.477549 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:33.477515    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-2gbdt_23218354-3966-4ea8-934c-c2948a0e0244/main/0.log"
Jun 03 02:17:33.720048 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:33.720015    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s_f4dba0a7-ba60-47f2-878b-ca15f700c7fc/storage-initializer/0.log"
Jun 03 02:17:33.727613 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:33.727514    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-kjs5s_f4dba0a7-ba60-47f2-878b-ca15f700c7fc/main/0.log"
Jun 03 02:17:33.953670 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:33.953645    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg_f7de8f50-7387-40dc-a20e-bf546331c21c/storage-initializer/0.log"
Jun 03 02:17:33.961552 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:33.961531    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-cdhjg_f7de8f50-7387-40dc-a20e-bf546331c21c/main/0.log"
Jun 03 02:17:34.083149 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:34.083076    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h_610e55b2-5281-403c-9b02-32668eec0b95/storage-initializer/0.log"
Jun 03 02:17:34.090383 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:34.090360    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-whm9h_610e55b2-5281-403c-9b02-32668eec0b95/main/0.log"
Jun 03 02:17:41.084172 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:41.084140    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-q7jxs_734f349a-3318-40d6-96ea-8f6bfca3dff2/global-pull-secret-syncer/0.log"
Jun 03 02:17:41.134709 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:41.134673    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9p5l6_83550fed-8052-46ad-b704-1a9b1b977d04/konnectivity-agent/0.log"
Jun 03 02:17:41.260738 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:41.260661    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-62.ec2.internal_b352523aa1133bdddd102a34c42e047b/haproxy/0.log"
Jun 03 02:17:44.722543 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:44.722505    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl_c7efc779-17d2-4c64-b6a6-a24374f80990/extract/0.log"
Jun 03 02:17:44.752003 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:44.751971    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl_c7efc779-17d2-4c64-b6a6-a24374f80990/util/0.log"
Jun 03 02:17:44.775198 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:44.775167    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kq6xl_c7efc779-17d2-4c64-b6a6-a24374f80990/pull/0.log"
Jun 03 02:17:44.829852 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:44.829820    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr_c8dd0d01-8219-42d9-9ec6-3bc2af2decef/extract/0.log"
Jun 03 02:17:44.860717 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:44.860679    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr_c8dd0d01-8219-42d9-9ec6-3bc2af2decef/util/0.log"
Jun 03 02:17:44.894919 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:44.894893    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9tmr_c8dd0d01-8219-42d9-9ec6-3bc2af2decef/pull/0.log"
Jun 03 02:17:44.926285 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:44.926249    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf_c79b6b70-7e57-450f-ae5e-4bceb24132db/extract/0.log"
Jun 03 02:17:44.947209 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:44.947174    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf_c79b6b70-7e57-450f-ae5e-4bceb24132db/util/0.log"
Jun 03 02:17:44.971717 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:44.971687    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736s8cf_c79b6b70-7e57-450f-ae5e-4bceb24132db/pull/0.log"
Jun 03 02:17:44.998410 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:44.998338    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72_48b1644c-85bc-476f-b241-b0e52a86761d/extract/0.log"
Jun 03 02:17:45.019052 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:45.019024    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72_48b1644c-85bc-476f-b241-b0e52a86761d/util/0.log"
Jun 03 02:17:45.041787 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:45.041759    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16jt72_48b1644c-85bc-476f-b241-b0e52a86761d/pull/0.log"
Jun 03 02:17:45.545772 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:45.545738    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-7kvjx_9380bf3a-f8f8-482d-b198-4aa095a96a87/manager/0.log"
Jun 03 02:17:46.890820 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:46.890791    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86/alertmanager/0.log"
Jun 03 02:17:46.916440 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:46.916411    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86/config-reloader/0.log"
Jun 03 02:17:46.939917 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:46.939888    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86/kube-rbac-proxy-web/0.log"
Jun 03 02:17:46.966632 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:46.966578    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86/kube-rbac-proxy/0.log"
Jun 03 02:17:46.988596 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:46.988567    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86/kube-rbac-proxy-metric/0.log"
Jun 03 02:17:47.014462 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:47.014432    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86/prom-label-proxy/0.log"
Jun 03 02:17:47.037262 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:47.037233    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba4f7b5f-4f2a-402f-8e35-38ffb08fbe86/init-config-reloader/0.log"
Jun 03 02:17:47.078521 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:47.078481    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-xhlkz_5c6f2ce1-e70c-4c86-84e1-f2f8e7004148/cluster-monitoring-operator/0.log"
Jun 03 02:17:47.365286 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:47.365204    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bfp6w_e6e67ccc-cb1f-4856-b0d7-049b1a67872e/node-exporter/0.log"
Jun 03 02:17:47.387433 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:47.387408    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bfp6w_e6e67ccc-cb1f-4856-b0d7-049b1a67872e/kube-rbac-proxy/0.log"
Jun 03 02:17:47.408447 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:47.408423    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bfp6w_e6e67ccc-cb1f-4856-b0d7-049b1a67872e/init-textfile/0.log"
Jun 03 02:17:47.886717 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:47.886687    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d9ff5fbb-jxnmg_83767c39-2a8a-4689-a7eb-e4fdc77d2238/telemeter-client/0.log"
Jun 03 02:17:47.908282 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:47.908245    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d9ff5fbb-jxnmg_83767c39-2a8a-4689-a7eb-e4fdc77d2238/reload/0.log"
Jun 03 02:17:47.931002 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:47.930970    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d9ff5fbb-jxnmg_83767c39-2a8a-4689-a7eb-e4fdc77d2238/kube-rbac-proxy/0.log"
Jun 03 02:17:50.354740 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:50.354713    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d858dc746-sj9bd_af6fcd5b-5367-44b3-a1bf-56396bf6a9c5/console/0.log"
Jun 03 02:17:50.389831 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:50.389798    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-rrfkj_b81dfe85-1760-4ac0-87b4-5a90bf58547f/download-server/0.log"
Jun 03 02:17:51.691214 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:51.691173    2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x4cvb/perf-node-gather-daemonset-xwtvm"]
Jun 03 02:17:51.695071 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:51.695050    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-xwtvm"
Jun 03 02:17:51.697339 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:51.697317    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x4cvb\"/\"kube-root-ca.crt\""
Jun 03 02:17:51.697339 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:51.697327    2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-x4cvb\"/\"default-dockercfg-fv2mg\""
Jun 03 02:17:51.697528 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:51.697367    2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x4cvb\"/\"openshift-service-ca.crt\""
Jun 03 02:17:51.704366 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:51.704332    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x4cvb/perf-node-gather-daemonset-xwtvm"]
Jun 03 02:17:51.820874 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:51.820837    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3594139b-15a4-4771-b2a1-75e05df07626-lib-modules\") pod \"perf-node-gather-daemonset-xwtvm\" (UID: \"3594139b-15a4-4771-b2a1-75e05df07626\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-xwtvm"
Jun 03 02:17:51.821063 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:51.820971    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3594139b-15a4-4771-b2a1-75e05df07626-podres\") pod \"perf-node-gather-daemonset-xwtvm\" (UID: \"3594139b-15a4-4771-b2a1-75e05df07626\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-xwtvm"
Jun 03 02:17:51.821063 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:51.821036    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3594139b-15a4-4771-b2a1-75e05df07626-proc\") pod \"perf-node-gather-daemonset-xwtvm\" (UID: \"3594139b-15a4-4771-b2a1-75e05df07626\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-xwtvm"
Jun 03 02:17:51.821138 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:51.821109    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3594139b-15a4-4771-b2a1-75e05df07626-sys\") pod \"perf-node-gather-daemonset-xwtvm\" (UID: \"3594139b-15a4-4771-b2a1-75e05df07626\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-xwtvm"
Jun 03 02:17:51.821178 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:51.821151    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpft8\" (UniqueName: \"kubernetes.io/projected/3594139b-15a4-4771-b2a1-75e05df07626-kube-api-access-rpft8\") pod \"perf-node-gather-daemonset-xwtvm\" (UID: \"3594139b-15a4-4771-b2a1-75e05df07626\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-xwtvm"
Jun 03 02:17:51.841098 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:51.841070    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zthbg_b3864081-3019-44a7-8958-5075918ca6b3/dns/0.log"
Jun 03 02:17:51.863947 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:51.863917    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zthbg_b3864081-3019-44a7-8958-5075918ca6b3/kube-rbac-proxy/0.log"
Jun 03 02:17:51.922433 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:51.922397    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3594139b-15a4-4771-b2a1-75e05df07626-podres\") pod \"perf-node-gather-daemonset-xwtvm\" (UID: \"3594139b-15a4-4771-b2a1-75e05df07626\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-xwtvm"
Jun 03 02:17:51.922694 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:51.922444    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3594139b-15a4-4771-b2a1-75e05df07626-proc\") pod \"perf-node-gather-daemonset-xwtvm\" (UID: \"3594139b-15a4-4771-b2a1-75e05df07626\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-xwtvm"
Jun 03 02:17:51.922694 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:51.922488    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3594139b-15a4-4771-b2a1-75e05df07626-sys\") pod \"perf-node-gather-daemonset-xwtvm\" (UID: \"3594139b-15a4-4771-b2a1-75e05df07626\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-xwtvm"
Jun 03 02:17:51.922694 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:51.922519    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rpft8\" (UniqueName: \"kubernetes.io/projected/3594139b-15a4-4771-b2a1-75e05df07626-kube-api-access-rpft8\") pod \"perf-node-gather-daemonset-xwtvm\" (UID: \"3594139b-15a4-4771-b2a1-75e05df07626\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-xwtvm"
Jun 03 02:17:51.922694 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:51.922547    2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3594139b-15a4-4771-b2a1-75e05df07626-lib-modules\") pod \"perf-node-gather-daemonset-xwtvm\" (UID: \"3594139b-15a4-4771-b2a1-75e05df07626\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-xwtvm"
Jun 03 02:17:51.922694 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:51.922562    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3594139b-15a4-4771-b2a1-75e05df07626-proc\") pod \"perf-node-gather-daemonset-xwtvm\" (UID: \"3594139b-15a4-4771-b2a1-75e05df07626\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-xwtvm"
Jun 03 02:17:51.922694 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:51.922628    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3594139b-15a4-4771-b2a1-75e05df07626-podres\") pod \"perf-node-gather-daemonset-xwtvm\" (UID: \"3594139b-15a4-4771-b2a1-75e05df07626\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-xwtvm"
Jun 03 02:17:51.922694 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:51.922632    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3594139b-15a4-4771-b2a1-75e05df07626-sys\") pod \"perf-node-gather-daemonset-xwtvm\" (UID: \"3594139b-15a4-4771-b2a1-75e05df07626\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-xwtvm"
Jun 03 02:17:51.922978 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:51.922722    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3594139b-15a4-4771-b2a1-75e05df07626-lib-modules\") pod \"perf-node-gather-daemonset-xwtvm\" (UID: \"3594139b-15a4-4771-b2a1-75e05df07626\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-xwtvm"
Jun 03 02:17:51.929471 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:51.929438    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j6knj_fd36a345-5628-409d-9024-eed1daad505b/dns-node-resolver/0.log"
Jun 03 02:17:51.930033 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:51.930014    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpft8\" (UniqueName: \"kubernetes.io/projected/3594139b-15a4-4771-b2a1-75e05df07626-kube-api-access-rpft8\") pod \"perf-node-gather-daemonset-xwtvm\" (UID: \"3594139b-15a4-4771-b2a1-75e05df07626\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-xwtvm"
Jun 03 02:17:52.009412 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:52.009322    2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-xwtvm"
Jun 03 02:17:52.149274 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:52.149246    2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x4cvb/perf-node-gather-daemonset-xwtvm"]
Jun 03 02:17:52.150794 ip-10-0-137-62 kubenswrapper[2577]: W0603 02:17:52.150756    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3594139b_15a4_4771_b2a1_75e05df07626.slice/crio-9dc998547ee3252316fc97ebff65f3c3b9bc1a04aae498495733cb50af539d5e WatchSource:0}: Error finding container 9dc998547ee3252316fc97ebff65f3c3b9bc1a04aae498495733cb50af539d5e: Status 404 returned error can't find the container with id 9dc998547ee3252316fc97ebff65f3c3b9bc1a04aae498495733cb50af539d5e
Jun 03 02:17:52.152548 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:52.152528    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 02:17:52.384495 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:52.384461    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6c99f595c-zl8vj_de4faf03-321d-44d3-8f21-6411d381e32e/registry/0.log"
Jun 03 02:17:52.404788 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:52.404758    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kq6lz_6dd7eb65-6fd1-4d72-a705-68df80e3c9f9/node-ca/0.log"
Jun 03 02:17:52.717055 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:52.716965    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-xwtvm" event={"ID":"3594139b-15a4-4771-b2a1-75e05df07626","Type":"ContainerStarted","Data":"b726af207079f172c5be849616432442709022b60bd50108dac082fb62cb3c92"}
Jun 03 02:17:52.717055 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:52.717001    2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-xwtvm" event={"ID":"3594139b-15a4-4771-b2a1-75e05df07626","Type":"ContainerStarted","Data":"9dc998547ee3252316fc97ebff65f3c3b9bc1a04aae498495733cb50af539d5e"}
Jun 03 02:17:52.717452 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:52.717087    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-xwtvm"
Jun 03 02:17:52.733997 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:52.733943    2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-xwtvm" podStartSLOduration=1.733927455 podStartE2EDuration="1.733927455s" podCreationTimestamp="2026-06-03 02:17:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 02:17:52.732365989 +0000 UTC m=+2242.296761801" watchObservedRunningTime="2026-06-03 02:17:52.733927455 +0000 UTC m=+2242.298323316"
Jun 03 02:17:53.324990 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:53.324951    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-dc6ng_320700f9-b5e3-46bf-94c4-eacd95b37173/discovery/0.log"
Jun 03 02:17:53.367488 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:53.367458    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-889cb89c5-wsddf_75f8daf2-fbfd-4d99-b7f0-449dec047cc8/kube-auth-proxy/0.log"
Jun 03 02:17:53.533159 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:53.533115    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-lk9cb_40cd08e3-65d5-4c91-9414-7341c2053e12/payload-processing/0.log"
Jun 03 02:17:53.552789 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:53.552766    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6fd64f4d5f-4qdl5_c463f7df-73f3-4c28-906a-c62846ca8a4b/router/0.log"
Jun 03 02:17:54.060488 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:54.060459    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-96vwc_ab8c3cff-b7cf-4b1e-bc43-a690f753ec12/serve-healthcheck-canary/0.log"
Jun 03 02:17:54.516521 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:54.516484    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-9j24t_d7dc8e7f-6638-40fb-9c54-6cc4902c5938/insights-operator/0.log"
Jun 03 02:17:54.517915 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:54.517894    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-9j24t_d7dc8e7f-6638-40fb-9c54-6cc4902c5938/insights-operator/1.log"
Jun 03 02:17:54.600010 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:54.599970    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kk5kb_84e65c14-6bee-434f-8d99-fc6edab71f18/kube-rbac-proxy/0.log"
Jun 03 02:17:54.621954 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:54.621924    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kk5kb_84e65c14-6bee-434f-8d99-fc6edab71f18/exporter/0.log"
Jun 03 02:17:54.651873 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:54.651846    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kk5kb_84e65c14-6bee-434f-8d99-fc6edab71f18/extractor/0.log"
Jun 03 02:17:56.782485 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:56.782452    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7b94c665b4-8jbrx_637bf8fb-391b-493c-94b9-1299f18b3e66/nginx/0.log"
Jun 03 02:17:56.828777 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:56.828744    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-lngwz_5945ffb4-861e-489c-ac58-07e0dfa8cb92/manager/0.log"
Jun 03 02:17:56.905960 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:56.905927    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-69dns_d99277bb-4449-4aa2-a1e2-40f61893d4a0/manager/0.log"
Jun 03 02:17:56.941477 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:56.941444    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6479d59f95-lh72n_e5ad8095-8af4-4cee-971b-2c049ba21229/maas-api/0.log"
Jun 03 02:17:57.081405 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:57.081310    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-nzznf_a2da778c-dbfc-4257-a01f-693abd213542/server/0.log"
Jun 03 02:17:57.128486 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:57.128449    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-d5dt8_33dc33a6-a326-4f70-bebd-d9b2479414f0/manager/0.log"
Jun 03 02:17:57.152631 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:57.152597    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7_f76882ed-aadb-44f4-84ae-f78bf86dec41/manager/0.log"
Jun 03 02:17:57.172117 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:57.172087    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f9cd4ffb9-7gdw7_f76882ed-aadb-44f4-84ae-f78bf86dec41/copy-manifests/0.log"
Jun 03 02:17:57.384483 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:57.384461    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-8zhds_1ebcebd3-f875-414a-9a68-8d794aee429d/postgres/0.log"
Jun 03 02:17:58.704958 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:58.704924    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-fdhmv_2db860f7-7c9a-477d-a0a5-d04b34c0710c/openshift-lws-operator/0.log"
Jun 03 02:17:58.732129 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:17:58.732099    2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-xwtvm"
Jun 03 02:18:04.896051 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:18:04.896021    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cd5c9_b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15/kube-multus-additional-cni-plugins/0.log"
Jun 03 02:18:04.916863 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:18:04.916835    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cd5c9_b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15/egress-router-binary-copy/0.log"
Jun 03 02:18:04.937991 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:18:04.937957    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cd5c9_b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15/cni-plugins/0.log"
Jun 03 02:18:04.959149 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:18:04.959108    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cd5c9_b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15/bond-cni-plugin/0.log"
Jun 03 02:18:04.979172 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:18:04.979134    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cd5c9_b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15/routeoverride-cni/0.log"
Jun 03 02:18:05.000898 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:18:05.000869    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cd5c9_b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15/whereabouts-cni-bincopy/0.log"
Jun 03 02:18:05.022169 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:18:05.022135    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cd5c9_b0c5a9eb-af1c-4e6a-aaf0-a322ced7df15/whereabouts-cni/0.log"
Jun 03 02:18:05.237536 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:18:05.237449    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gmwmw_30eae78c-3802-46f5-a21a-c3f9fd825044/kube-multus/0.log"
Jun 03 02:18:05.371986 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:18:05.371957    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zwwq7_212f3e8b-a98d-4191-a9b8-b42694d05b21/network-metrics-daemon/0.log"
Jun 03 02:18:05.391519 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:18:05.391473    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zwwq7_212f3e8b-a98d-4191-a9b8-b42694d05b21/kube-rbac-proxy/0.log"
Jun 03 02:18:06.715965 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:18:06.715931    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/ovn-controller/0.log"
Jun 03 02:18:06.733778 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:18:06.733748    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/ovn-acl-logging/0.log"
Jun 03 02:18:06.744279 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:18:06.744248    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/ovn-acl-logging/1.log"
Jun 03 02:18:06.762790 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:18:06.762758    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/kube-rbac-proxy-node/0.log"
Jun 03 02:18:06.781942 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:18:06.781909    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/kube-rbac-proxy-ovn-metrics/0.log"
Jun 03 02:18:06.800696 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:18:06.800668    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/northd/0.log"
Jun 03 02:18:06.820162 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:18:06.820122    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/nbdb/0.log"
Jun 03 02:18:06.841451 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:18:06.841410    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/sbdb/0.log"
Jun 03 02:18:06.953189 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:18:06.953154    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qtd96_b49da4f9-9aed-4820-9908-ced2843a97f6/ovnkube-controller/0.log"
Jun 03 02:18:08.041074 ip-10-0-137-62 kubenswrapper[2577]: I0603 02:18:08.041037    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-hcml4_0843251b-e289-4bda-abcc-d9d49b1d2d00/network-check-target-container/0.log"