May 21 01:45:22.891307 ip-10-0-141-162 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 21 01:45:22.891320 ip-10-0-141-162 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 21 01:45:22.891329 ip-10-0-141-162 systemd[1]: kubelet.service: Failed with result 'resources'.
May 21 01:45:22.891650 ip-10-0-141-162 systemd[1]: Failed to start Kubernetes Kubelet.
May 21 01:45:32.051968 ip-10-0-141-162 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 21 01:45:32.051982 ip-10-0-141-162 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ac4529bb648740eabf03e1b988844a19 --
May 21 01:47:41.580837 ip-10-0-141-162 systemd[1]: Starting Kubernetes Kubelet...
May 21 01:47:42.081858 ip-10-0-141-162 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 01:47:42.081858 ip-10-0-141-162 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 21 01:47:42.081858 ip-10-0-141-162 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 01:47:42.081858 ip-10-0-141-162 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 21 01:47:42.081858 ip-10-0-141-162 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 01:47:42.084473 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.084402    2552 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 21 01:47:42.091617 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091593    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 01:47:42.091617 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091611    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 01:47:42.091617 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091615    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 01:47:42.091617 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091618    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 01:47:42.091617 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091621    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 01:47:42.091617 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091624    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 01:47:42.091836 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091626    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 01:47:42.091836 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091630    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 01:47:42.091836 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091632    2552 feature_gate.go:328] unrecognized feature gate: Example2
May 21 01:47:42.091836 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091635    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 01:47:42.091836 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091639    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 01:47:42.091836 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091643    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 01:47:42.091836 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091646    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 01:47:42.091836 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091648    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 01:47:42.091836 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091651    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 01:47:42.091836 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091654    2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 01:47:42.091836 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091656    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 01:47:42.091836 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091659    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 01:47:42.091836 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091661    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 01:47:42.091836 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091664    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 01:47:42.091836 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091667    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 01:47:42.091836 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091669    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 01:47:42.091836 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091672    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 01:47:42.091836 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091676    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 01:47:42.091836 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091678    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 01:47:42.091836 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091681    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 01:47:42.092318 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091685    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 01:47:42.092318 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091689    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 01:47:42.092318 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091692    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 01:47:42.092318 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091695    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 01:47:42.092318 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091698    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 01:47:42.092318 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091701    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 01:47:42.092318 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091704    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 01:47:42.092318 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091707    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 01:47:42.092318 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091710    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 01:47:42.092318 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091713    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 01:47:42.092318 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091716    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 01:47:42.092318 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091720    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 01:47:42.092318 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091722    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 01:47:42.092318 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091726    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 01:47:42.092318 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091729    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 01:47:42.092318 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091732    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 01:47:42.092318 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091735    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 01:47:42.092318 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091737    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 01:47:42.092318 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091740    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 01:47:42.092840 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091742    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 01:47:42.092840 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091745    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 01:47:42.092840 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091748    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 01:47:42.092840 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091750    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 01:47:42.092840 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091753    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 01:47:42.092840 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091756    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 01:47:42.092840 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091758    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 01:47:42.092840 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091761    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 01:47:42.092840 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091763    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 01:47:42.092840 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091766    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 01:47:42.092840 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091769    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 01:47:42.092840 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091771    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 01:47:42.092840 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091773    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 01:47:42.092840 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091776    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 01:47:42.092840 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091778    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 01:47:42.092840 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091781    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 01:47:42.092840 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091783    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 01:47:42.092840 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091786    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 01:47:42.092840 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091788    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 01:47:42.093290 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091791    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 01:47:42.093290 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091793    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 01:47:42.093290 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091796    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 01:47:42.093290 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091798    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 01:47:42.093290 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091801    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 01:47:42.093290 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091803    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 01:47:42.093290 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091807    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 01:47:42.093290 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091811    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 01:47:42.093290 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091813    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 01:47:42.093290 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091816    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 01:47:42.093290 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091818    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 01:47:42.093290 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091821    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 01:47:42.093290 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091824    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 01:47:42.093290 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091826    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 01:47:42.093290 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091830    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 01:47:42.093290 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091833    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 01:47:42.093290 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091836    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 01:47:42.093290 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091838    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 01:47:42.093290 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091841    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 01:47:42.093290 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091844    2552 feature_gate.go:328] unrecognized feature gate: Example
May 21 01:47:42.093789 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091846    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 01:47:42.093789 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.091849    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 01:47:42.093789 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092223    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 01:47:42.093789 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092228    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 01:47:42.093789 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092231    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 01:47:42.093789 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092233    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 01:47:42.093789 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092236    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 01:47:42.093789 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092239    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 01:47:42.093789 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092241    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 01:47:42.093789 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092244    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 01:47:42.093789 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092247    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 01:47:42.093789 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092249    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 01:47:42.093789 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092252    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 01:47:42.093789 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092254    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 01:47:42.093789 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092257    2552 feature_gate.go:328] unrecognized feature gate: Example
May 21 01:47:42.093789 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092259    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 01:47:42.093789 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092261    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 01:47:42.093789 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092264    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 01:47:42.093789 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092266    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 01:47:42.093789 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092270    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 01:47:42.094265 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092272    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 01:47:42.094265 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092275    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 01:47:42.094265 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092278    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 01:47:42.094265 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092280    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 01:47:42.094265 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092284    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 01:47:42.094265 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092288    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 01:47:42.094265 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092292    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 01:47:42.094265 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092295    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 01:47:42.094265 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092298    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 01:47:42.094265 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092300    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 01:47:42.094265 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092303    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 01:47:42.094265 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092306    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 01:47:42.094265 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092308    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 01:47:42.094265 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092311    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 01:47:42.094265 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092314    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 01:47:42.094265 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092316    2552 feature_gate.go:328] unrecognized feature gate: Example2
May 21 01:47:42.094265 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092319    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 01:47:42.094265 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092321    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 01:47:42.094265 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092324    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 01:47:42.094745 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092326    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 01:47:42.094745 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092329    2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 01:47:42.094745 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092332    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 01:47:42.094745 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092334    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 01:47:42.094745 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092337    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 01:47:42.094745 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092340    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 01:47:42.094745 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092342    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 01:47:42.094745 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092345    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 01:47:42.094745 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092347    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 01:47:42.094745 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092349    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 01:47:42.094745 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092352    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 01:47:42.094745 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092354    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 01:47:42.094745 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092360    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 01:47:42.094745 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092364    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 01:47:42.094745 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092367    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 01:47:42.094745 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092369    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 01:47:42.094745 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092372    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 01:47:42.094745 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092374    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 01:47:42.094745 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092376    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 01:47:42.095211 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092379    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 01:47:42.095211 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092382    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 01:47:42.095211 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092384    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 01:47:42.095211 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092387    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 01:47:42.095211 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092389    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 01:47:42.095211 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092392    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 01:47:42.095211 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092394    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 01:47:42.095211 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092397    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 01:47:42.095211 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092399    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 01:47:42.095211 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092402    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 01:47:42.095211 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092404    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 01:47:42.095211 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092407    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 01:47:42.095211 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092409    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 01:47:42.095211 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092411    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 01:47:42.095211 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092414    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 01:47:42.095211 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092416    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 01:47:42.095211 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092418    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 01:47:42.095211 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092421    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 01:47:42.095211 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092424    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 01:47:42.095211 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092426    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 01:47:42.095709 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092429    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 01:47:42.095709 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092432    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 01:47:42.095709 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092435    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 01:47:42.095709 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092438    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 01:47:42.095709 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092440    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 01:47:42.095709 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092443    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 01:47:42.095709 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092446    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 01:47:42.095709 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092448    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 01:47:42.095709 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092450    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 01:47:42.095709 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.092453    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 01:47:42.095709 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092522    2552 flags.go:64] FLAG: --address="0.0.0.0"
May 21 01:47:42.095709 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092529    2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 21 01:47:42.095709 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092535    2552 flags.go:64] FLAG: --anonymous-auth="true"
May 21 01:47:42.095709 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092540    2552 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 21 01:47:42.095709 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092561    2552 flags.go:64] FLAG: --authentication-token-webhook="false"
May 21 01:47:42.095709 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092566    2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 21 01:47:42.095709 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092573    2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 21 01:47:42.095709 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092577    2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 21 01:47:42.095709 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092580    2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 21 01:47:42.095709 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092583    2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 21 01:47:42.095709 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092586    2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 21 01:47:42.096201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092590    2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 21 01:47:42.096201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092593    2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 21 01:47:42.096201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092596    2552 flags.go:64] FLAG: --cgroup-root=""
May 21 01:47:42.096201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092599    2552 flags.go:64] FLAG: --cgroups-per-qos="true"
May 21 01:47:42.096201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092602    2552 flags.go:64] FLAG: --client-ca-file=""
May 21 01:47:42.096201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092604    2552 flags.go:64] FLAG: --cloud-config=""
May 21 01:47:42.096201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092607    2552 flags.go:64] FLAG: --cloud-provider="external"
May 21 01:47:42.096201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092610    2552 flags.go:64] FLAG: --cluster-dns="[]"
May 21 01:47:42.096201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092619    2552 flags.go:64] FLAG: --cluster-domain=""
May 21 01:47:42.096201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092622    2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 21 01:47:42.096201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092625    2552 flags.go:64] FLAG: --config-dir=""
May 21 01:47:42.096201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092628    2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 21 01:47:42.096201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092631    2552 flags.go:64] FLAG: --container-log-max-files="5"
May 21 01:47:42.096201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092635    2552 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 21 01:47:42.096201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092639    2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 21 01:47:42.096201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092642    2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 21 01:47:42.096201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092645    2552 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 21 01:47:42.096201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092648    2552 flags.go:64] FLAG: --contention-profiling="false"
May 21 01:47:42.096201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092651    2552 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 21 01:47:42.096201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092654    2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 21 01:47:42.096201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092657    2552 flags.go:64] FLAG: --cpu-manager-policy="none"
May 21 01:47:42.096201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092659    2552 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 21 01:47:42.096201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092663    2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 21 01:47:42.096201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092666    2552 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 21 01:47:42.096201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092669    2552 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 21 01:47:42.096823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092672    2552 flags.go:64] FLAG: --enable-load-reader="false"
May 21 01:47:42.096823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092676    2552 flags.go:64] FLAG: --enable-server="true"
May 21 01:47:42.096823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092679    2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 21 01:47:42.096823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092688    2552 flags.go:64] FLAG: --event-burst="100"
May 21 01:47:42.096823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092691    2552 flags.go:64] FLAG: --event-qps="50"
May 21 01:47:42.096823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092694    2552 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 21 01:47:42.096823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092697    2552 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 21 01:47:42.096823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092700    2552 flags.go:64] FLAG: --eviction-hard=""
May 21 01:47:42.096823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092704    2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 21 01:47:42.096823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092706    2552 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 21 01:47:42.096823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092710    2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 21 01:47:42.096823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092712    2552 flags.go:64] FLAG: --eviction-soft=""
May 21 01:47:42.096823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092715    2552 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 21 01:47:42.096823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092718    2552 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 21 01:47:42.096823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092721    2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 21 01:47:42.096823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092724    2552 flags.go:64] FLAG: --experimental-mounter-path=""
May 21 01:47:42.096823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092727    2552 flags.go:64] FLAG: --fail-cgroupv1="false"
May 21 01:47:42.096823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092729    2552 flags.go:64] FLAG: --fail-swap-on="true"
May 21 01:47:42.096823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092733    2552 flags.go:64] FLAG: --feature-gates=""
May 21 01:47:42.096823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092737    2552 flags.go:64] FLAG: --file-check-frequency="20s"
May 21 01:47:42.096823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092740    2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 21 01:47:42.096823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092743    2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 21 01:47:42.096823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092746    2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 21 01:47:42.096823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092749    2552 flags.go:64] FLAG: --healthz-port="10248"
May 21 01:47:42.096823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092752    2552 flags.go:64] FLAG: --help="false"
May 21 01:47:42.097459 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092755    2552 flags.go:64] FLAG: --hostname-override="ip-10-0-141-162.ec2.internal"
May 21 01:47:42.097459 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092758    2552 flags.go:64] FLAG: --housekeeping-interval="10s"
May 21 01:47:42.097459 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092761    2552 flags.go:64] FLAG: --http-check-frequency="20s"
May 21 01:47:42.097459 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092764    2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 21 01:47:42.097459 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092767    2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 21 01:47:42.097459 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092770    2552 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 21 01:47:42.097459 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092773    2552 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 21 01:47:42.097459 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092776    2552 flags.go:64] FLAG: --image-service-endpoint=""
May 21 01:47:42.097459 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092779    2552 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 21 01:47:42.097459 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092783    2552 flags.go:64] FLAG: --kube-api-burst="100"
May 21 01:47:42.097459 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092786    2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 21 01:47:42.097459 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092789    2552 flags.go:64] FLAG: --kube-api-qps="50"
May 21 01:47:42.097459 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092792    2552 flags.go:64] FLAG: --kube-reserved=""
May 21 01:47:42.097459 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092800    2552 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 21 01:47:42.097459 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092803    2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 21 01:47:42.097459 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092806    2552 flags.go:64] FLAG: --kubelet-cgroups=""
May 21 01:47:42.097459 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092809    2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 21 01:47:42.097459 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092812    2552 flags.go:64] FLAG: --lock-file=""
May 21 01:47:42.097459 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092815    2552 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 21 01:47:42.097459 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092818    2552 flags.go:64] FLAG: --log-flush-frequency="5s"
May 21 01:47:42.097459 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092821    2552 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 21 01:47:42.097459 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092826    2552 flags.go:64] FLAG: --log-json-split-stream="false"
May 21 01:47:42.097459 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092829    2552 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 21 01:47:42.098029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092832    2552 flags.go:64] FLAG: --log-text-split-stream="false"
May 21 01:47:42.098029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092834    2552 flags.go:64] FLAG: --logging-format="text"
May 21 01:47:42.098029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092837    2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 21 01:47:42.098029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092841    2552 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 21 01:47:42.098029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092845    2552 flags.go:64] FLAG: --manifest-url=""
May 21 01:47:42.098029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092848    2552 flags.go:64] FLAG: --manifest-url-header=""
May 21 01:47:42.098029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092852    2552 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 21 01:47:42.098029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092855    2552 flags.go:64] FLAG: --max-open-files="1000000"
May 21 01:47:42.098029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092859    2552 flags.go:64] FLAG: --max-pods="110"
May 21 01:47:42.098029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092862    2552 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 21 01:47:42.098029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092865    2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 21 01:47:42.098029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092868    2552 flags.go:64] FLAG: --memory-manager-policy="None"
May 21 01:47:42.098029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092872    2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 21 01:47:42.098029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092874    2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 21 01:47:42.098029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092877    2552 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 21 01:47:42.098029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092880    2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 21 01:47:42.098029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092887    2552 flags.go:64] FLAG: --node-status-max-images="50"
May 21 01:47:42.098029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092890    2552 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 21 01:47:42.098029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092893    2552 flags.go:64] FLAG: --oom-score-adj="-999"
May 21 01:47:42.098029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092896    2552 flags.go:64] FLAG: --pod-cidr=""
May 21 01:47:42.098029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092899    2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 21 01:47:42.098029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092904    2552 flags.go:64] FLAG: --pod-manifest-path=""
May 21 01:47:42.098029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092908    2552 flags.go:64] FLAG: --pod-max-pids="-1"
May 21 01:47:42.098029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092911    2552 flags.go:64] FLAG: --pods-per-core="0"
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092914    2552 flags.go:64] FLAG: --port="10250"
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092917    2552 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092920    2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-033d31be0741f2a2b"
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092923    2552 flags.go:64] FLAG: --qos-reserved=""
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092926    2552 flags.go:64] FLAG: --read-only-port="10255"
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092929    2552 flags.go:64] FLAG: --register-node="true"
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092932    2552 flags.go:64] FLAG: --register-schedulable="true"
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092934    2552 flags.go:64] FLAG: --register-with-taints=""
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092938    2552 flags.go:64] FLAG: --registry-burst="10"
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092945    2552 flags.go:64] FLAG: --registry-qps="5"
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092947    2552 flags.go:64] FLAG: --reserved-cpus=""
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092950    2552 flags.go:64] FLAG: --reserved-memory=""
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092954    2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092957    2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092960    2552 flags.go:64] FLAG: --rotate-certificates="false"
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092963    2552 flags.go:64] FLAG: --rotate-server-certificates="false"
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092966    2552 flags.go:64] FLAG: --runonce="false"
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092968    2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092971    2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092974    2552 flags.go:64] FLAG: --seccomp-default="false"
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092977    2552 flags.go:64] FLAG: --serialize-image-pulls="true"
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092980    2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092983    2552 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092986    2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092989    2552 flags.go:64] FLAG: --storage-driver-password="root"
May 21 01:47:42.098618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092992    2552 flags.go:64] FLAG: --storage-driver-secure="false"
May 21 01:47:42.099247 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092995    2552 flags.go:64] FLAG: --storage-driver-table="stats"
May 21 01:47:42.099247 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.092997    2552 flags.go:64] FLAG: --storage-driver-user="root"
May 21 01:47:42.099247 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.093001    2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 21 01:47:42.099247 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.093004    2552 flags.go:64] FLAG: --sync-frequency="1m0s"
May 21 01:47:42.099247 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.093008    2552 flags.go:64] FLAG: --system-cgroups=""
May 21 01:47:42.099247 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.093011    2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 21 01:47:42.099247 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.093016    2552 flags.go:64] FLAG: --system-reserved-cgroup=""
May 21 01:47:42.099247 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.093018    2552 flags.go:64] FLAG: --tls-cert-file=""
May 21 01:47:42.099247 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.093021    2552 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 21 01:47:42.099247 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.093025    2552 flags.go:64] FLAG: --tls-min-version=""
May 21 01:47:42.099247 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.093028    2552 flags.go:64] FLAG: --tls-private-key-file=""
May 21 01:47:42.099247 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.093031    2552 flags.go:64] FLAG: --topology-manager-policy="none"
May 21 01:47:42.099247 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.093033    2552 flags.go:64] FLAG: --topology-manager-policy-options=""
May 21 01:47:42.099247 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.093036    2552 flags.go:64] FLAG: --topology-manager-scope="container"
May 21 01:47:42.099247 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.093039    2552 flags.go:64] FLAG: --v="2"
May 21 01:47:42.099247 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.093045    2552 flags.go:64] FLAG: --version="false"
May 21 01:47:42.099247 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.093049    2552 flags.go:64] FLAG: --vmodule=""
May 21 01:47:42.099247 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.093053    2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 21 01:47:42.099247 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.093056    2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 21 01:47:42.099247 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093140    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 01:47:42.099247 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093144    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 01:47:42.099247 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093147    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 01:47:42.099247 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093150    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 01:47:42.099247 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093153    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 01:47:42.100078 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093156    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 01:47:42.100078 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093158    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 01:47:42.100078 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093161    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 01:47:42.100078 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093164    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 01:47:42.100078 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093166    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 01:47:42.100078 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093169    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 01:47:42.100078 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093171    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 01:47:42.100078 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093174    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 01:47:42.100078 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093177    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 01:47:42.100078 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093179    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 01:47:42.100078 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093182    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 01:47:42.100078 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093185    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 01:47:42.100078 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093189    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 01:47:42.100078 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093192    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 01:47:42.100078 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093194    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 01:47:42.100078 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093197    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 01:47:42.100078 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093200    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 01:47:42.100078 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093202    2552 feature_gate.go:328] unrecognized feature gate: Example2
May 21 01:47:42.100078 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093205    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 01:47:42.100078 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093208    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 01:47:42.100977 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093210    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 01:47:42.100977 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093213    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 01:47:42.100977 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093216    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 01:47:42.100977 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093221    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 01:47:42.100977 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093224    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 01:47:42.100977 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093227    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 01:47:42.100977 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093230    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 01:47:42.100977 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093233    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 01:47:42.100977 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093235    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 01:47:42.100977 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093238    2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 01:47:42.100977 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093241    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 01:47:42.100977 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093243    2552 feature_gate.go:328] unrecognized feature gate: Example
May 21 01:47:42.100977 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093246    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 01:47:42.100977 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093248    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 01:47:42.100977 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093251    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 01:47:42.100977 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093253    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 01:47:42.100977 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093256    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 01:47:42.100977 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093258    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 01:47:42.100977 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093261    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 01:47:42.100977 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093264    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 01:47:42.101909 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093266    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 01:47:42.101909 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093269    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 01:47:42.101909 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093272    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 01:47:42.101909 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093274    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 01:47:42.101909 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093279    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 01:47:42.101909 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093281    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 01:47:42.101909 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093284    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 01:47:42.101909 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093287    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 01:47:42.101909 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093290    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 01:47:42.101909 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093292    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 01:47:42.101909 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093295    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 01:47:42.101909 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093298    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 01:47:42.101909 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093300    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 01:47:42.101909 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093303    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 01:47:42.101909 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093306    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 01:47:42.101909 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093309    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 01:47:42.101909 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093312    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 01:47:42.101909 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093314    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 01:47:42.101909 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093317    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 01:47:42.102753 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093319    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 01:47:42.102753 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093322    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 01:47:42.102753 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093324    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 01:47:42.102753 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093327    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 01:47:42.102753 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093329    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 01:47:42.102753 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093332    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 01:47:42.102753 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093335    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 01:47:42.102753 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093338    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 01:47:42.102753 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093342    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 01:47:42.102753 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093345    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 01:47:42.102753 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093347    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 01:47:42.102753 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093349    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 01:47:42.102753 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093352    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 01:47:42.102753 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093354    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 01:47:42.102753 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093357    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 01:47:42.102753 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093359    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 01:47:42.102753 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093362    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 01:47:42.102753 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093366    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 01:47:42.102753 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093368    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 01:47:42.103280 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093371    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 01:47:42.103280 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093374    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 01:47:42.103280 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.093376    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 01:47:42.103280 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.094350    2552 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 01:47:42.103280 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.101574    2552 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 21 01:47:42.103280 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.101596    2552 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 21 01:47:42.103280 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101667    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 01:47:42.103280 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101675    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 01:47:42.103280 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101680    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 01:47:42.103280 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101685    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 01:47:42.103280 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101689    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 01:47:42.103280 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101694    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 01:47:42.103280 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101699    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 01:47:42.103280 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101704    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 01:47:42.103280 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101709    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 01:47:42.103280 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101713    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 01:47:42.103822 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101718    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 01:47:42.103822 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101722    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 01:47:42.103822 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101726    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 01:47:42.103822 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101730    2552 feature_gate.go:328] unrecognized feature gate: Example2
May 21 01:47:42.103822 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101735    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 01:47:42.103822 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101739    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 01:47:42.103822 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101744    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 01:47:42.103822 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101748    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 01:47:42.103822 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101752    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 01:47:42.103822 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101760    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 01:47:42.103822 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101766    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 01:47:42.103822 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101770    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 01:47:42.103822 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101775    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 01:47:42.103822 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101779    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 01:47:42.103822 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101783    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 01:47:42.103822 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101787    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 01:47:42.103822 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101791    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 01:47:42.103822 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101795    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 01:47:42.103822 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101800    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 01:47:42.103822 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101805    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 01:47:42.104323 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101809    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 01:47:42.104323 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101816    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 01:47:42.104323 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101822    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 01:47:42.104323 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101828    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 01:47:42.104323 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101832    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 01:47:42.104323 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101837    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 01:47:42.104323 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101841    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 01:47:42.104323 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101845    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 01:47:42.104323 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101849    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 01:47:42.104323 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101854    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 01:47:42.104323 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101858    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 01:47:42.104323 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101862    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 01:47:42.104323 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101866    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 01:47:42.104323 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101871    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 01:47:42.104323 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101875    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 01:47:42.104323 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101879    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 01:47:42.104323 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101883    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 01:47:42.104323 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101887    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 01:47:42.104323 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101892    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 01:47:42.104323 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101897    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 01:47:42.105074 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101901    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 01:47:42.105074 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101905    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 01:47:42.105074 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101909    2552 feature_gate.go:328] unrecognized feature gate: Example
May 21 01:47:42.105074 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101912    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 01:47:42.105074 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101916    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 01:47:42.105074 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101920    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 01:47:42.105074 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101925    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 01:47:42.105074 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101928    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 01:47:42.105074 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101932    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 01:47:42.105074 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101936    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 01:47:42.105074 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101940    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 01:47:42.105074 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101946    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 01:47:42.105074 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101950    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 01:47:42.105074 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101954    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 01:47:42.105074 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101960    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 01:47:42.105074 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101964    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 01:47:42.105074 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101969    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 01:47:42.105074 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101973    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 01:47:42.105074 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101977    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 01:47:42.105074 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101981    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 01:47:42.105575 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101985    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 01:47:42.105575 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101989    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 01:47:42.105575 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101994    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 01:47:42.105575 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.101998    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 01:47:42.105575 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102002    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 01:47:42.105575 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102007    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 01:47:42.105575 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102011    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 01:47:42.105575 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102015    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 01:47:42.105575 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102019    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 01:47:42.105575 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102023    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 01:47:42.105575 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102030    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 01:47:42.105575 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102037    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 01:47:42.105575 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102042    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 01:47:42.105575 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102046    2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 01:47:42.105575 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102050    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 01:47:42.105575 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102055    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 01:47:42.105996 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.102063    2552 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 01:47:42.105996 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102226    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 01:47:42.105996 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102235    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 01:47:42.105996 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102240    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 01:47:42.105996 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102245    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 01:47:42.105996 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102249    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 01:47:42.105996 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102254    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 01:47:42.105996 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102258    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 01:47:42.105996 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102262    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 01:47:42.105996 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102266    2552 feature_gate.go:328] unrecognized feature gate: Example
May 21 01:47:42.105996 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102271    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 01:47:42.105996 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102276    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 01:47:42.105996 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102281    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 01:47:42.105996 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102285    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 01:47:42.105996 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102290    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 01:47:42.106368 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102294    2552 feature_gate.go:328] unrecognized feature gate: Example2
May 21 01:47:42.106368 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102299    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 01:47:42.106368 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102303    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 01:47:42.106368 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102307    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 01:47:42.106368 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102311    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 01:47:42.106368 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102315    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 01:47:42.106368 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102320    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 01:47:42.106368 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102324    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 01:47:42.106368 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102328    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 01:47:42.106368 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102335    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 01:47:42.106368 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102341    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 01:47:42.106368 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102347    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 01:47:42.106368 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102352    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 01:47:42.106368 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102357    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 01:47:42.106368 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102361    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 01:47:42.106368 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102366    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 01:47:42.106368 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102371    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 01:47:42.106368 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102375    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 01:47:42.106368 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102380    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 01:47:42.107040 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102384    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 01:47:42.107040 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102388    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 01:47:42.107040 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102392    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 01:47:42.107040 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102397    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 01:47:42.107040 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102401    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 01:47:42.107040 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102405    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 01:47:42.107040 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102410    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 01:47:42.107040 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102414    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 01:47:42.107040 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102418    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 01:47:42.107040 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102422    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 01:47:42.107040 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102427    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 01:47:42.107040 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102432    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 01:47:42.107040 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102436    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 01:47:42.107040 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102440    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 01:47:42.107040 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102444    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 01:47:42.107040 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102448    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 01:47:42.107040 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102453    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 01:47:42.107040 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102456    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 01:47:42.107040 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102461    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 01:47:42.107783 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102465    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 01:47:42.107783 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102469    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 01:47:42.107783 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102473    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 01:47:42.107783 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102477    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 01:47:42.107783 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102481    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 01:47:42.107783 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102486    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 01:47:42.107783 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102491    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 01:47:42.107783 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102495    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 01:47:42.107783 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102499    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 01:47:42.107783 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102503    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 01:47:42.107783 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102507    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 01:47:42.107783 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102511    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 01:47:42.107783 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102515    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 01:47:42.107783 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102519    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 01:47:42.107783 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102523    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 01:47:42.107783 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102526    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 01:47:42.107783 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102530    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 01:47:42.107783 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102535    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 01:47:42.107783 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102539    2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 01:47:42.107783 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102561    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 01:47:42.108261 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102566    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 01:47:42.108261 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102571    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 01:47:42.108261 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102575    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 01:47:42.108261 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102579    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 01:47:42.108261 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102584    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 01:47:42.108261 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102588    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 01:47:42.108261 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102592    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 01:47:42.108261 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102596    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 01:47:42.108261 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102601    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 01:47:42.108261 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102605    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 01:47:42.108261 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102609    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 01:47:42.108261 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102613    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 01:47:42.108261 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102617    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 01:47:42.108261 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:42.102621    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 01:47:42.108261 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.102629    2552 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 01:47:42.108261 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.103619    2552 server.go:962] "Client rotation is on, will bootstrap in background"
May 21 01:47:42.109040 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.108445    2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 21 01:47:42.110098 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.110084    2552 server.go:1019] "Starting client certificate rotation"
May 21 01:47:42.110202 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.110186    2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 01:47:42.110235 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.110219    2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 01:47:42.139147 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.139125    2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 01:47:42.141925 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.141906    2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 01:47:42.163707 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.163687    2552 log.go:25] "Validated CRI v1 runtime API"
May 21 01:47:42.169778 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.169760    2552 log.go:25] "Validated CRI v1 image API"
May 21 01:47:42.170891 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.170870    2552 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 01:47:42.173053 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.173033    2552 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 21 01:47:42.175744 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.175724    2552 fs.go:135] Filesystem UUIDs: map[723d52e6-3bde-4ed8-aed9-2bd1d0bd79a9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 881913c5-6ab0-47a1-a2aa-e9dbf2b414c6:/dev/nvme0n1p4]
May 21 01:47:42.175809 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.175743    2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 21 01:47:42.180073 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.179964    2552 manager.go:217] Machine: {Timestamp:2026-05-21 01:47:42.179474096 +0000 UTC m=+0.466720864 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098620 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2eb90ddd8a91923f8f5d905e5610eb SystemUUID:ec2eb90d-dd8a-9192-3f8f-5d905e5610eb BootID:ac4529bb-6487-40ea-bf03-e1b988844a19 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e1:44:8c:ea:a7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e1:44:8c:ea:a7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:96:d4:6a:31:98 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 21 01:47:42.180143 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.180093    2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 21 01:47:42.180172 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.180156    2552 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 21 01:47:42.181381 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.181361    2552 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 21 01:47:42.181519 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.181381    2552 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-162.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 21 01:47:42.181579 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.181529    2552 topology_manager.go:138] "Creating topology manager with none policy"
May 21 01:47:42.181579 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.181538    2552 container_manager_linux.go:306] "Creating device plugin manager"
May 21 01:47:42.181579 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.181561    2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 01:47:42.182513 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.182503    2552 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 01:47:42.183718 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.183708    2552 state_mem.go:36] "Initialized new in-memory state store"
May 21 01:47:42.183821 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.183812    2552 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 21 01:47:42.185604 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.185585    2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hhgmv"
May 21 01:47:42.186559 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.186536    2552 kubelet.go:491] "Attempting to sync node with API server"
May 21 01:47:42.186594 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.186565    2552 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 21 01:47:42.186594 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.186579    2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 21 01:47:42.186594 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.186588    2552 kubelet.go:397] "Adding apiserver pod source"
May 21 01:47:42.186676 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.186597    2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 21 01:47:42.187905 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.187894    2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 01:47:42.187956 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.187912    2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 01:47:42.190453 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.190434    2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hhgmv"
May 21 01:47:42.191561 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.191534    2552 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 21 01:47:42.193924 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.193905    2552 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 21 01:47:42.196084 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.196069    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 21 01:47:42.196084 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.196087    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 21 01:47:42.196186 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.196108    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 21 01:47:42.196186 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.196114    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 21 01:47:42.196186 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.196124    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 21 01:47:42.196186 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.196130    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 21 01:47:42.196186 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.196135    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 21 01:47:42.196186 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.196141    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 21 01:47:42.196186 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.196147    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 21 01:47:42.196186 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.196152    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 21 01:47:42.196186 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.196164    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 21 01:47:42.196186 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.196169    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 21 01:47:42.197208 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.197195    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 21 01:47:42.197208 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.197207    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 21 01:47:42.198316 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.198294    2552 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 01:47:42.200998 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.200977    2552 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 21 01:47:42.201108 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.201096    2552 server.go:1295] "Started kubelet"
May 21 01:47:42.201647 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.201628    2552 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 01:47:42.201779 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.201736    2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 21 01:47:42.202030 ip-10-0-141-162 systemd[1]: Started Kubernetes Kubelet.
May 21 01:47:42.202425 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.202212    2552 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 21 01:47:42.202616 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.202477    2552 server_v1.go:47] "podresources" method="list" useActivePods=true
May 21 01:47:42.204089 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.204072    2552 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 21 01:47:42.205136 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.205120    2552 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-141-162.ec2.internal" not found
May 21 01:47:42.205356 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.205339    2552 server.go:317] "Adding debug handlers to kubelet server"
May 21 01:47:42.212264 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.212244    2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 21 01:47:42.212264 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.212255    2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 21 01:47:42.212408 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.212302    2552 volume_manager.go:295] "The desired_state_of_world populator starts"
May 21 01:47:42.212408 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.212310    2552 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 21 01:47:42.212505 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.212418    2552 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 21 01:47:42.212505 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.212479    2552 reconstruct.go:97] "Volume reconstruction finished"
May 21 01:47:42.212505 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.212489    2552 reconciler.go:26] "Reconciler: start to sync state"
May 21 01:47:42.213103 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.213061    2552 factory.go:55] Registering systemd factory
May 21 01:47:42.213103 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.213079    2552 factory.go:223] Registration of the systemd container factory successfully
May 21 01:47:42.213571 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:42.213403    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found"
May 21 01:47:42.213686 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.213515    2552 factory.go:153] Registering CRI-O factory
May 21 01:47:42.213757 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.213693    2552 factory.go:223] Registration of the crio container factory successfully
May 21 01:47:42.213813 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.213776    2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 21 01:47:42.213813 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.213794    2552 factory.go:103] Registering Raw factory
May 21 01:47:42.213813 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.213807    2552 manager.go:1196] Started watching for new ooms in manager
May 21 01:47:42.213994 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:42.213520    2552 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 21 01:47:42.214190 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.214178    2552 manager.go:319] Starting recovery of all containers
May 21 01:47:42.214457 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.214435    2552 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 01:47:42.216176 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:42.216152    2552 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-162.ec2.internal\" not found" node="ip-10-0-141-162.ec2.internal"
May 21 01:47:42.219161 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.219135    2552 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-141-162.ec2.internal" not found
May 21 01:47:42.224977 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.224964    2552 manager.go:324] Recovery completed
May 21 01:47:42.228901 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.228889    2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 01:47:42.230680 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.230664    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientMemory"
May 21 01:47:42.230748 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.230704    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasNoDiskPressure"
May 21 01:47:42.230748 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.230715    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientPID"
May 21 01:47:42.231179 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.231166    2552 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 21 01:47:42.231179 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.231177    2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 21 01:47:42.231268 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.231199    2552 state_mem.go:36] "Initialized new in-memory state store"
May 21 01:47:42.234019 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.234005    2552 policy_none.go:49] "None policy: Start"
May 21 01:47:42.234081 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.234024    2552 memory_manager.go:186] "Starting memorymanager" policy="None"
May 21 01:47:42.234081 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.234037    2552 state_mem.go:35] "Initializing new in-memory state store"
May 21 01:47:42.275624 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.275605    2552 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-141-162.ec2.internal" not found
May 21 01:47:42.285005 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.280060    2552 manager.go:341] "Starting Device Plugin manager"
May 21 01:47:42.285005 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:42.280355    2552 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 21 01:47:42.285005 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.280388    2552 server.go:85] "Starting device plugin registration server"
May 21 01:47:42.285005 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.280617    2552 eviction_manager.go:189] "Eviction manager: starting control loop"
May 21 01:47:42.285005 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.280630    2552 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 21 01:47:42.285005 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.280814    2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 21 01:47:42.285005 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.280891    2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 21 01:47:42.285005 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.280899    2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 21 01:47:42.285005 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:42.281953    2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 21 01:47:42.285005 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:42.282001    2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-162.ec2.internal\" not found"
May 21 01:47:42.315654 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.315625    2552 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 21 01:47:42.316697 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.316685    2552 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 21 01:47:42.316752 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.316708    2552 status_manager.go:230] "Starting to sync pod status with apiserver"
May 21 01:47:42.316752 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.316721    2552 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 21 01:47:42.316752 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.316728    2552 kubelet.go:2451] "Starting kubelet main sync loop"
May 21 01:47:42.316843 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:42.316758    2552 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 21 01:47:42.318660 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.318641    2552 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 01:47:42.381469 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.381425    2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 01:47:42.382440 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.382414    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientMemory"
May 21 01:47:42.382526 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.382445    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasNoDiskPressure"
May 21 01:47:42.382526 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.382459    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientPID"
May 21 01:47:42.382526 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.382478    2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-162.ec2.internal"
May 21 01:47:42.390741 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.390725    2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-162.ec2.internal"
May 21 01:47:42.390786 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:42.390745    2552 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-162.ec2.internal\": node \"ip-10-0-141-162.ec2.internal\" not found"
May 21 01:47:42.417657 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.417634    2552 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal"]
May 21 01:47:42.419912 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.419895    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal"
May 21 01:47:42.419990 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.419896    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal"
May 21 01:47:42.452111 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.452094    2552 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal"
May 21 01:47:42.456509 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.456496    2552 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal"
May 21 01:47:42.469361 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.469343    2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 01:47:42.469437 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.469345    2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 01:47:42.513994 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.513966    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e8729e0afae81f85f1fdd1f8713f60cd-config\") pod \"kube-apiserver-proxy-ip-10-0-141-162.ec2.internal\" (UID: \"e8729e0afae81f85f1fdd1f8713f60cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal"
May 21 01:47:42.514066 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.513997    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/df7d891e45dc4894e91d322e3d16f193-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal\" (UID: \"df7d891e45dc4894e91d322e3d16f193\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal"
May 21 01:47:42.514066 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.514019    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df7d891e45dc4894e91d322e3d16f193-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal\" (UID: \"df7d891e45dc4894e91d322e3d16f193\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal"
May 21 01:47:42.614412 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.614392    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/df7d891e45dc4894e91d322e3d16f193-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal\" (UID: \"df7d891e45dc4894e91d322e3d16f193\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal"
May 21 01:47:42.614491 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.614417    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df7d891e45dc4894e91d322e3d16f193-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal\" (UID: \"df7d891e45dc4894e91d322e3d16f193\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal"
May 21 01:47:42.614491 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.614434    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e8729e0afae81f85f1fdd1f8713f60cd-config\") pod \"kube-apiserver-proxy-ip-10-0-141-162.ec2.internal\" (UID: \"e8729e0afae81f85f1fdd1f8713f60cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal"
May 21 01:47:42.614575 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.614492    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e8729e0afae81f85f1fdd1f8713f60cd-config\") pod \"kube-apiserver-proxy-ip-10-0-141-162.ec2.internal\" (UID: \"e8729e0afae81f85f1fdd1f8713f60cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal"
May 21 01:47:42.614575 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.614492    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df7d891e45dc4894e91d322e3d16f193-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal\" (UID: \"df7d891e45dc4894e91d322e3d16f193\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal"
May 21 01:47:42.614638 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.614573    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/df7d891e45dc4894e91d322e3d16f193-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal\" (UID: \"df7d891e45dc4894e91d322e3d16f193\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal"
May 21 01:47:42.772099 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.772051    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal"
May 21 01:47:42.773080 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:42.773067    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal"
May 21 01:47:43.109562 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.109491    2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 21 01:47:43.110113 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.109618    2552 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 01:47:43.110113 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.109622    2552 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 01:47:43.110113 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.109652    2552 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 01:47:43.187036 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.187013    2552 apiserver.go:52] "Watching apiserver"
May 21 01:47:43.192108 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.192074    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 01:42:42 +0000 UTC" deadline="2028-02-20 04:08:35.023307682 +0000 UTC"
May 21 01:47:43.192108 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.192106    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15362h20m51.831203592s"
May 21 01:47:43.194947 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.194930    2552 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 21 01:47:43.195310 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.195289    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g","openshift-cluster-node-tuning-operator/tuned-xk25b","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal","openshift-multus/multus-additional-cni-plugins-v9vqz","openshift-multus/network-metrics-daemon-hn6dl","openshift-network-diagnostics/network-check-target-6ld5n","openshift-dns/node-resolver-2jn8b","openshift-image-registry/node-ca-49shb","openshift-multus/multus-jt6xm","openshift-network-operator/iptables-alerter-sswsj","openshift-ovn-kubernetes/ovnkube-node-z8sf4","kube-system/konnectivity-agent-hq6nm","kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal"]
May 21 01:47:43.197957 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.197943    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g"
May 21 01:47:43.199997 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.199973    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.200393 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.200370    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 21 01:47:43.200489 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.200394    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 21 01:47:43.200661 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.200643    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 21 01:47:43.200716 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.200650    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mdkkf\""
May 21 01:47:43.202584 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.202467    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 21 01:47:43.203492 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.202747    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 21 01:47:43.203492 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.202769    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hrjsj\""
May 21 01:47:43.204684 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.204661    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.206949 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.206933    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 21 01:47:43.207143 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.207098    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:47:43.207236 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.207170    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:47:43.207236 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:43.207173    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn6dl" podUID="95930799-a903-46cc-b0ac-b157dfbd4bb8"
May 21 01:47:43.207342 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:43.207244    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ld5n" podUID="5eed9975-086b-4431-910d-aa0d9cf2dc74"
May 21 01:47:43.207413 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.207358    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 21 01:47:43.207413 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.207403    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 21 01:47:43.207523 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.207420    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kfshk\""
May 21 01:47:43.207523 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.207446    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 21 01:47:43.207523 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.207404    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 21 01:47:43.209307 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.209280    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2jn8b"
May 21 01:47:43.211497 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.211479    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-49shb"
May 21 01:47:43.211876 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.211857    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 21 01:47:43.211876 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.211872    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 21 01:47:43.212028 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.211890    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xk5qj\""
May 21 01:47:43.212367 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.212355    2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 21 01:47:43.213819 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.213798    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 21 01:47:43.213899 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.213809    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.213899 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.213834    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gnnmk\""
May 21 01:47:43.214177 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.214161    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 21 01:47:43.214226 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.214212    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 21 01:47:43.216081 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.216056    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rhdzl\""
May 21 01:47:43.216175 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.216105    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sswsj"
May 21 01:47:43.216415 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.216368    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 21 01:47:43.218036 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218017    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-sys\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.218123 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218043    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3dd449c6-c30a-404a-8163-d12b70542e94-os-release\") pod \"multus-additional-cni-plugins-v9vqz\" (UID: \"3dd449c6-c30a-404a-8163-d12b70542e94\") " pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.218123 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218062    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-hostroot\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.218123 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218088    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bd8f0513-bcd1-4c4a-be8f-af5172e44140-etc-selinux\") pod \"aws-ebs-csi-driver-node-qt46g\" (UID: \"bd8f0513-bcd1-4c4a-be8f-af5172e44140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g"
May 21 01:47:43.218272 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218128    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z95q6\" (UniqueName: \"kubernetes.io/projected/553e91d1-f895-496b-9432-4c1ab85db2d9-kube-api-access-z95q6\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.218272 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218163    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7v5r\" (UniqueName: \"kubernetes.io/projected/3dd449c6-c30a-404a-8163-d12b70542e94-kube-api-access-s7v5r\") pod \"multus-additional-cni-plugins-v9vqz\" (UID: \"3dd449c6-c30a-404a-8163-d12b70542e94\") " pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.218272 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218227    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-etc-sysconfig\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.218420 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218281    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-etc-sysctl-conf\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.218420 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218317    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-lib-modules\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.218420 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218345    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3dd449c6-c30a-404a-8163-d12b70542e94-system-cni-dir\") pod \"multus-additional-cni-plugins-v9vqz\" (UID: \"3dd449c6-c30a-404a-8163-d12b70542e94\") " pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.218420 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218384    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3dd449c6-c30a-404a-8163-d12b70542e94-cni-binary-copy\") pod \"multus-additional-cni-plugins-v9vqz\" (UID: \"3dd449c6-c30a-404a-8163-d12b70542e94\") " pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.218420 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218411    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-multus-cni-dir\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.218683 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218458    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-host-var-lib-cni-multus\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.218683 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218460    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 21 01:47:43.218683 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218485    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 21 01:47:43.218683 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218500    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-host\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.218683 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218531    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs\") pod \"network-metrics-daemon-hn6dl\" (UID: \"95930799-a903-46cc-b0ac-b157dfbd4bb8\") " pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:47:43.218683 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218582    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8xb8\" (UniqueName: \"kubernetes.io/projected/a4b8a809-3e02-4dd9-aba5-092aa39a344f-kube-api-access-z8xb8\") pod \"node-ca-49shb\" (UID: \"a4b8a809-3e02-4dd9-aba5-092aa39a344f\") " pod="openshift-image-registry/node-ca-49shb"
May 21 01:47:43.218683 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218595    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dxvp2\""
May 21 01:47:43.218683 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218607    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 21 01:47:43.218683 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218612    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-var-lib-kubelet\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.218683 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218588    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.219158 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218640    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3dd449c6-c30a-404a-8163-d12b70542e94-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v9vqz\" (UID: \"3dd449c6-c30a-404a-8163-d12b70542e94\") " pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.219158 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218759    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5c4f\" (UniqueName: \"kubernetes.io/projected/5eed9975-086b-4431-910d-aa0d9cf2dc74-kube-api-access-l5c4f\") pod \"network-check-target-6ld5n\" (UID: \"5eed9975-086b-4431-910d-aa0d9cf2dc74\") " pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:47:43.219158 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218787    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-cnibin\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.219158 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218826    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3dd449c6-c30a-404a-8163-d12b70542e94-cnibin\") pod \"multus-additional-cni-plugins-v9vqz\" (UID: \"3dd449c6-c30a-404a-8163-d12b70542e94\") " pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.219158 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218850    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3dd449c6-c30a-404a-8163-d12b70542e94-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v9vqz\" (UID: \"3dd449c6-c30a-404a-8163-d12b70542e94\") " pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.219158 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.218986    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c246e67d-eb3e-4599-8d35-e25d77dc3d6b-tmp-dir\") pod \"node-resolver-2jn8b\" (UID: \"c246e67d-eb3e-4599-8d35-e25d77dc3d6b\") " pod="openshift-dns/node-resolver-2jn8b"
May 21 01:47:43.219158 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219004    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/553e91d1-f895-496b-9432-4c1ab85db2d9-cni-binary-copy\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.219158 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219025    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-host-var-lib-kubelet\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.219158 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219047    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-run\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.219158 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219062    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-host-run-k8s-cni-cncf-io\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.219158 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219078    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-etc-kubernetes\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.219158 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219093    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp465\" (UniqueName: \"kubernetes.io/projected/bd5cd680-f612-4207-a7d2-f595aa762713-kube-api-access-mp465\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.219158 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219115    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-os-release\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.219158 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219139    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-host-run-netns\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.219158 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219152    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bd8f0513-bcd1-4c4a-be8f-af5172e44140-device-dir\") pod \"aws-ebs-csi-driver-node-qt46g\" (UID: \"bd8f0513-bcd1-4c4a-be8f-af5172e44140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g"
May 21 01:47:43.219611 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219196    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-etc-systemd\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.219611 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219219    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4b8a809-3e02-4dd9-aba5-092aa39a344f-serviceca\") pod \"node-ca-49shb\" (UID: \"a4b8a809-3e02-4dd9-aba5-092aa39a344f\") " pod="openshift-image-registry/node-ca-49shb"
May 21 01:47:43.219611 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219235    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bd8f0513-bcd1-4c4a-be8f-af5172e44140-socket-dir\") pod \"aws-ebs-csi-driver-node-qt46g\" (UID: \"bd8f0513-bcd1-4c4a-be8f-af5172e44140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g"
May 21 01:47:43.219611 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219257    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptq2q\" (UniqueName: \"kubernetes.io/projected/bd8f0513-bcd1-4c4a-be8f-af5172e44140-kube-api-access-ptq2q\") pod \"aws-ebs-csi-driver-node-qt46g\" (UID: \"bd8f0513-bcd1-4c4a-be8f-af5172e44140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g"
May 21 01:47:43.219611 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219283    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd5cd680-f612-4207-a7d2-f595aa762713-tmp\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.219611 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219296    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-system-cni-dir\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.219611 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219326    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bd8f0513-bcd1-4c4a-be8f-af5172e44140-sys-fs\") pod \"aws-ebs-csi-driver-node-qt46g\" (UID: \"bd8f0513-bcd1-4c4a-be8f-af5172e44140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g"
May 21 01:47:43.219611 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219348    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-multus-socket-dir-parent\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.219611 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219362    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c246e67d-eb3e-4599-8d35-e25d77dc3d6b-hosts-file\") pod \"node-resolver-2jn8b\" (UID: \"c246e67d-eb3e-4599-8d35-e25d77dc3d6b\") " pod="openshift-dns/node-resolver-2jn8b"
May 21 01:47:43.219611 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219374    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd5cd680-f612-4207-a7d2-f595aa762713-etc-tuned\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.219611 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219400    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3dd449c6-c30a-404a-8163-d12b70542e94-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v9vqz\" (UID: \"3dd449c6-c30a-404a-8163-d12b70542e94\") " pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.219611 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219428    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7czzp\" (UniqueName: \"kubernetes.io/projected/95930799-a903-46cc-b0ac-b157dfbd4bb8-kube-api-access-7czzp\") pod \"network-metrics-daemon-hn6dl\" (UID: \"95930799-a903-46cc-b0ac-b157dfbd4bb8\") " pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:47:43.219611 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219450    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-multus-conf-dir\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.219611 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219463    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/553e91d1-f895-496b-9432-4c1ab85db2d9-multus-daemon-config\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.219611 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219478    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-etc-sysctl-d\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.219611 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219519    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-host-var-lib-cni-bin\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.220096 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219584    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-host-run-multus-certs\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.220096 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219625    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bd8f0513-bcd1-4c4a-be8f-af5172e44140-registration-dir\") pod \"aws-ebs-csi-driver-node-qt46g\" (UID: \"bd8f0513-bcd1-4c4a-be8f-af5172e44140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g"
May 21 01:47:43.220096 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219660    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8lnl\" (UniqueName: \"kubernetes.io/projected/c246e67d-eb3e-4599-8d35-e25d77dc3d6b-kube-api-access-c8lnl\") pod \"node-resolver-2jn8b\" (UID: \"c246e67d-eb3e-4599-8d35-e25d77dc3d6b\") " pod="openshift-dns/node-resolver-2jn8b"
May 21 01:47:43.220096 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219685    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-etc-kubernetes\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.220096 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219716    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-etc-modprobe-d\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.220096 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219738    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4b8a809-3e02-4dd9-aba5-092aa39a344f-host\") pod \"node-ca-49shb\" (UID: \"a4b8a809-3e02-4dd9-aba5-092aa39a344f\") " pod="openshift-image-registry/node-ca-49shb"
May 21 01:47:43.220096 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.219772    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bd8f0513-bcd1-4c4a-be8f-af5172e44140-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qt46g\" (UID: \"bd8f0513-bcd1-4c4a-be8f-af5172e44140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g"
May 21 01:47:43.220739 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.220721    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hq6nm"
May 21 01:47:43.220921 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.220901    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 21 01:47:43.221005 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.220983    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sxmmq\""
May 21 01:47:43.221140 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.221124    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 21 01:47:43.221192 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.221128    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 21 01:47:43.221235 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.221127    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 21 01:47:43.222226 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.222202    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 21 01:47:43.222525 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.222476    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 21 01:47:43.222967 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.222950    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 21 01:47:43.223045 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.222969    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 21 01:47:43.223107 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.223063    2552 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 01:47:43.223107 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.223094    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z68sv\""
May 21 01:47:43.249184 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.249166    2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v242v"
May 21 01:47:43.254270 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.254255    2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v242v"
May 21 01:47:43.284839 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:43.284812    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8729e0afae81f85f1fdd1f8713f60cd.slice/crio-cf68e48a25649b7ae76a0681f99d934d22da85160a49c3a2056261763ecff20e WatchSource:0}: Error finding container cf68e48a25649b7ae76a0681f99d934d22da85160a49c3a2056261763ecff20e: Status 404 returned error can't find the container with id cf68e48a25649b7ae76a0681f99d934d22da85160a49c3a2056261763ecff20e
May 21 01:47:43.285067 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:43.285051    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf7d891e45dc4894e91d322e3d16f193.slice/crio-dd1a82060dfe863f40d6bc0a870f24b6310afe2fb4486f1b5907da3a1a6a469a WatchSource:0}: Error finding container dd1a82060dfe863f40d6bc0a870f24b6310afe2fb4486f1b5907da3a1a6a469a: Status 404 returned error can't find the container with id dd1a82060dfe863f40d6bc0a870f24b6310afe2fb4486f1b5907da3a1a6a469a
May 21 01:47:43.288429 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.288410    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 01:47:43.313494 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.313475    2552 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 21 01:47:43.320095 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320070    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c8lnl\" (UniqueName: \"kubernetes.io/projected/c246e67d-eb3e-4599-8d35-e25d77dc3d6b-kube-api-access-c8lnl\") pod \"node-resolver-2jn8b\" (UID: \"c246e67d-eb3e-4599-8d35-e25d77dc3d6b\") " pod="openshift-dns/node-resolver-2jn8b"
May 21 01:47:43.320193 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320100    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-etc-kubernetes\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.320193 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320128    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc5qp\" (UniqueName: \"kubernetes.io/projected/4da4318a-ab5c-41e6-b839-c03f4a319ec6-kube-api-access-vc5qp\") pod \"iptables-alerter-sswsj\" (UID: \"4da4318a-ab5c-41e6-b839-c03f4a319ec6\") " pod="openshift-network-operator/iptables-alerter-sswsj"
May 21 01:47:43.320193 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320155    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-host-slash\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.320193 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320180    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-run-ovn\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.320387 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320203    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee5c3804-f1e0-4ad7-b349-aa9227318c9c-konnectivity-ca\") pod \"konnectivity-agent-hq6nm\" (UID: \"ee5c3804-f1e0-4ad7-b349-aa9227318c9c\") " pod="kube-system/konnectivity-agent-hq6nm"
May 21 01:47:43.320387 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320201    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-etc-kubernetes\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.320387 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320232    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-etc-modprobe-d\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.320387 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320222    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal" event={"ID":"df7d891e45dc4894e91d322e3d16f193","Type":"ContainerStarted","Data":"dd1a82060dfe863f40d6bc0a870f24b6310afe2fb4486f1b5907da3a1a6a469a"}
May 21 01:47:43.320387 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320268    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4b8a809-3e02-4dd9-aba5-092aa39a344f-host\") pod \"node-ca-49shb\" (UID: \"a4b8a809-3e02-4dd9-aba5-092aa39a344f\") " pod="openshift-image-registry/node-ca-49shb"
May 21 01:47:43.320387 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320293    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-var-lib-openvswitch\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.320387 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320318    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-run-openvswitch\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.320387 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320320    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-etc-modprobe-d\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.320387 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320345    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bd8f0513-bcd1-4c4a-be8f-af5172e44140-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qt46g\" (UID: \"bd8f0513-bcd1-4c4a-be8f-af5172e44140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g"
May 21 01:47:43.320387 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320347    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4b8a809-3e02-4dd9-aba5-092aa39a344f-host\") pod \"node-ca-49shb\" (UID: \"a4b8a809-3e02-4dd9-aba5-092aa39a344f\") " pod="openshift-image-registry/node-ca-49shb"
May 21 01:47:43.320387 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320368    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-ovn-node-metrics-cert\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.320865 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320393    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-sys\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.320865 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320411    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3dd449c6-c30a-404a-8163-d12b70542e94-os-release\") pod \"multus-additional-cni-plugins-v9vqz\" (UID: \"3dd449c6-c30a-404a-8163-d12b70542e94\") " pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.320865 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320432    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-hostroot\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.320865 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320437    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-sys\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.320865 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320435    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bd8f0513-bcd1-4c4a-be8f-af5172e44140-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qt46g\" (UID: \"bd8f0513-bcd1-4c4a-be8f-af5172e44140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g"
May 21 01:47:43.320865 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320470    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bd8f0513-bcd1-4c4a-be8f-af5172e44140-etc-selinux\") pod \"aws-ebs-csi-driver-node-qt46g\" (UID: \"bd8f0513-bcd1-4c4a-be8f-af5172e44140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g"
May 21 01:47:43.320865 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320481    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-hostroot\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.320865 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320498    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-host-kubelet\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.320865 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320492    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3dd449c6-c30a-404a-8163-d12b70542e94-os-release\") pod \"multus-additional-cni-plugins-v9vqz\" (UID: \"3dd449c6-c30a-404a-8163-d12b70542e94\") " pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.320865 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320526    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-ovnkube-script-lib\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.320865 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320530    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bd8f0513-bcd1-4c4a-be8f-af5172e44140-etc-selinux\") pod \"aws-ebs-csi-driver-node-qt46g\" (UID: \"bd8f0513-bcd1-4c4a-be8f-af5172e44140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g"
May 21 01:47:43.320865 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320571    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z95q6\" (UniqueName: \"kubernetes.io/projected/553e91d1-f895-496b-9432-4c1ab85db2d9-kube-api-access-z95q6\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.320865 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320589    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s7v5r\" (UniqueName: \"kubernetes.io/projected/3dd449c6-c30a-404a-8163-d12b70542e94-kube-api-access-s7v5r\") pod \"multus-additional-cni-plugins-v9vqz\" (UID: \"3dd449c6-c30a-404a-8163-d12b70542e94\") " pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.320865 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320613    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-etc-sysconfig\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.320865 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320635    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-etc-sysctl-conf\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.320865 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320650    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-lib-modules\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.320865 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320671    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3dd449c6-c30a-404a-8163-d12b70542e94-system-cni-dir\") pod \"multus-additional-cni-plugins-v9vqz\" (UID: \"3dd449c6-c30a-404a-8163-d12b70542e94\") " pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.321642 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320715    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-etc-sysconfig\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.321642 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320719    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3dd449c6-c30a-404a-8163-d12b70542e94-cni-binary-copy\") pod \"multus-additional-cni-plugins-v9vqz\" (UID: \"3dd449c6-c30a-404a-8163-d12b70542e94\") " pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.321642 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320755    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-multus-cni-dir\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.321642 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320793    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3dd449c6-c30a-404a-8163-d12b70542e94-system-cni-dir\") pod \"multus-additional-cni-plugins-v9vqz\" (UID: \"3dd449c6-c30a-404a-8163-d12b70542e94\") " pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.321642 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320796    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-host-var-lib-cni-multus\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.321642 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320830    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-host\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.321642 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320854    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs\") pod \"network-metrics-daemon-hn6dl\" (UID: \"95930799-a903-46cc-b0ac-b157dfbd4bb8\") " pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:47:43.321642 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320879    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z8xb8\" (UniqueName: \"kubernetes.io/projected/a4b8a809-3e02-4dd9-aba5-092aa39a344f-kube-api-access-z8xb8\") pod \"node-ca-49shb\" (UID: \"a4b8a809-3e02-4dd9-aba5-092aa39a344f\") " pod="openshift-image-registry/node-ca-49shb"
May 21 01:47:43.321642 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320883    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-multus-cni-dir\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.321642 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320831    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-host-var-lib-cni-multus\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.321642 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320883    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-lib-modules\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.321642 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320897    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-host\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.321642 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320803    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-etc-sysctl-conf\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.321642 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320906    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4da4318a-ab5c-41e6-b839-c03f4a319ec6-iptables-alerter-script\") pod \"iptables-alerter-sswsj\" (UID: \"4da4318a-ab5c-41e6-b839-c03f4a319ec6\") " pod="openshift-network-operator/iptables-alerter-sswsj"
May 21 01:47:43.321642 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320950    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-ovnkube-config\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.321642 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:43.320974    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:47:43.321642 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320978    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-var-lib-kubelet\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.321642 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.320996    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3dd449c6-c30a-404a-8163-d12b70542e94-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v9vqz\" (UID: \"3dd449c6-c30a-404a-8163-d12b70542e94\") " pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.322189 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:43.321054    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs podName:95930799-a903-46cc-b0ac-b157dfbd4bb8 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:43.821000738 +0000 UTC m=+2.108247492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs") pod "network-metrics-daemon-hn6dl" (UID: "95930799-a903-46cc-b0ac-b157dfbd4bb8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:47:43.322189 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321083    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-var-lib-kubelet\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.322189 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321114    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3dd449c6-c30a-404a-8163-d12b70542e94-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v9vqz\" (UID: \"3dd449c6-c30a-404a-8163-d12b70542e94\") " pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.322189 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321140    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5c4f\" (UniqueName: \"kubernetes.io/projected/5eed9975-086b-4431-910d-aa0d9cf2dc74-kube-api-access-l5c4f\") pod \"network-check-target-6ld5n\" (UID: \"5eed9975-086b-4431-910d-aa0d9cf2dc74\") " pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:47:43.322189 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321169    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-cnibin\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.322189 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321197    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wk92\" (UniqueName: \"kubernetes.io/projected/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-kube-api-access-8wk92\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.322189 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321225    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee5c3804-f1e0-4ad7-b349-aa9227318c9c-agent-certs\") pod \"konnectivity-agent-hq6nm\" (UID: \"ee5c3804-f1e0-4ad7-b349-aa9227318c9c\") " pod="kube-system/konnectivity-agent-hq6nm"
May 21 01:47:43.322189 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321245    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-cnibin\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.322189 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321251    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3dd449c6-c30a-404a-8163-d12b70542e94-cnibin\") pod \"multus-additional-cni-plugins-v9vqz\" (UID: \"3dd449c6-c30a-404a-8163-d12b70542e94\") " pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.322189 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321285    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3dd449c6-c30a-404a-8163-d12b70542e94-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v9vqz\" (UID: \"3dd449c6-c30a-404a-8163-d12b70542e94\") " pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.322189 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321298    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3dd449c6-c30a-404a-8163-d12b70542e94-cni-binary-copy\") pod \"multus-additional-cni-plugins-v9vqz\" (UID: \"3dd449c6-c30a-404a-8163-d12b70542e94\") " pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.322189 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321309    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c246e67d-eb3e-4599-8d35-e25d77dc3d6b-tmp-dir\") pod \"node-resolver-2jn8b\" (UID: \"c246e67d-eb3e-4599-8d35-e25d77dc3d6b\") " pod="openshift-dns/node-resolver-2jn8b"
May 21 01:47:43.322189 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321310    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3dd449c6-c30a-404a-8163-d12b70542e94-cnibin\") pod \"multus-additional-cni-plugins-v9vqz\" (UID: \"3dd449c6-c30a-404a-8163-d12b70542e94\") " pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.322189 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321326    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/553e91d1-f895-496b-9432-4c1ab85db2d9-cni-binary-copy\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.322189 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321347    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-host-var-lib-kubelet\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.322189 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321407    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal" event={"ID":"e8729e0afae81f85f1fdd1f8713f60cd","Type":"ContainerStarted","Data":"cf68e48a25649b7ae76a0681f99d934d22da85160a49c3a2056261763ecff20e"}
May 21 01:47:43.322871 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321413    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4da4318a-ab5c-41e6-b839-c03f4a319ec6-host-slash\") pod \"iptables-alerter-sswsj\" (UID: \"4da4318a-ab5c-41e6-b839-c03f4a319ec6\") " pod="openshift-network-operator/iptables-alerter-sswsj"
May 21 01:47:43.322871 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321447    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-host-var-lib-kubelet\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.322871 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321455    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-etc-openvswitch\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.322871 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321480    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-env-overrides\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.322871 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321527    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-run\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.322871 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321576    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-host-run-k8s-cni-cncf-io\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.322871 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321599    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-log-socket\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.322871 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321615    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-etc-kubernetes\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.322871 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321614    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c246e67d-eb3e-4599-8d35-e25d77dc3d6b-tmp-dir\") pod \"node-resolver-2jn8b\" (UID: \"c246e67d-eb3e-4599-8d35-e25d77dc3d6b\") " pod="openshift-dns/node-resolver-2jn8b"
May 21 01:47:43.322871 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321617    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-run\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.322871 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321630    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mp465\" (UniqueName: \"kubernetes.io/projected/bd5cd680-f612-4207-a7d2-f595aa762713-kube-api-access-mp465\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.322871 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321647    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-os-release\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.322871 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321672    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-host-run-k8s-cni-cncf-io\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.322871 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321676    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-host-run-netns\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.322871 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321694    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-etc-kubernetes\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.322871 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321716    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bd8f0513-bcd1-4c4a-be8f-af5172e44140-device-dir\") pod \"aws-ebs-csi-driver-node-qt46g\" (UID: \"bd8f0513-bcd1-4c4a-be8f-af5172e44140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g"
May 21 01:47:43.322871 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321730    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-etc-systemd\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.322871 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321748    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4b8a809-3e02-4dd9-aba5-092aa39a344f-serviceca\") pod \"node-ca-49shb\" (UID: \"a4b8a809-3e02-4dd9-aba5-092aa39a344f\") " pod="openshift-image-registry/node-ca-49shb"
May 21 01:47:43.323703 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321762    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bd8f0513-bcd1-4c4a-be8f-af5172e44140-socket-dir\") pod \"aws-ebs-csi-driver-node-qt46g\" (UID: \"bd8f0513-bcd1-4c4a-be8f-af5172e44140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g"
May 21 01:47:43.323703 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321778    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ptq2q\" (UniqueName: \"kubernetes.io/projected/bd8f0513-bcd1-4c4a-be8f-af5172e44140-kube-api-access-ptq2q\") pod \"aws-ebs-csi-driver-node-qt46g\" (UID: \"bd8f0513-bcd1-4c4a-be8f-af5172e44140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g"
May 21 01:47:43.323703 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321795    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd5cd680-f612-4207-a7d2-f595aa762713-tmp\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.323703 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321802    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bd8f0513-bcd1-4c4a-be8f-af5172e44140-device-dir\") pod \"aws-ebs-csi-driver-node-qt46g\" (UID: \"bd8f0513-bcd1-4c4a-be8f-af5172e44140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g"
May 21 01:47:43.323703 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321811    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-system-cni-dir\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.323703 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321842    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bd8f0513-bcd1-4c4a-be8f-af5172e44140-sys-fs\") pod \"aws-ebs-csi-driver-node-qt46g\" (UID: \"bd8f0513-bcd1-4c4a-be8f-af5172e44140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g"
May 21 01:47:43.323703 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321857    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-run-systemd\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.323703 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321862    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3dd449c6-c30a-404a-8163-d12b70542e94-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v9vqz\" (UID: \"3dd449c6-c30a-404a-8163-d12b70542e94\") " pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.323703 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321871    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-os-release\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.323703 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321873    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-node-log\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.323703 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321911    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-multus-socket-dir-parent\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.323703 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321916    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-host-run-netns\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.323703 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321918    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/553e91d1-f895-496b-9432-4c1ab85db2d9-cni-binary-copy\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.323703 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321926    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c246e67d-eb3e-4599-8d35-e25d77dc3d6b-hosts-file\") pod \"node-resolver-2jn8b\" (UID: \"c246e67d-eb3e-4599-8d35-e25d77dc3d6b\") " pod="openshift-dns/node-resolver-2jn8b"
May 21 01:47:43.323703 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321950    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd5cd680-f612-4207-a7d2-f595aa762713-etc-tuned\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.323703 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.321976    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-system-cni-dir\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.323703 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.322033    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bd8f0513-bcd1-4c4a-be8f-af5172e44140-sys-fs\") pod \"aws-ebs-csi-driver-node-qt46g\" (UID: \"bd8f0513-bcd1-4c4a-be8f-af5172e44140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g"
May 21 01:47:43.323703 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.322073    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-etc-systemd\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.324472 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.322160    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bd8f0513-bcd1-4c4a-be8f-af5172e44140-socket-dir\") pod \"aws-ebs-csi-driver-node-qt46g\" (UID: \"bd8f0513-bcd1-4c4a-be8f-af5172e44140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g"
May 21 01:47:43.324472 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.322160    2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 21 01:47:43.324472 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.322286    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4b8a809-3e02-4dd9-aba5-092aa39a344f-serviceca\") pod \"node-ca-49shb\" (UID: \"a4b8a809-3e02-4dd9-aba5-092aa39a344f\") " pod="openshift-image-registry/node-ca-49shb"
May 21 01:47:43.324472 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.322564    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3dd449c6-c30a-404a-8163-d12b70542e94-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v9vqz\" (UID: \"3dd449c6-c30a-404a-8163-d12b70542e94\") " pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.324472 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.322609    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7czzp\" (UniqueName: \"kubernetes.io/projected/95930799-a903-46cc-b0ac-b157dfbd4bb8-kube-api-access-7czzp\") pod \"network-metrics-daemon-hn6dl\" (UID: \"95930799-a903-46cc-b0ac-b157dfbd4bb8\") " pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:47:43.324472 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.322477    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-multus-socket-dir-parent\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.324472 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.322649    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-systemd-units\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.324472 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.322878    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c246e67d-eb3e-4599-8d35-e25d77dc3d6b-hosts-file\") pod \"node-resolver-2jn8b\" (UID: \"c246e67d-eb3e-4599-8d35-e25d77dc3d6b\") " pod="openshift-dns/node-resolver-2jn8b"
May 21 01:47:43.324472 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.323570    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3dd449c6-c30a-404a-8163-d12b70542e94-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v9vqz\" (UID: \"3dd449c6-c30a-404a-8163-d12b70542e94\") " pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.324472 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.323665    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-host-run-netns\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.324472 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.323717    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-multus-conf-dir\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.324472 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.323749    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/553e91d1-f895-496b-9432-4c1ab85db2d9-multus-daemon-config\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.324472 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.323784    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-etc-sysctl-d\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.324472 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.323814    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-host-run-ovn-kubernetes\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.324472 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.323842    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.324472 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.323874    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-host-var-lib-cni-bin\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.324472 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.323902    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-host-cni-bin\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.325210 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.323932    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-host-run-multus-certs\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.325210 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.323962    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bd8f0513-bcd1-4c4a-be8f-af5172e44140-registration-dir\") pod \"aws-ebs-csi-driver-node-qt46g\" (UID: \"bd8f0513-bcd1-4c4a-be8f-af5172e44140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g"
May 21 01:47:43.325210 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.323985    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-host-cni-netd\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.325210 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.324098    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-multus-conf-dir\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.325210 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.324539    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/553e91d1-f895-496b-9432-4c1ab85db2d9-multus-daemon-config\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.325210 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.324678    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd5cd680-f612-4207-a7d2-f595aa762713-etc-sysctl-d\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.325210 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.324750    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-host-run-multus-certs\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.325210 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.324774    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/553e91d1-f895-496b-9432-4c1ab85db2d9-host-var-lib-cni-bin\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.325210 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.324803    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bd8f0513-bcd1-4c4a-be8f-af5172e44140-registration-dir\") pod \"aws-ebs-csi-driver-node-qt46g\" (UID: \"bd8f0513-bcd1-4c4a-be8f-af5172e44140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g"
May 21 01:47:43.325704 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.325682    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd5cd680-f612-4207-a7d2-f595aa762713-etc-tuned\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.325761 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.325738    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd5cd680-f612-4207-a7d2-f595aa762713-tmp\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.328065 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:43.328045    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 01:47:43.328159 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:43.328069    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 01:47:43.328159 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:43.328083    2552 projected.go:194] Error preparing data for projected volume kube-api-access-l5c4f for pod openshift-network-diagnostics/network-check-target-6ld5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:47:43.328159 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:43.328141    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5eed9975-086b-4431-910d-aa0d9cf2dc74-kube-api-access-l5c4f podName:5eed9975-086b-4431-910d-aa0d9cf2dc74 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:43.828123981 +0000 UTC m=+2.115370762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l5c4f" (UniqueName: "kubernetes.io/projected/5eed9975-086b-4431-910d-aa0d9cf2dc74-kube-api-access-l5c4f") pod "network-check-target-6ld5n" (UID: "5eed9975-086b-4431-910d-aa0d9cf2dc74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:47:43.328481 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.328462    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7v5r\" (UniqueName: \"kubernetes.io/projected/3dd449c6-c30a-404a-8163-d12b70542e94-kube-api-access-s7v5r\") pod \"multus-additional-cni-plugins-v9vqz\" (UID: \"3dd449c6-c30a-404a-8163-d12b70542e94\") " pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.328828 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.328808    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8lnl\" (UniqueName: \"kubernetes.io/projected/c246e67d-eb3e-4599-8d35-e25d77dc3d6b-kube-api-access-c8lnl\") pod \"node-resolver-2jn8b\" (UID: \"c246e67d-eb3e-4599-8d35-e25d77dc3d6b\") " pod="openshift-dns/node-resolver-2jn8b"
May 21 01:47:43.330120 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.330097    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8xb8\" (UniqueName: \"kubernetes.io/projected/a4b8a809-3e02-4dd9-aba5-092aa39a344f-kube-api-access-z8xb8\") pod \"node-ca-49shb\" (UID: \"a4b8a809-3e02-4dd9-aba5-092aa39a344f\") " pod="openshift-image-registry/node-ca-49shb"
May 21 01:47:43.330293 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.330275    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z95q6\" (UniqueName: \"kubernetes.io/projected/553e91d1-f895-496b-9432-4c1ab85db2d9-kube-api-access-z95q6\") pod \"multus-jt6xm\" (UID: \"553e91d1-f895-496b-9432-4c1ab85db2d9\") " pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.331711 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.331688    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp465\" (UniqueName: \"kubernetes.io/projected/bd5cd680-f612-4207-a7d2-f595aa762713-kube-api-access-mp465\") pod \"tuned-xk25b\" (UID: \"bd5cd680-f612-4207-a7d2-f595aa762713\") " pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.332242 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.332222    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptq2q\" (UniqueName: \"kubernetes.io/projected/bd8f0513-bcd1-4c4a-be8f-af5172e44140-kube-api-access-ptq2q\") pod \"aws-ebs-csi-driver-node-qt46g\" (UID: \"bd8f0513-bcd1-4c4a-be8f-af5172e44140\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g"
May 21 01:47:43.332572 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.332537    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7czzp\" (UniqueName: \"kubernetes.io/projected/95930799-a903-46cc-b0ac-b157dfbd4bb8-kube-api-access-7czzp\") pod \"network-metrics-daemon-hn6dl\" (UID: \"95930799-a903-46cc-b0ac-b157dfbd4bb8\") " pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:47:43.424631 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424580    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-run-systemd\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.424631 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424609    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-node-log\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.424776 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424635    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-systemd-units\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.424776 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424657    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-host-run-netns\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.424776 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424675    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-run-systemd\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.424776 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424682    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-host-run-ovn-kubernetes\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.424776 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424689    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-node-log\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.424776 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424710    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.424776 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424723    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-host-run-ovn-kubernetes\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.424776 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424731    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-host-cni-bin\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.424776 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424733    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-host-run-netns\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.424776 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424709    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-systemd-units\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.424776 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424741    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.424776 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424754    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-host-cni-netd\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.424776 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424777    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vc5qp\" (UniqueName: \"kubernetes.io/projected/4da4318a-ab5c-41e6-b839-c03f4a319ec6-kube-api-access-vc5qp\") pod \"iptables-alerter-sswsj\" (UID: \"4da4318a-ab5c-41e6-b839-c03f4a319ec6\") " pod="openshift-network-operator/iptables-alerter-sswsj"
May 21 01:47:43.425367 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424798    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-host-slash\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.425367 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424779    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-host-cni-bin\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.425367 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424819    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-run-ovn\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.425367 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424834    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-host-slash\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.425367 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424842    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee5c3804-f1e0-4ad7-b349-aa9227318c9c-konnectivity-ca\") pod \"konnectivity-agent-hq6nm\" (UID: \"ee5c3804-f1e0-4ad7-b349-aa9227318c9c\") " pod="kube-system/konnectivity-agent-hq6nm"
May 21 01:47:43.425367 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424839    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-host-cni-netd\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.425367 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424878    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-run-ovn\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.425367 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424879    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-var-lib-openvswitch\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.425367 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424916    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-run-openvswitch\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.425367 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424944    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-ovn-node-metrics-cert\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.425367 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424972    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-host-kubelet\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.425367 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424997    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-ovnkube-script-lib\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.425367 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.425034    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-host-kubelet\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.425367 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.425043    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4da4318a-ab5c-41e6-b839-c03f4a319ec6-iptables-alerter-script\") pod \"iptables-alerter-sswsj\" (UID: \"4da4318a-ab5c-41e6-b839-c03f4a319ec6\") " pod="openshift-network-operator/iptables-alerter-sswsj"
May 21 01:47:43.425367 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.425078    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-ovnkube-config\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.425367 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424946    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-run-openvswitch\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.425367 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.425121    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8wk92\" (UniqueName: \"kubernetes.io/projected/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-kube-api-access-8wk92\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.425962 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.424917    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-var-lib-openvswitch\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.425962 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.425171    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee5c3804-f1e0-4ad7-b349-aa9227318c9c-agent-certs\") pod \"konnectivity-agent-hq6nm\" (UID: \"ee5c3804-f1e0-4ad7-b349-aa9227318c9c\") " pod="kube-system/konnectivity-agent-hq6nm"
May 21 01:47:43.425962 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.425200    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4da4318a-ab5c-41e6-b839-c03f4a319ec6-host-slash\") pod \"iptables-alerter-sswsj\" (UID: \"4da4318a-ab5c-41e6-b839-c03f4a319ec6\") " pod="openshift-network-operator/iptables-alerter-sswsj"
May 21 01:47:43.425962 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.425224    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-etc-openvswitch\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.425962 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.425248    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-env-overrides\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.425962 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.425275    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-log-socket\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.425962 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.425296    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4da4318a-ab5c-41e6-b839-c03f4a319ec6-host-slash\") pod \"iptables-alerter-sswsj\" (UID: \"4da4318a-ab5c-41e6-b839-c03f4a319ec6\") " pod="openshift-network-operator/iptables-alerter-sswsj"
May 21 01:47:43.425962 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.425341    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-log-socket\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.425962 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.425376    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee5c3804-f1e0-4ad7-b349-aa9227318c9c-konnectivity-ca\") pod \"konnectivity-agent-hq6nm\" (UID: \"ee5c3804-f1e0-4ad7-b349-aa9227318c9c\") " pod="kube-system/konnectivity-agent-hq6nm"
May 21 01:47:43.425962 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.425387    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-etc-openvswitch\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.425962 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.425611    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4da4318a-ab5c-41e6-b839-c03f4a319ec6-iptables-alerter-script\") pod \"iptables-alerter-sswsj\" (UID: \"4da4318a-ab5c-41e6-b839-c03f4a319ec6\") " pod="openshift-network-operator/iptables-alerter-sswsj"
May 21 01:47:43.425962 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.425706    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-ovnkube-config\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.425962 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.425734    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-env-overrides\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.426323 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.426187    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-ovnkube-script-lib\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.426988 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.426972    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-ovn-node-metrics-cert\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.427159 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.427144    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee5c3804-f1e0-4ad7-b349-aa9227318c9c-agent-certs\") pod \"konnectivity-agent-hq6nm\" (UID: \"ee5c3804-f1e0-4ad7-b349-aa9227318c9c\") " pod="kube-system/konnectivity-agent-hq6nm"
May 21 01:47:43.432386 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.432359    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc5qp\" (UniqueName: \"kubernetes.io/projected/4da4318a-ab5c-41e6-b839-c03f4a319ec6-kube-api-access-vc5qp\") pod \"iptables-alerter-sswsj\" (UID: \"4da4318a-ab5c-41e6-b839-c03f4a319ec6\") " pod="openshift-network-operator/iptables-alerter-sswsj"
May 21 01:47:43.432386 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.432374    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wk92\" (UniqueName: \"kubernetes.io/projected/0d57ff45-b79d-46a9-9f26-b8b9a064ab4a-kube-api-access-8wk92\") pod \"ovnkube-node-z8sf4\" (UID: \"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.526187 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.526166    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g"
May 21 01:47:43.532677 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:43.532653    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd8f0513_bcd1_4c4a_be8f_af5172e44140.slice/crio-24b1e59e12a4d430ede55370a22955c89eb6af4c78e04ba04913564179a98bbf WatchSource:0}: Error finding container 24b1e59e12a4d430ede55370a22955c89eb6af4c78e04ba04913564179a98bbf: Status 404 returned error can't find the container with id 24b1e59e12a4d430ede55370a22955c89eb6af4c78e04ba04913564179a98bbf
May 21 01:47:43.542150 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.542135    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xk25b"
May 21 01:47:43.548099 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:43.548077    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd5cd680_f612_4207_a7d2_f595aa762713.slice/crio-c7feb170c4574788c6e2cec41b7df08c4c74b22b18f6c0a288cc1ba39ea74f68 WatchSource:0}: Error finding container c7feb170c4574788c6e2cec41b7df08c4c74b22b18f6c0a288cc1ba39ea74f68: Status 404 returned error can't find the container with id c7feb170c4574788c6e2cec41b7df08c4c74b22b18f6c0a288cc1ba39ea74f68
May 21 01:47:43.562856 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.562836    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v9vqz"
May 21 01:47:43.567806 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:43.567787    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dd449c6_c30a_404a_8163_d12b70542e94.slice/crio-1d1e89ddd30f5571991cc31572886fdbf17cbfc022293707a789dd67976a67b9 WatchSource:0}: Error finding container 1d1e89ddd30f5571991cc31572886fdbf17cbfc022293707a789dd67976a67b9: Status 404 returned error can't find the container with id 1d1e89ddd30f5571991cc31572886fdbf17cbfc022293707a789dd67976a67b9
May 21 01:47:43.582615 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.582601    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2jn8b"
May 21 01:47:43.588711 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:43.588693    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc246e67d_eb3e_4599_8d35_e25d77dc3d6b.slice/crio-8cb6cde0765745268d55710e6d909452a83a2ace1be53cab33df671449abdced WatchSource:0}: Error finding container 8cb6cde0765745268d55710e6d909452a83a2ace1be53cab33df671449abdced: Status 404 returned error can't find the container with id 8cb6cde0765745268d55710e6d909452a83a2ace1be53cab33df671449abdced
May 21 01:47:43.595067 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.595050    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-49shb"
May 21 01:47:43.599505 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.599488    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jt6xm"
May 21 01:47:43.600105 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:43.600087    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4b8a809_3e02_4dd9_aba5_092aa39a344f.slice/crio-1cd5c1dcf0a6f7ce882c52a6540c705a8242f55a9b54598aaf203d48eae6e169 WatchSource:0}: Error finding container 1cd5c1dcf0a6f7ce882c52a6540c705a8242f55a9b54598aaf203d48eae6e169: Status 404 returned error can't find the container with id 1cd5c1dcf0a6f7ce882c52a6540c705a8242f55a9b54598aaf203d48eae6e169
May 21 01:47:43.605124 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:43.605101    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod553e91d1_f895_496b_9432_4c1ab85db2d9.slice/crio-81c1f8b39b993302392e91c820fc968cb0bf90c1a83a9d7d0fa7cb6b91d081dd WatchSource:0}: Error finding container 81c1f8b39b993302392e91c820fc968cb0bf90c1a83a9d7d0fa7cb6b91d081dd: Status 404 returned error can't find the container with id 81c1f8b39b993302392e91c820fc968cb0bf90c1a83a9d7d0fa7cb6b91d081dd
May 21 01:47:43.605945 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.605923    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sswsj"
May 21 01:47:43.612054 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.612034    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:47:43.612868 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:43.612846    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4da4318a_ab5c_41e6_b839_c03f4a319ec6.slice/crio-50a603c34ba26ffd76780d05ae26bdbdde6c7a17dcd54704e1e6b1997646d6e2 WatchSource:0}: Error finding container 50a603c34ba26ffd76780d05ae26bdbdde6c7a17dcd54704e1e6b1997646d6e2: Status 404 returned error can't find the container with id 50a603c34ba26ffd76780d05ae26bdbdde6c7a17dcd54704e1e6b1997646d6e2
May 21 01:47:43.615600 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.615582    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hq6nm"
May 21 01:47:43.621180 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:43.621159    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d57ff45_b79d_46a9_9f26_b8b9a064ab4a.slice/crio-8074b4c449f8f34565508e8c1262ae47fd5655cf9b289ed0902e146ff9532a12 WatchSource:0}: Error finding container 8074b4c449f8f34565508e8c1262ae47fd5655cf9b289ed0902e146ff9532a12: Status 404 returned error can't find the container with id 8074b4c449f8f34565508e8c1262ae47fd5655cf9b289ed0902e146ff9532a12
May 21 01:47:43.625958 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:47:43.625933    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee5c3804_f1e0_4ad7_b349_aa9227318c9c.slice/crio-77611993a61e59f9a7af57f170a8cc9a32d1554085460984c75f1a587a9172f4 WatchSource:0}: Error finding container 77611993a61e59f9a7af57f170a8cc9a32d1554085460984c75f1a587a9172f4: Status 404 returned error can't find the container with id 77611993a61e59f9a7af57f170a8cc9a32d1554085460984c75f1a587a9172f4
May 21 01:47:43.827713 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.827640    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs\") pod \"network-metrics-daemon-hn6dl\" (UID: \"95930799-a903-46cc-b0ac-b157dfbd4bb8\") " pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:47:43.827869 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:43.827763    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:47:43.827869 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:43.827827    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs podName:95930799-a903-46cc-b0ac-b157dfbd4bb8 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:44.827810711 +0000 UTC m=+3.115057465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs") pod "network-metrics-daemon-hn6dl" (UID: "95930799-a903-46cc-b0ac-b157dfbd4bb8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:47:43.928356 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.928328    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5c4f\" (UniqueName: \"kubernetes.io/projected/5eed9975-086b-4431-910d-aa0d9cf2dc74-kube-api-access-l5c4f\") pod \"network-check-target-6ld5n\" (UID: \"5eed9975-086b-4431-910d-aa0d9cf2dc74\") " pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:47:43.928503 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:43.928476    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 01:47:43.928503 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:43.928495    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 01:47:43.928654 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:43.928508    2552 projected.go:194] Error preparing data for projected volume kube-api-access-l5c4f for pod openshift-network-diagnostics/network-check-target-6ld5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:47:43.928654 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:43.928579    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5eed9975-086b-4431-910d-aa0d9cf2dc74-kube-api-access-l5c4f podName:5eed9975-086b-4431-910d-aa0d9cf2dc74 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:44.928559008 +0000 UTC m=+3.215805776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l5c4f" (UniqueName: "kubernetes.io/projected/5eed9975-086b-4431-910d-aa0d9cf2dc74-kube-api-access-l5c4f") pod "network-check-target-6ld5n" (UID: "5eed9975-086b-4431-910d-aa0d9cf2dc74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:47:43.983849 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:43.983820    2552 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 01:47:44.179500 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:44.179424    2552 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 01:47:44.255025 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:44.254985    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 01:42:43 +0000 UTC" deadline="2028-01-13 22:47:13.026606479 +0000 UTC"
May 21 01:47:44.255025 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:44.255022    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14468h59m28.771587839s"
May 21 01:47:44.339706 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:44.339668    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4" event={"ID":"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a","Type":"ContainerStarted","Data":"8074b4c449f8f34565508e8c1262ae47fd5655cf9b289ed0902e146ff9532a12"}
May 21 01:47:44.342888 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:44.342847    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2jn8b" event={"ID":"c246e67d-eb3e-4599-8d35-e25d77dc3d6b","Type":"ContainerStarted","Data":"8cb6cde0765745268d55710e6d909452a83a2ace1be53cab33df671449abdced"}
May 21 01:47:44.346842 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:44.346787    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v9vqz" event={"ID":"3dd449c6-c30a-404a-8163-d12b70542e94","Type":"ContainerStarted","Data":"1d1e89ddd30f5571991cc31572886fdbf17cbfc022293707a789dd67976a67b9"}
May 21 01:47:44.357379 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:44.357336    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xk25b" event={"ID":"bd5cd680-f612-4207-a7d2-f595aa762713","Type":"ContainerStarted","Data":"c7feb170c4574788c6e2cec41b7df08c4c74b22b18f6c0a288cc1ba39ea74f68"}
May 21 01:47:44.368624 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:44.368488    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hq6nm" event={"ID":"ee5c3804-f1e0-4ad7-b349-aa9227318c9c","Type":"ContainerStarted","Data":"77611993a61e59f9a7af57f170a8cc9a32d1554085460984c75f1a587a9172f4"}
May 21 01:47:44.381318 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:44.381257    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sswsj" event={"ID":"4da4318a-ab5c-41e6-b839-c03f4a319ec6","Type":"ContainerStarted","Data":"50a603c34ba26ffd76780d05ae26bdbdde6c7a17dcd54704e1e6b1997646d6e2"}
May 21 01:47:44.389991 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:44.389965    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jt6xm" event={"ID":"553e91d1-f895-496b-9432-4c1ab85db2d9","Type":"ContainerStarted","Data":"81c1f8b39b993302392e91c820fc968cb0bf90c1a83a9d7d0fa7cb6b91d081dd"}
May 21 01:47:44.402025 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:44.402000    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-49shb" event={"ID":"a4b8a809-3e02-4dd9-aba5-092aa39a344f","Type":"ContainerStarted","Data":"1cd5c1dcf0a6f7ce882c52a6540c705a8242f55a9b54598aaf203d48eae6e169"}
May 21 01:47:44.418110 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:44.418084    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g" event={"ID":"bd8f0513-bcd1-4c4a-be8f-af5172e44140","Type":"ContainerStarted","Data":"24b1e59e12a4d430ede55370a22955c89eb6af4c78e04ba04913564179a98bbf"}
May 21 01:47:44.461846 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:44.461306    2552 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 01:47:44.837830 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:44.837198    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs\") pod \"network-metrics-daemon-hn6dl\" (UID: \"95930799-a903-46cc-b0ac-b157dfbd4bb8\") " pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:47:44.837830 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:44.837356    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:47:44.837830 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:44.837418    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs podName:95930799-a903-46cc-b0ac-b157dfbd4bb8 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:46.837400376 +0000 UTC m=+5.124647136 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs") pod "network-metrics-daemon-hn6dl" (UID: "95930799-a903-46cc-b0ac-b157dfbd4bb8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:47:44.937885 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:44.937839    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5c4f\" (UniqueName: \"kubernetes.io/projected/5eed9975-086b-4431-910d-aa0d9cf2dc74-kube-api-access-l5c4f\") pod \"network-check-target-6ld5n\" (UID: \"5eed9975-086b-4431-910d-aa0d9cf2dc74\") " pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:47:44.938069 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:44.938051    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 01:47:44.938139 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:44.938075    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 01:47:44.938139 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:44.938089    2552 projected.go:194] Error preparing data for projected volume kube-api-access-l5c4f for pod openshift-network-diagnostics/network-check-target-6ld5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:47:44.938236 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:44.938152    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5eed9975-086b-4431-910d-aa0d9cf2dc74-kube-api-access-l5c4f podName:5eed9975-086b-4431-910d-aa0d9cf2dc74 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:46.938135488 +0000 UTC m=+5.225382257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l5c4f" (UniqueName: "kubernetes.io/projected/5eed9975-086b-4431-910d-aa0d9cf2dc74-kube-api-access-l5c4f") pod "network-check-target-6ld5n" (UID: "5eed9975-086b-4431-910d-aa0d9cf2dc74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:47:45.256219 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:45.256110    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 01:42:43 +0000 UTC" deadline="2027-12-28 20:40:58.516642655 +0000 UTC"
May 21 01:47:45.256219 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:45.256145    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14082h53m13.260501699s"
May 21 01:47:45.317388 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:45.317353    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:47:45.317595 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:45.317514    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ld5n" podUID="5eed9975-086b-4431-910d-aa0d9cf2dc74"
May 21 01:47:45.317678 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:45.317669    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:47:45.317819 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:45.317779    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn6dl" podUID="95930799-a903-46cc-b0ac-b157dfbd4bb8"
May 21 01:47:46.855166 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:46.855119    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs\") pod \"network-metrics-daemon-hn6dl\" (UID: \"95930799-a903-46cc-b0ac-b157dfbd4bb8\") " pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:47:46.855708 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:46.855259    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:47:46.855708 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:46.855337    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs podName:95930799-a903-46cc-b0ac-b157dfbd4bb8 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:50.855316405 +0000 UTC m=+9.142563166 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs") pod "network-metrics-daemon-hn6dl" (UID: "95930799-a903-46cc-b0ac-b157dfbd4bb8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:47:46.956680 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:46.956053    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5c4f\" (UniqueName: \"kubernetes.io/projected/5eed9975-086b-4431-910d-aa0d9cf2dc74-kube-api-access-l5c4f\") pod \"network-check-target-6ld5n\" (UID: \"5eed9975-086b-4431-910d-aa0d9cf2dc74\") " pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:47:46.956680 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:46.956236    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 01:47:46.956680 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:46.956253    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 01:47:46.956680 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:46.956265    2552 projected.go:194] Error preparing data for projected volume kube-api-access-l5c4f for pod openshift-network-diagnostics/network-check-target-6ld5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:47:46.956680 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:46.956327    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5eed9975-086b-4431-910d-aa0d9cf2dc74-kube-api-access-l5c4f podName:5eed9975-086b-4431-910d-aa0d9cf2dc74 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:50.956305678 +0000 UTC m=+9.243552448 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l5c4f" (UniqueName: "kubernetes.io/projected/5eed9975-086b-4431-910d-aa0d9cf2dc74-kube-api-access-l5c4f") pod "network-check-target-6ld5n" (UID: "5eed9975-086b-4431-910d-aa0d9cf2dc74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:47:47.317781 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:47.317696    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:47:47.317934 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:47.317846    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn6dl" podUID="95930799-a903-46cc-b0ac-b157dfbd4bb8"
May 21 01:47:47.317934 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:47.317896    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:47:47.318049 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:47.318004    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ld5n" podUID="5eed9975-086b-4431-910d-aa0d9cf2dc74"
May 21 01:47:49.317103 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:49.317069    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:47:49.317608 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:49.317069    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:47:49.317608 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:49.317188    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ld5n" podUID="5eed9975-086b-4431-910d-aa0d9cf2dc74"
May 21 01:47:49.317608 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:49.317251    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn6dl" podUID="95930799-a903-46cc-b0ac-b157dfbd4bb8"
May 21 01:47:50.886649 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:50.885999    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs\") pod \"network-metrics-daemon-hn6dl\" (UID: \"95930799-a903-46cc-b0ac-b157dfbd4bb8\") " pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:47:50.886649 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:50.886186    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:47:50.886649 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:50.886245    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs podName:95930799-a903-46cc-b0ac-b157dfbd4bb8 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:58.886226964 +0000 UTC m=+17.173473727 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs") pod "network-metrics-daemon-hn6dl" (UID: "95930799-a903-46cc-b0ac-b157dfbd4bb8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:47:50.986540 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:50.986498    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5c4f\" (UniqueName: \"kubernetes.io/projected/5eed9975-086b-4431-910d-aa0d9cf2dc74-kube-api-access-l5c4f\") pod \"network-check-target-6ld5n\" (UID: \"5eed9975-086b-4431-910d-aa0d9cf2dc74\") " pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:47:50.986736 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:50.986696    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 01:47:50.986736 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:50.986714    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 01:47:50.986736 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:50.986727    2552 projected.go:194] Error preparing data for projected volume kube-api-access-l5c4f for pod openshift-network-diagnostics/network-check-target-6ld5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:47:50.986907 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:50.986782    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5eed9975-086b-4431-910d-aa0d9cf2dc74-kube-api-access-l5c4f podName:5eed9975-086b-4431-910d-aa0d9cf2dc74 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:58.986763577 +0000 UTC m=+17.274010335 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l5c4f" (UniqueName: "kubernetes.io/projected/5eed9975-086b-4431-910d-aa0d9cf2dc74-kube-api-access-l5c4f") pod "network-check-target-6ld5n" (UID: "5eed9975-086b-4431-910d-aa0d9cf2dc74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:47:51.318370 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:51.318117    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:47:51.318370 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:51.318240    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ld5n" podUID="5eed9975-086b-4431-910d-aa0d9cf2dc74"
May 21 01:47:51.318370 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:51.318346    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:47:51.318820 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:51.318490    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn6dl" podUID="95930799-a903-46cc-b0ac-b157dfbd4bb8"
May 21 01:47:53.317646 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:53.317605    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:47:53.318119 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:53.317721    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ld5n" podUID="5eed9975-086b-4431-910d-aa0d9cf2dc74"
May 21 01:47:53.318119 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:53.317612    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:47:53.318119 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:53.318105    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn6dl" podUID="95930799-a903-46cc-b0ac-b157dfbd4bb8"
May 21 01:47:55.316989 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:55.316942    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:47:55.317426 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:55.316941    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:47:55.317426 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:55.317083    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn6dl" podUID="95930799-a903-46cc-b0ac-b157dfbd4bb8"
May 21 01:47:55.317426 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:55.317171    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ld5n" podUID="5eed9975-086b-4431-910d-aa0d9cf2dc74"
May 21 01:47:57.317261 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:57.317224    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:47:57.317661 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:57.317224    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:47:57.317661 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:57.317332    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn6dl" podUID="95930799-a903-46cc-b0ac-b157dfbd4bb8"
May 21 01:47:57.317661 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:57.317399    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ld5n" podUID="5eed9975-086b-4431-910d-aa0d9cf2dc74"
May 21 01:47:58.949276 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:58.949240    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs\") pod \"network-metrics-daemon-hn6dl\" (UID: \"95930799-a903-46cc-b0ac-b157dfbd4bb8\") " pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:47:58.949762 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:58.949396    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:47:58.949762 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:58.949471    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs podName:95930799-a903-46cc-b0ac-b157dfbd4bb8 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:14.949449749 +0000 UTC m=+33.236696513 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs") pod "network-metrics-daemon-hn6dl" (UID: "95930799-a903-46cc-b0ac-b157dfbd4bb8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:47:59.050277 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:59.050245    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5c4f\" (UniqueName: \"kubernetes.io/projected/5eed9975-086b-4431-910d-aa0d9cf2dc74-kube-api-access-l5c4f\") pod \"network-check-target-6ld5n\" (UID: \"5eed9975-086b-4431-910d-aa0d9cf2dc74\") " pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:47:59.050416 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:59.050391    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 01:47:59.050416 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:59.050409    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 01:47:59.050416 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:59.050418    2552 projected.go:194] Error preparing data for projected volume kube-api-access-l5c4f for pod openshift-network-diagnostics/network-check-target-6ld5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:47:59.050566 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:59.050471    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5eed9975-086b-4431-910d-aa0d9cf2dc74-kube-api-access-l5c4f podName:5eed9975-086b-4431-910d-aa0d9cf2dc74 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:15.05045446 +0000 UTC m=+33.337701219 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l5c4f" (UniqueName: "kubernetes.io/projected/5eed9975-086b-4431-910d-aa0d9cf2dc74-kube-api-access-l5c4f") pod "network-check-target-6ld5n" (UID: "5eed9975-086b-4431-910d-aa0d9cf2dc74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:47:59.316971 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:59.316941    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:47:59.317130 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:47:59.316941    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:47:59.317130 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:59.317067    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn6dl" podUID="95930799-a903-46cc-b0ac-b157dfbd4bb8"
May 21 01:47:59.317130 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:47:59.317121    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ld5n" podUID="5eed9975-086b-4431-910d-aa0d9cf2dc74"
May 21 01:48:01.317240 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:01.317211    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:48:01.317661 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:01.317215    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:48:01.317661 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:01.317313    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ld5n" podUID="5eed9975-086b-4431-910d-aa0d9cf2dc74"
May 21 01:48:01.317661 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:01.317395    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn6dl" podUID="95930799-a903-46cc-b0ac-b157dfbd4bb8"
May 21 01:48:03.317273 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:03.317135    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:48:03.317866 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:03.317351    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ld5n" podUID="5eed9975-086b-4431-910d-aa0d9cf2dc74"
May 21 01:48:03.317866 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:03.317139    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:48:03.317866 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:03.317420    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn6dl" podUID="95930799-a903-46cc-b0ac-b157dfbd4bb8"
May 21 01:48:03.459414 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:03.459389    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal" event={"ID":"e8729e0afae81f85f1fdd1f8713f60cd","Type":"ContainerStarted","Data":"7df9b9e83195059c2ab40570e6afaa533f718f0acc8824b95a6dab321d362954"}
May 21 01:48:03.460719 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:03.460696    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hq6nm" event={"ID":"ee5c3804-f1e0-4ad7-b349-aa9227318c9c","Type":"ContainerStarted","Data":"bafe7ad26e4f9341f94e9dc54836c51dfff6ea82fb310bf1c462012a4dc7b7c5"}
May 21 01:48:03.462084 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:03.462056    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jt6xm" event={"ID":"553e91d1-f895-496b-9432-4c1ab85db2d9","Type":"ContainerStarted","Data":"0e7ab58c4e046953a2e8048486cd979579a7de855e548a6b5fb472fad79340d3"}
May 21 01:48:03.466729 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:03.466696    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-49shb" event={"ID":"a4b8a809-3e02-4dd9-aba5-092aa39a344f","Type":"ContainerStarted","Data":"aa66b4700c7112a85ff207c0599c89b66eba85e4a9a63853c3f1735a9cc7e342"}
May 21 01:48:03.468288 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:03.468264    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g" event={"ID":"bd8f0513-bcd1-4c4a-be8f-af5172e44140","Type":"ContainerStarted","Data":"0a9b4c79649348d27aafd895dcd7d770105e5d109440cea37750f3d9c51ca863"}
May 21 01:48:03.471471 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:03.471447    2552 generic.go:358] "Generic (PLEG): container finished" podID="df7d891e45dc4894e91d322e3d16f193" containerID="8b7f09b4b94ad4371f4e04990e230811e8b5aed6a816ad367e870a9d8b3efa4e" exitCode=0
May 21 01:48:03.471572 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:03.471514    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal" event={"ID":"df7d891e45dc4894e91d322e3d16f193","Type":"ContainerDied","Data":"8b7f09b4b94ad4371f4e04990e230811e8b5aed6a816ad367e870a9d8b3efa4e"}
May 21 01:48:03.473246 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:03.473201    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal" podStartSLOduration=21.473190309 podStartE2EDuration="21.473190309s" podCreationTimestamp="2026-05-21 01:47:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 01:48:03.472966982 +0000 UTC m=+21.760213759" watchObservedRunningTime="2026-05-21 01:48:03.473190309 +0000 UTC m=+21.760437085"
May 21 01:48:03.473444 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:03.473420    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4" event={"ID":"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a","Type":"ContainerStarted","Data":"3f779683f9e167112eac44aa45f1cd61f3e197eb8f74835a30a0624af3bdee4e"}
May 21 01:48:03.473519 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:03.473451    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4" event={"ID":"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a","Type":"ContainerStarted","Data":"ac312d7b902126eff40f2389b5c43d4693a31a7eb783c6598fd203f4a99dffbc"}
May 21 01:48:03.473519 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:03.473466    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4" event={"ID":"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a","Type":"ContainerStarted","Data":"3ef4c78157a150d22e2862cfcda5c637ce815fb5b6a69dcc532ef8f92f76e931"}
May 21 01:48:03.473519 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:03.473479    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4" event={"ID":"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a","Type":"ContainerStarted","Data":"1c68b8417ec0a7d6e04b4e2e2cf784ad8266e12fd54c5d6e567948c497965e55"}
May 21 01:48:03.474606 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:03.474584    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2jn8b" event={"ID":"c246e67d-eb3e-4599-8d35-e25d77dc3d6b","Type":"ContainerStarted","Data":"598f69f62be2988d343ce5973330419121682c8a0c1254091c34661c760a60ed"}
May 21 01:48:03.475640 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:03.475621    2552 generic.go:358] "Generic (PLEG): container finished" podID="3dd449c6-c30a-404a-8163-d12b70542e94" containerID="1303091e480ba47b1415f06183a37824ab95f80b69cfe739e9cccd836a2ece91" exitCode=0
May 21 01:48:03.475704 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:03.475670    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v9vqz" event={"ID":"3dd449c6-c30a-404a-8163-d12b70542e94","Type":"ContainerDied","Data":"1303091e480ba47b1415f06183a37824ab95f80b69cfe739e9cccd836a2ece91"}
May 21 01:48:03.476832 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:03.476817    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xk25b" event={"ID":"bd5cd680-f612-4207-a7d2-f595aa762713","Type":"ContainerStarted","Data":"dc0fa9f2eb5de0936ead1abb79b5324cc69eb5c7b31e216bfaec439a0b073363"}
May 21 01:48:03.486848 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:03.486814    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hq6nm" podStartSLOduration=2.868129346 podStartE2EDuration="21.486804305s" podCreationTimestamp="2026-05-21 01:47:42 +0000 UTC" firstStartedPulling="2026-05-21 01:47:43.627487623 +0000 UTC m=+1.914734396" lastFinishedPulling="2026-05-21 01:48:02.246162599 +0000 UTC m=+20.533409355" observedRunningTime="2026-05-21 01:48:03.486306605 +0000 UTC m=+21.773553381" watchObservedRunningTime="2026-05-21 01:48:03.486804305 +0000 UTC m=+21.774051082"
May 21 01:48:03.528971 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:03.528937    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-49shb" podStartSLOduration=2.885039016 podStartE2EDuration="21.528924992s" podCreationTimestamp="2026-05-21 01:47:42 +0000 UTC" firstStartedPulling="2026-05-21 01:47:43.602290772 +0000 UTC m=+1.889537527" lastFinishedPulling="2026-05-21 01:48:02.246176742 +0000 UTC m=+20.533423503" observedRunningTime="2026-05-21 01:48:03.514384787 +0000 UTC m=+21.801631565" watchObservedRunningTime="2026-05-21 01:48:03.528924992 +0000 UTC m=+21.816171767"
May 21 01:48:03.529068 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:03.529012    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-jt6xm" podStartSLOduration=2.804164253 podStartE2EDuration="21.529008766s" podCreationTimestamp="2026-05-21 01:47:42 +0000 UTC" firstStartedPulling="2026-05-21 01:47:43.606919822 +0000 UTC m=+1.894166581" lastFinishedPulling="2026-05-21 01:48:02.331764339 +0000 UTC m=+20.619011094" observedRunningTime="2026-05-21 01:48:03.529006179 +0000 UTC m=+21.816252957" watchObservedRunningTime="2026-05-21 01:48:03.529008766 +0000 UTC m=+21.816255543"
May 21 01:48:03.542997 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:03.542966    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-2jn8b" podStartSLOduration=2.886789093 podStartE2EDuration="21.542954803s" podCreationTimestamp="2026-05-21 01:47:42 +0000 UTC" firstStartedPulling="2026-05-21 01:47:43.589995032 +0000 UTC m=+1.877241789" lastFinishedPulling="2026-05-21 01:48:02.246160741 +0000 UTC m=+20.533407499" observedRunningTime="2026-05-21 01:48:03.542859161 +0000 UTC m=+21.830106150" watchObservedRunningTime="2026-05-21 01:48:03.542954803 +0000 UTC m=+21.830201580"
May 21 01:48:03.576514 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:03.576481    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xk25b" podStartSLOduration=2.827845806 podStartE2EDuration="21.576469836s" podCreationTimestamp="2026-05-21 01:47:42 +0000 UTC" firstStartedPulling="2026-05-21 01:47:43.549677095 +0000 UTC m=+1.836923850" lastFinishedPulling="2026-05-21 01:48:02.298301122 +0000 UTC m=+20.585547880" observedRunningTime="2026-05-21 01:48:03.576365622 +0000 UTC m=+21.863612399" watchObservedRunningTime="2026-05-21 01:48:03.576469836 +0000 UTC m=+21.863716613"
May 21 01:48:04.459408 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:04.459370    2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 21 01:48:04.480633 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:04.480601    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sswsj" event={"ID":"4da4318a-ab5c-41e6-b839-c03f4a319ec6","Type":"ContainerStarted","Data":"61a93fde402047c9d2655c448a30d77785dfa03b97c4fece4c43031a009216b7"}
May 21 01:48:04.482658 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:04.482632    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g" event={"ID":"bd8f0513-bcd1-4c4a-be8f-af5172e44140","Type":"ContainerStarted","Data":"368caba47f08a41e56ee1d30e0ed39f4111ea4e0482ac7540eee2c6a5e1b44ec"}
May 21 01:48:04.485572 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:04.485445    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal" event={"ID":"df7d891e45dc4894e91d322e3d16f193","Type":"ContainerStarted","Data":"e5e4a10f6d9ae8b6ecb305ebb02cf776965aa0ad3a06fa131e6d796f14bd3f03"}
May 21 01:48:04.491925 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:04.491901    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4" event={"ID":"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a","Type":"ContainerStarted","Data":"147e991ad7e454956d2af2abc57437ae1ec3c1eeb5fba699858533e8597f1bf5"}
May 21 01:48:04.492026 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:04.491948    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4" event={"ID":"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a","Type":"ContainerStarted","Data":"543e9461a02caf63e03c8776d592f5ac480005dd9eb1ec087aa934d5a2bca91e"}
May 21 01:48:04.494397 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:04.494353    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sswsj" podStartSLOduration=3.814978843 podStartE2EDuration="22.494341357s" podCreationTimestamp="2026-05-21 01:47:42 +0000 UTC" firstStartedPulling="2026-05-21 01:47:43.615494693 +0000 UTC m=+1.902741448" lastFinishedPulling="2026-05-21 01:48:02.294857207 +0000 UTC m=+20.582103962" observedRunningTime="2026-05-21 01:48:04.494190669 +0000 UTC m=+22.781437447" watchObservedRunningTime="2026-05-21 01:48:04.494341357 +0000 UTC m=+22.781588134"
May 21 01:48:05.295498 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:05.295408    2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T01:48:04.459395347Z","UUID":"6acd9cbd-0374-49f8-953d-2ad6ffd48062","Handler":null,"Name":"","Endpoint":""}
May 21 01:48:05.297011 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:05.296968    2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 21 01:48:05.297011 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:05.296995    2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 21 01:48:05.317499 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:05.317468    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:48:05.317642 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:05.317524    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:48:05.317698 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:05.317655    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn6dl" podUID="95930799-a903-46cc-b0ac-b157dfbd4bb8"
May 21 01:48:05.317803 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:05.317776    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ld5n" podUID="5eed9975-086b-4431-910d-aa0d9cf2dc74"
May 21 01:48:06.497412 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:06.497368    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g" event={"ID":"bd8f0513-bcd1-4c4a-be8f-af5172e44140","Type":"ContainerStarted","Data":"e3bd21849559a9566f5cd25bca9a3af30ec91b69bd5bd212ac6b3085ef7f5762"}
May 21 01:48:06.500449 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:06.500416    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4" event={"ID":"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a","Type":"ContainerStarted","Data":"bf1f38063af00a9949d488f0fa2d372c3dafe53e3806a72502da1133f780e561"}
May 21 01:48:06.514334 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:06.514285    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qt46g" podStartSLOduration=2.418010387 podStartE2EDuration="24.514270108s" podCreationTimestamp="2026-05-21 01:47:42 +0000 UTC" firstStartedPulling="2026-05-21 01:47:43.534187389 +0000 UTC m=+1.821434144" lastFinishedPulling="2026-05-21 01:48:05.630447095 +0000 UTC m=+23.917693865" observedRunningTime="2026-05-21 01:48:06.514148291 +0000 UTC m=+24.801395068" watchObservedRunningTime="2026-05-21 01:48:06.514270108 +0000 UTC m=+24.801516888"
May 21 01:48:06.514535 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:06.514510    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal" podStartSLOduration=24.514503351 podStartE2EDuration="24.514503351s" podCreationTimestamp="2026-05-21 01:47:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 01:48:04.507386076 +0000 UTC m=+22.794632852" watchObservedRunningTime="2026-05-21 01:48:06.514503351 +0000 UTC m=+24.801750130"
May 21 01:48:06.927004 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:06.926922    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hq6nm"
May 21 01:48:06.927710 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:06.927686    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hq6nm"
May 21 01:48:07.317103 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:07.317068    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:48:07.317247 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:07.317073    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:48:07.317247 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:07.317195    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn6dl" podUID="95930799-a903-46cc-b0ac-b157dfbd4bb8"
May 21 01:48:07.317324 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:07.317248    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ld5n" podUID="5eed9975-086b-4431-910d-aa0d9cf2dc74"
May 21 01:48:08.507047 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:08.507014    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4" event={"ID":"0d57ff45-b79d-46a9-9f26-b8b9a064ab4a","Type":"ContainerStarted","Data":"c648117398a92053415af7a77eaf8dde2ab666f274e37a5c5b666563a4e65303"}
May 21 01:48:08.507831 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:08.507316    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:48:08.508684 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:08.508659    2552 generic.go:358] "Generic (PLEG): container finished" podID="3dd449c6-c30a-404a-8163-d12b70542e94" containerID="11b7612bd277231d64ef6f527c78de04483ff3d4f347d9d85651e78e32497d1c" exitCode=0
May 21 01:48:08.508825 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:08.508692    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v9vqz" event={"ID":"3dd449c6-c30a-404a-8163-d12b70542e94","Type":"ContainerDied","Data":"11b7612bd277231d64ef6f527c78de04483ff3d4f347d9d85651e78e32497d1c"}
May 21 01:48:08.523001 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:08.522974    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:48:08.532495 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:08.532459    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4" podStartSLOduration=7.264634389 podStartE2EDuration="26.532449222s" podCreationTimestamp="2026-05-21 01:47:42 +0000 UTC" firstStartedPulling="2026-05-21 01:47:43.624414385 +0000 UTC m=+1.911661157" lastFinishedPulling="2026-05-21 01:48:02.892229221 +0000 UTC m=+21.179475990" observedRunningTime="2026-05-21 01:48:08.531816069 +0000 UTC m=+26.819062845" watchObservedRunningTime="2026-05-21 01:48:08.532449222 +0000 UTC m=+26.819695999"
May 21 01:48:09.317449 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:09.317284    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:48:09.317634 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:09.317288    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:48:09.317634 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:09.317520    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ld5n" podUID="5eed9975-086b-4431-910d-aa0d9cf2dc74"
May 21 01:48:09.317746 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:09.317645    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn6dl" podUID="95930799-a903-46cc-b0ac-b157dfbd4bb8"
May 21 01:48:09.512540 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:09.512476    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:48:09.512540 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:09.512518    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:48:09.531106 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:09.531082    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:48:09.774823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:09.774796    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6ld5n"]
May 21 01:48:09.774992 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:09.774919    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:48:09.775058 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:09.775022    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ld5n" podUID="5eed9975-086b-4431-910d-aa0d9cf2dc74"
May 21 01:48:09.777573 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:09.777526    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hn6dl"]
May 21 01:48:09.777684 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:09.777637    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:48:09.777736 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:09.777718    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn6dl" podUID="95930799-a903-46cc-b0ac-b157dfbd4bb8"
May 21 01:48:10.514762 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:10.514726    2552 generic.go:358] "Generic (PLEG): container finished" podID="3dd449c6-c30a-404a-8163-d12b70542e94" containerID="79252d03ce5657ba63162ca3e15ede39073f450619cdfa46fed98e1c5374775a" exitCode=0
May 21 01:48:10.515301 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:10.514813    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v9vqz" event={"ID":"3dd449c6-c30a-404a-8163-d12b70542e94","Type":"ContainerDied","Data":"79252d03ce5657ba63162ca3e15ede39073f450619cdfa46fed98e1c5374775a"}
May 21 01:48:11.317800 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:11.317740    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:48:11.317922 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:11.317746    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:48:11.317922 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:11.317832    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ld5n" podUID="5eed9975-086b-4431-910d-aa0d9cf2dc74"
May 21 01:48:11.317991 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:11.317917    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn6dl" podUID="95930799-a903-46cc-b0ac-b157dfbd4bb8"
May 21 01:48:11.518840 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:11.518804    2552 generic.go:358] "Generic (PLEG): container finished" podID="3dd449c6-c30a-404a-8163-d12b70542e94" containerID="6918b90d6b95db0d22f426089fdff312c3afb83580b37e8a9ca34b856c076aed" exitCode=0
May 21 01:48:11.519216 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:11.518891    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v9vqz" event={"ID":"3dd449c6-c30a-404a-8163-d12b70542e94","Type":"ContainerDied","Data":"6918b90d6b95db0d22f426089fdff312c3afb83580b37e8a9ca34b856c076aed"}
May 21 01:48:12.152658 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:12.152570    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hq6nm"
May 21 01:48:12.152814 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:12.152733    2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 21 01:48:12.153238 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:12.153205    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hq6nm"
May 21 01:48:13.317928 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:13.317899    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:48:13.318356 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:13.318080    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ld5n" podUID="5eed9975-086b-4431-910d-aa0d9cf2dc74"
May 21 01:48:13.318356 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:13.318090    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:48:13.318356 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:13.318186    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn6dl" podUID="95930799-a903-46cc-b0ac-b157dfbd4bb8"
May 21 01:48:14.973448 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:14.973270    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs\") pod \"network-metrics-daemon-hn6dl\" (UID: \"95930799-a903-46cc-b0ac-b157dfbd4bb8\") " pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:48:14.973448 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:14.973434    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:48:14.973898 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:14.973507    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs podName:95930799-a903-46cc-b0ac-b157dfbd4bb8 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:46.973488455 +0000 UTC m=+65.260735210 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs") pod "network-metrics-daemon-hn6dl" (UID: "95930799-a903-46cc-b0ac-b157dfbd4bb8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:48:15.074346 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.074312    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5c4f\" (UniqueName: \"kubernetes.io/projected/5eed9975-086b-4431-910d-aa0d9cf2dc74-kube-api-access-l5c4f\") pod \"network-check-target-6ld5n\" (UID: \"5eed9975-086b-4431-910d-aa0d9cf2dc74\") " pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:48:15.074508 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:15.074462    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 01:48:15.074508 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:15.074481    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 01:48:15.074508 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:15.074490    2552 projected.go:194] Error preparing data for projected volume kube-api-access-l5c4f for pod openshift-network-diagnostics/network-check-target-6ld5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:48:15.074672 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:15.074559    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5eed9975-086b-4431-910d-aa0d9cf2dc74-kube-api-access-l5c4f podName:5eed9975-086b-4431-910d-aa0d9cf2dc74 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:47.074530312 +0000 UTC m=+65.361777068 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l5c4f" (UniqueName: "kubernetes.io/projected/5eed9975-086b-4431-910d-aa0d9cf2dc74-kube-api-access-l5c4f") pod "network-check-target-6ld5n" (UID: "5eed9975-086b-4431-910d-aa0d9cf2dc74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:48:15.317422 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.317389    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:48:15.317629 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.317401    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:48:15.317629 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:15.317507    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ld5n" podUID="5eed9975-086b-4431-910d-aa0d9cf2dc74"
May 21 01:48:15.317771 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:15.317636    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn6dl" podUID="95930799-a903-46cc-b0ac-b157dfbd4bb8"
May 21 01:48:15.518524 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.518496    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeReady"
May 21 01:48:15.518702 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.518639    2552 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 21 01:48:15.559594 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.559562    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-748dc"]
May 21 01:48:15.583606 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.583520    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-msfwg"]
May 21 01:48:15.583736 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.583687    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-748dc"
May 21 01:48:15.586381 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.586355    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 21 01:48:15.586381 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.586374    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bvhf9\""
May 21 01:48:15.586381 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.586380    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 21 01:48:15.586638 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.586391    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 21 01:48:15.609457 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.609437    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-748dc"]
May 21 01:48:15.609457 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.609458    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-msfwg"]
May 21 01:48:15.609596 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.609585    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-msfwg"
May 21 01:48:15.612370 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.612340    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 21 01:48:15.612370 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.612340    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qjjsz\""
May 21 01:48:15.612507 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.612340    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 21 01:48:15.679297 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.679274    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs527\" (UniqueName: \"kubernetes.io/projected/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-kube-api-access-fs527\") pod \"ingress-canary-748dc\" (UID: \"0d7dcaae-df99-4c98-a24b-a13f5cad4b75\") " pod="openshift-ingress-canary/ingress-canary-748dc"
May 21 01:48:15.679412 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.679322    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-cert\") pod \"ingress-canary-748dc\" (UID: \"0d7dcaae-df99-4c98-a24b-a13f5cad4b75\") " pod="openshift-ingress-canary/ingress-canary-748dc"
May 21 01:48:15.780743 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.780712    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-config-volume\") pod \"dns-default-msfwg\" (UID: \"7309acd7-d8d3-4e93-9eee-df1cbc2af69e\") " pod="openshift-dns/dns-default-msfwg"
May 21 01:48:15.780883 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.780749    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-metrics-tls\") pod \"dns-default-msfwg\" (UID: \"7309acd7-d8d3-4e93-9eee-df1cbc2af69e\") " pod="openshift-dns/dns-default-msfwg"
May 21 01:48:15.780883 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.780841    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fs527\" (UniqueName: \"kubernetes.io/projected/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-kube-api-access-fs527\") pod \"ingress-canary-748dc\" (UID: \"0d7dcaae-df99-4c98-a24b-a13f5cad4b75\") " pod="openshift-ingress-canary/ingress-canary-748dc"
May 21 01:48:15.780984 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.780906    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-tmp-dir\") pod \"dns-default-msfwg\" (UID: \"7309acd7-d8d3-4e93-9eee-df1cbc2af69e\") " pod="openshift-dns/dns-default-msfwg"
May 21 01:48:15.780984 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.780949    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8zbf\" (UniqueName: \"kubernetes.io/projected/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-kube-api-access-f8zbf\") pod \"dns-default-msfwg\" (UID: \"7309acd7-d8d3-4e93-9eee-df1cbc2af69e\") " pod="openshift-dns/dns-default-msfwg"
May 21 01:48:15.781080 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.780986    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-cert\") pod \"ingress-canary-748dc\" (UID: \"0d7dcaae-df99-4c98-a24b-a13f5cad4b75\") " pod="openshift-ingress-canary/ingress-canary-748dc"
May 21 01:48:15.781122 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:15.781110    2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 01:48:15.781204 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:15.781188    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-cert podName:0d7dcaae-df99-4c98-a24b-a13f5cad4b75 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:16.281166734 +0000 UTC m=+34.568413495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-cert") pod "ingress-canary-748dc" (UID: "0d7dcaae-df99-4c98-a24b-a13f5cad4b75") : secret "canary-serving-cert" not found
May 21 01:48:15.792487 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.792464    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs527\" (UniqueName: \"kubernetes.io/projected/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-kube-api-access-fs527\") pod \"ingress-canary-748dc\" (UID: \"0d7dcaae-df99-4c98-a24b-a13f5cad4b75\") " pod="openshift-ingress-canary/ingress-canary-748dc"
May 21 01:48:15.881478 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.881413    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-tmp-dir\") pod \"dns-default-msfwg\" (UID: \"7309acd7-d8d3-4e93-9eee-df1cbc2af69e\") " pod="openshift-dns/dns-default-msfwg"
May 21 01:48:15.881478 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.881459    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f8zbf\" (UniqueName: \"kubernetes.io/projected/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-kube-api-access-f8zbf\") pod \"dns-default-msfwg\" (UID: \"7309acd7-d8d3-4e93-9eee-df1cbc2af69e\") " pod="openshift-dns/dns-default-msfwg"
May 21 01:48:15.881696 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.881533    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-config-volume\") pod \"dns-default-msfwg\" (UID: \"7309acd7-d8d3-4e93-9eee-df1cbc2af69e\") " pod="openshift-dns/dns-default-msfwg"
May 21 01:48:15.881696 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.881570    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-metrics-tls\") pod \"dns-default-msfwg\" (UID: \"7309acd7-d8d3-4e93-9eee-df1cbc2af69e\") " pod="openshift-dns/dns-default-msfwg"
May 21 01:48:15.881696 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:15.881688    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 01:48:15.881832 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:15.881749    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-metrics-tls podName:7309acd7-d8d3-4e93-9eee-df1cbc2af69e nodeName:}" failed. No retries permitted until 2026-05-21 01:48:16.381732661 +0000 UTC m=+34.668979416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-metrics-tls") pod "dns-default-msfwg" (UID: "7309acd7-d8d3-4e93-9eee-df1cbc2af69e") : secret "dns-default-metrics-tls" not found
May 21 01:48:15.882087 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.882057    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-tmp-dir\") pod \"dns-default-msfwg\" (UID: \"7309acd7-d8d3-4e93-9eee-df1cbc2af69e\") " pod="openshift-dns/dns-default-msfwg"
May 21 01:48:15.882178 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.882116    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-config-volume\") pod \"dns-default-msfwg\" (UID: \"7309acd7-d8d3-4e93-9eee-df1cbc2af69e\") " pod="openshift-dns/dns-default-msfwg"
May 21 01:48:15.889884 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:15.889861    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8zbf\" (UniqueName: \"kubernetes.io/projected/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-kube-api-access-f8zbf\") pod \"dns-default-msfwg\" (UID: \"7309acd7-d8d3-4e93-9eee-df1cbc2af69e\") " pod="openshift-dns/dns-default-msfwg"
May 21 01:48:16.285146 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:16.285115    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-cert\") pod \"ingress-canary-748dc\" (UID: \"0d7dcaae-df99-4c98-a24b-a13f5cad4b75\") " pod="openshift-ingress-canary/ingress-canary-748dc"
May 21 01:48:16.285628 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:16.285256    2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 01:48:16.285628 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:16.285319    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-cert podName:0d7dcaae-df99-4c98-a24b-a13f5cad4b75 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:17.285301653 +0000 UTC m=+35.572548408 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-cert") pod "ingress-canary-748dc" (UID: "0d7dcaae-df99-4c98-a24b-a13f5cad4b75") : secret "canary-serving-cert" not found
May 21 01:48:16.385879 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:16.385846    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-metrics-tls\") pod \"dns-default-msfwg\" (UID: \"7309acd7-d8d3-4e93-9eee-df1cbc2af69e\") " pod="openshift-dns/dns-default-msfwg"
May 21 01:48:16.386049 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:16.386015    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 01:48:16.386099 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:16.386092    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-metrics-tls podName:7309acd7-d8d3-4e93-9eee-df1cbc2af69e nodeName:}" failed. No retries permitted until 2026-05-21 01:48:17.386071544 +0000 UTC m=+35.673318321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-metrics-tls") pod "dns-default-msfwg" (UID: "7309acd7-d8d3-4e93-9eee-df1cbc2af69e") : secret "dns-default-metrics-tls" not found
May 21 01:48:17.291448 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:17.291418    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-cert\") pod \"ingress-canary-748dc\" (UID: \"0d7dcaae-df99-4c98-a24b-a13f5cad4b75\") " pod="openshift-ingress-canary/ingress-canary-748dc"
May 21 01:48:17.291812 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:17.291572    2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 01:48:17.291812 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:17.291630    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-cert podName:0d7dcaae-df99-4c98-a24b-a13f5cad4b75 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:19.29161548 +0000 UTC m=+37.578862234 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-cert") pod "ingress-canary-748dc" (UID: "0d7dcaae-df99-4c98-a24b-a13f5cad4b75") : secret "canary-serving-cert" not found
May 21 01:48:17.317200 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:17.317180    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:48:17.317200 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:17.317190    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:48:17.320968 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:17.320946    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 01:48:17.320968 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:17.320960    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 01:48:17.321142 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:17.320971    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 01:48:17.321142 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:17.320967    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ng7kc\""
May 21 01:48:17.321142 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:17.320962    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8dzcp\""
May 21 01:48:17.392785 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:17.392759    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-metrics-tls\") pod \"dns-default-msfwg\" (UID: \"7309acd7-d8d3-4e93-9eee-df1cbc2af69e\") " pod="openshift-dns/dns-default-msfwg"
May 21 01:48:17.392931 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:17.392914    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 01:48:17.392994 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:17.392985    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-metrics-tls podName:7309acd7-d8d3-4e93-9eee-df1cbc2af69e nodeName:}" failed. No retries permitted until 2026-05-21 01:48:19.392965483 +0000 UTC m=+37.680212241 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-metrics-tls") pod "dns-default-msfwg" (UID: "7309acd7-d8d3-4e93-9eee-df1cbc2af69e") : secret "dns-default-metrics-tls" not found
May 21 01:48:18.534403 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:18.534368    2552 generic.go:358] "Generic (PLEG): container finished" podID="3dd449c6-c30a-404a-8163-d12b70542e94" containerID="e9930044a3e209f19fe3085744ce2ce7dc4863c2f5b0c803ddd54aeecba7b75b" exitCode=0
May 21 01:48:18.534403 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:18.534407    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v9vqz" event={"ID":"3dd449c6-c30a-404a-8163-d12b70542e94","Type":"ContainerDied","Data":"e9930044a3e209f19fe3085744ce2ce7dc4863c2f5b0c803ddd54aeecba7b75b"}
May 21 01:48:19.307134 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:19.307103    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-cert\") pod \"ingress-canary-748dc\" (UID: \"0d7dcaae-df99-4c98-a24b-a13f5cad4b75\") " pod="openshift-ingress-canary/ingress-canary-748dc"
May 21 01:48:19.307292 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:19.307225    2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 01:48:19.307292 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:19.307279    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-cert podName:0d7dcaae-df99-4c98-a24b-a13f5cad4b75 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:23.307265532 +0000 UTC m=+41.594512287 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-cert") pod "ingress-canary-748dc" (UID: "0d7dcaae-df99-4c98-a24b-a13f5cad4b75") : secret "canary-serving-cert" not found
May 21 01:48:19.408207 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:19.408182    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-metrics-tls\") pod \"dns-default-msfwg\" (UID: \"7309acd7-d8d3-4e93-9eee-df1cbc2af69e\") " pod="openshift-dns/dns-default-msfwg"
May 21 01:48:19.408327 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:19.408289    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 01:48:19.408366 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:19.408335    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-metrics-tls podName:7309acd7-d8d3-4e93-9eee-df1cbc2af69e nodeName:}" failed. No retries permitted until 2026-05-21 01:48:23.408322064 +0000 UTC m=+41.695568819 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-metrics-tls") pod "dns-default-msfwg" (UID: "7309acd7-d8d3-4e93-9eee-df1cbc2af69e") : secret "dns-default-metrics-tls" not found
May 21 01:48:19.538832 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:19.538806    2552 generic.go:358] "Generic (PLEG): container finished" podID="3dd449c6-c30a-404a-8163-d12b70542e94" containerID="fce52029f30efa0527b378368cfd7de425b3f3194c19167b76a9547bba403d50" exitCode=0
May 21 01:48:19.539240 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:19.538866    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v9vqz" event={"ID":"3dd449c6-c30a-404a-8163-d12b70542e94","Type":"ContainerDied","Data":"fce52029f30efa0527b378368cfd7de425b3f3194c19167b76a9547bba403d50"}
May 21 01:48:20.543237 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:20.543204    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v9vqz" event={"ID":"3dd449c6-c30a-404a-8163-d12b70542e94","Type":"ContainerStarted","Data":"3d6cd57723257ef6a15440acbf4b93b6502c192498e3cf44b7f161e1e5a13d7a"}
May 21 01:48:20.566092 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:20.566038    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v9vqz" podStartSLOduration=4.730209663 podStartE2EDuration="38.56602379s" podCreationTimestamp="2026-05-21 01:47:42 +0000 UTC" firstStartedPulling="2026-05-21 01:47:43.56945998 +0000 UTC m=+1.856706734" lastFinishedPulling="2026-05-21 01:48:17.405274106 +0000 UTC m=+35.692520861" observedRunningTime="2026-05-21 01:48:20.565690752 +0000 UTC m=+38.852937529" watchObservedRunningTime="2026-05-21 01:48:20.56602379 +0000 UTC m=+38.853270569"
May 21 01:48:23.334889 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:23.334853    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-cert\") pod \"ingress-canary-748dc\" (UID: \"0d7dcaae-df99-4c98-a24b-a13f5cad4b75\") " pod="openshift-ingress-canary/ingress-canary-748dc"
May 21 01:48:23.335352 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:23.334950    2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 01:48:23.335352 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:23.334999    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-cert podName:0d7dcaae-df99-4c98-a24b-a13f5cad4b75 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:31.334985642 +0000 UTC m=+49.622232397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-cert") pod "ingress-canary-748dc" (UID: "0d7dcaae-df99-4c98-a24b-a13f5cad4b75") : secret "canary-serving-cert" not found
May 21 01:48:23.435297 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:23.435270    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-metrics-tls\") pod \"dns-default-msfwg\" (UID: \"7309acd7-d8d3-4e93-9eee-df1cbc2af69e\") " pod="openshift-dns/dns-default-msfwg"
May 21 01:48:23.435424 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:23.435367    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 01:48:23.435424 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:23.435408    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-metrics-tls podName:7309acd7-d8d3-4e93-9eee-df1cbc2af69e nodeName:}" failed. No retries permitted until 2026-05-21 01:48:31.435396838 +0000 UTC m=+49.722643592 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-metrics-tls") pod "dns-default-msfwg" (UID: "7309acd7-d8d3-4e93-9eee-df1cbc2af69e") : secret "dns-default-metrics-tls" not found
May 21 01:48:31.383314 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:31.383277    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-cert\") pod \"ingress-canary-748dc\" (UID: \"0d7dcaae-df99-4c98-a24b-a13f5cad4b75\") " pod="openshift-ingress-canary/ingress-canary-748dc"
May 21 01:48:31.383791 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:31.383409    2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 01:48:31.383791 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:31.383471    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-cert podName:0d7dcaae-df99-4c98-a24b-a13f5cad4b75 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:47.38345547 +0000 UTC m=+65.670702225 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-cert") pod "ingress-canary-748dc" (UID: "0d7dcaae-df99-4c98-a24b-a13f5cad4b75") : secret "canary-serving-cert" not found
May 21 01:48:31.484319 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:31.484294    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-metrics-tls\") pod \"dns-default-msfwg\" (UID: \"7309acd7-d8d3-4e93-9eee-df1cbc2af69e\") " pod="openshift-dns/dns-default-msfwg"
May 21 01:48:31.484439 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:31.484414    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 01:48:31.484476 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:31.484472    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-metrics-tls podName:7309acd7-d8d3-4e93-9eee-df1cbc2af69e nodeName:}" failed. No retries permitted until 2026-05-21 01:48:47.484459922 +0000 UTC m=+65.771706677 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-metrics-tls") pod "dns-default-msfwg" (UID: "7309acd7-d8d3-4e93-9eee-df1cbc2af69e") : secret "dns-default-metrics-tls" not found
May 21 01:48:41.529626 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:41.529595    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z8sf4"
May 21 01:48:43.959589 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:43.959537    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w8fwv"]
May 21 01:48:43.963638 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:43.963617    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-9cxjs"]
May 21 01:48:43.963766 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:43.963749    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w8fwv"
May 21 01:48:43.965637 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:43.965619    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-9cxjs"
May 21 01:48:43.966563 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:43.966531    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 21 01:48:43.966686 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:43.966603    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-4qnzp\""
May 21 01:48:43.967208 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:43.967189    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 21 01:48:43.968200 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:43.968184    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 21 01:48:43.968249 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:43.968202    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-f67rq\""
May 21 01:48:43.968432 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:43.968418    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 21 01:48:43.968721 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:43.968709    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 21 01:48:43.972303 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:43.972282    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w8fwv"]
May 21 01:48:43.975513 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:43.975491    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-9cxjs"]
May 21 01:48:44.067448 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.067428    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt79p\" (UniqueName: \"kubernetes.io/projected/72f54f15-db03-429e-90e5-e3b11d5bc31f-kube-api-access-mt79p\") pod \"volume-data-source-validator-5cf8c89d64-w8fwv\" (UID: \"72f54f15-db03-429e-90e5-e3b11d5bc31f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w8fwv"
May 21 01:48:44.067566 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.067456    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0be9025-02e4-41be-8824-d6d2ae0efdb5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-9cxjs\" (UID: \"f0be9025-02e4-41be-8824-d6d2ae0efdb5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-9cxjs"
May 21 01:48:44.067566 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.067482    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jgm6\" (UniqueName: \"kubernetes.io/projected/f0be9025-02e4-41be-8824-d6d2ae0efdb5-kube-api-access-5jgm6\") pod \"cluster-samples-operator-697587599-9cxjs\" (UID: \"f0be9025-02e4-41be-8824-d6d2ae0efdb5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-9cxjs"
May 21 01:48:44.070524 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.070494    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-cgx9r"]
May 21 01:48:44.072614 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.072596    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-g7xz9"]
May 21 01:48:44.072748 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.072734    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-cgx9r"
May 21 01:48:44.074229 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.074212    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-bcb44468d-kzbm2"]
May 21 01:48:44.074342 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.074326    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-g7xz9"
May 21 01:48:44.075100 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.075084    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-k6htw\""
May 21 01:48:44.075272 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.075260    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 21 01:48:44.075314 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.075261    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 21 01:48:44.075347 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.075335    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 21 01:48:44.075724 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.075708    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 21 01:48:44.075999 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.075983    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:44.077748 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.077728    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 21 01:48:44.078727 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.078675    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 21 01:48:44.078727 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.078698    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-tclcl\""
May 21 01:48:44.078895 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.078866    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 21 01:48:44.079017 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.078999    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 21 01:48:44.079073 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.079017    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 21 01:48:44.079845 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.079418    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 21 01:48:44.079845 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.079658    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xmfz9\""
May 21 01:48:44.080209 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.080187    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 21 01:48:44.085429 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.085396    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 21 01:48:44.093321 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.092170    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 21 01:48:44.093321 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.092390    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-g7xz9"]
May 21 01:48:44.093321 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.093148    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-cgx9r"]
May 21 01:48:44.093524 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.093391    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 21 01:48:44.094797 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.094768    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bcb44468d-kzbm2"]
May 21 01:48:44.168518 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.168497    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a234f24-ca45-477a-9bac-38fe001042d6-registry-certificates\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:44.168635 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.168523    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a234f24-ca45-477a-9bac-38fe001042d6-trusted-ca\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:44.168635 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.168542    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-registry-tls\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:44.168635 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.168572    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a234f24-ca45-477a-9bac-38fe001042d6-ca-trust-extracted\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:44.168635 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.168626    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5jgm6\" (UniqueName: \"kubernetes.io/projected/f0be9025-02e4-41be-8824-d6d2ae0efdb5-kube-api-access-5jgm6\") pod \"cluster-samples-operator-697587599-9cxjs\" (UID: \"f0be9025-02e4-41be-8824-d6d2ae0efdb5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-9cxjs"
May 21 01:48:44.168787 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.168663    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95jmm\" (UniqueName: \"kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-kube-api-access-95jmm\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:44.168787 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.168680    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fb97518-73b0-46b5-af75-6646323566c6-service-ca-bundle\") pod \"insights-operator-78bdfb888c-g7xz9\" (UID: \"2fb97518-73b0-46b5-af75-6646323566c6\") " pod="openshift-insights/insights-operator-78bdfb888c-g7xz9"
May 21 01:48:44.168787 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.168696    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7srs\" (UniqueName: \"kubernetes.io/projected/2fb97518-73b0-46b5-af75-6646323566c6-kube-api-access-z7srs\") pod \"insights-operator-78bdfb888c-g7xz9\" (UID: \"2fb97518-73b0-46b5-af75-6646323566c6\") " pod="openshift-insights/insights-operator-78bdfb888c-g7xz9"
May 21 01:48:44.168787 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.168716    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a1d53d4-c866-4375-a183-ecfaa11e9d0b-config\") pod \"console-operator-76dff48d59-cgx9r\" (UID: \"3a1d53d4-c866-4375-a183-ecfaa11e9d0b\") " pod="openshift-console-operator/console-operator-76dff48d59-cgx9r"
May 21 01:48:44.168787 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.168747    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j85bb\" (UniqueName: \"kubernetes.io/projected/3a1d53d4-c866-4375-a183-ecfaa11e9d0b-kube-api-access-j85bb\") pod \"console-operator-76dff48d59-cgx9r\" (UID: \"3a1d53d4-c866-4375-a183-ecfaa11e9d0b\") " pod="openshift-console-operator/console-operator-76dff48d59-cgx9r"
May 21 01:48:44.168787 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.168784    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fb97518-73b0-46b5-af75-6646323566c6-tmp\") pod \"insights-operator-78bdfb888c-g7xz9\" (UID: \"2fb97518-73b0-46b5-af75-6646323566c6\") " pod="openshift-insights/insights-operator-78bdfb888c-g7xz9"
May 21 01:48:44.168984 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.168806    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2fb97518-73b0-46b5-af75-6646323566c6-serving-cert\") pod \"insights-operator-78bdfb888c-g7xz9\" (UID: \"2fb97518-73b0-46b5-af75-6646323566c6\") " pod="openshift-insights/insights-operator-78bdfb888c-g7xz9"
May 21 01:48:44.168984 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.168838    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fb97518-73b0-46b5-af75-6646323566c6-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-g7xz9\" (UID: \"2fb97518-73b0-46b5-af75-6646323566c6\") " pod="openshift-insights/insights-operator-78bdfb888c-g7xz9"
May 21 01:48:44.168984 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.168866    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a1d53d4-c866-4375-a183-ecfaa11e9d0b-trusted-ca\") pod \"console-operator-76dff48d59-cgx9r\" (UID: \"3a1d53d4-c866-4375-a183-ecfaa11e9d0b\") " pod="openshift-console-operator/console-operator-76dff48d59-cgx9r"
May 21 01:48:44.168984 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.168947    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a234f24-ca45-477a-9bac-38fe001042d6-image-registry-private-configuration\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:44.168984 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.168972    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a234f24-ca45-477a-9bac-38fe001042d6-installation-pull-secrets\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:44.169145 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.168996    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mt79p\" (UniqueName: \"kubernetes.io/projected/72f54f15-db03-429e-90e5-e3b11d5bc31f-kube-api-access-mt79p\") pod \"volume-data-source-validator-5cf8c89d64-w8fwv\" (UID: \"72f54f15-db03-429e-90e5-e3b11d5bc31f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w8fwv"
May 21 01:48:44.169145 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.169012    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0be9025-02e4-41be-8824-d6d2ae0efdb5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-9cxjs\" (UID: \"f0be9025-02e4-41be-8824-d6d2ae0efdb5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-9cxjs"
May 21 01:48:44.169145 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.169033    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-bound-sa-token\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:44.169145 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.169129    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2fb97518-73b0-46b5-af75-6646323566c6-snapshots\") pod \"insights-operator-78bdfb888c-g7xz9\" (UID: \"2fb97518-73b0-46b5-af75-6646323566c6\") " pod="openshift-insights/insights-operator-78bdfb888c-g7xz9"
May 21 01:48:44.169145 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:44.169140    2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 21 01:48:44.169307 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.169166    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a1d53d4-c866-4375-a183-ecfaa11e9d0b-serving-cert\") pod \"console-operator-76dff48d59-cgx9r\" (UID: \"3a1d53d4-c866-4375-a183-ecfaa11e9d0b\") " pod="openshift-console-operator/console-operator-76dff48d59-cgx9r"
May 21 01:48:44.169307 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:44.169182    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0be9025-02e4-41be-8824-d6d2ae0efdb5-samples-operator-tls podName:f0be9025-02e4-41be-8824-d6d2ae0efdb5 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:44.669168508 +0000 UTC m=+62.956415267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f0be9025-02e4-41be-8824-d6d2ae0efdb5-samples-operator-tls") pod "cluster-samples-operator-697587599-9cxjs" (UID: "f0be9025-02e4-41be-8824-d6d2ae0efdb5") : secret "samples-operator-tls" not found
May 21 01:48:44.180435 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.180409    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt79p\" (UniqueName: \"kubernetes.io/projected/72f54f15-db03-429e-90e5-e3b11d5bc31f-kube-api-access-mt79p\") pod \"volume-data-source-validator-5cf8c89d64-w8fwv\" (UID: \"72f54f15-db03-429e-90e5-e3b11d5bc31f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w8fwv"
May 21 01:48:44.180628 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.180608    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jgm6\" (UniqueName: \"kubernetes.io/projected/f0be9025-02e4-41be-8824-d6d2ae0efdb5-kube-api-access-5jgm6\") pod \"cluster-samples-operator-697587599-9cxjs\" (UID: \"f0be9025-02e4-41be-8824-d6d2ae0efdb5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-9cxjs"
May 21 01:48:44.269639 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.269619    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-bound-sa-token\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:44.269717 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.269647    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2fb97518-73b0-46b5-af75-6646323566c6-snapshots\") pod \"insights-operator-78bdfb888c-g7xz9\" (UID: \"2fb97518-73b0-46b5-af75-6646323566c6\") " pod="openshift-insights/insights-operator-78bdfb888c-g7xz9"
May 21 01:48:44.269717 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.269665    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a1d53d4-c866-4375-a183-ecfaa11e9d0b-serving-cert\") pod \"console-operator-76dff48d59-cgx9r\" (UID: \"3a1d53d4-c866-4375-a183-ecfaa11e9d0b\") " pod="openshift-console-operator/console-operator-76dff48d59-cgx9r"
May 21 01:48:44.269717 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.269682    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a234f24-ca45-477a-9bac-38fe001042d6-registry-certificates\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:44.269852 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.269827    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a234f24-ca45-477a-9bac-38fe001042d6-trusted-ca\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:44.269903 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.269879    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-registry-tls\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:44.269953 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.269906    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a234f24-ca45-477a-9bac-38fe001042d6-ca-trust-extracted\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:44.270025 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:44.270008    2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 01:48:44.270082 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:44.270027    2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bcb44468d-kzbm2: secret "image-registry-tls" not found
May 21 01:48:44.270082 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.270060    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-95jmm\" (UniqueName: \"kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-kube-api-access-95jmm\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:44.270188 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:44.270088    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-registry-tls podName:5a234f24-ca45-477a-9bac-38fe001042d6 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:44.770070905 +0000 UTC m=+63.057317674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-registry-tls") pod "image-registry-bcb44468d-kzbm2" (UID: "5a234f24-ca45-477a-9bac-38fe001042d6") : secret "image-registry-tls" not found
May 21 01:48:44.270188 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.270130    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2fb97518-73b0-46b5-af75-6646323566c6-snapshots\") pod \"insights-operator-78bdfb888c-g7xz9\" (UID: \"2fb97518-73b0-46b5-af75-6646323566c6\") " pod="openshift-insights/insights-operator-78bdfb888c-g7xz9"
May 21 01:48:44.270302 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.270220    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fb97518-73b0-46b5-af75-6646323566c6-service-ca-bundle\") pod \"insights-operator-78bdfb888c-g7xz9\" (UID: \"2fb97518-73b0-46b5-af75-6646323566c6\") " pod="openshift-insights/insights-operator-78bdfb888c-g7xz9"
May 21 01:48:44.270302 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.270256    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z7srs\" (UniqueName: \"kubernetes.io/projected/2fb97518-73b0-46b5-af75-6646323566c6-kube-api-access-z7srs\") pod \"insights-operator-78bdfb888c-g7xz9\" (UID: \"2fb97518-73b0-46b5-af75-6646323566c6\") " pod="openshift-insights/insights-operator-78bdfb888c-g7xz9"
May 21 01:48:44.270302 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.270286    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a1d53d4-c866-4375-a183-ecfaa11e9d0b-config\") pod \"console-operator-76dff48d59-cgx9r\" (UID: \"3a1d53d4-c866-4375-a183-ecfaa11e9d0b\") " pod="openshift-console-operator/console-operator-76dff48d59-cgx9r"
May 21 01:48:44.270302 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.270290    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a234f24-ca45-477a-9bac-38fe001042d6-ca-trust-extracted\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:44.270504 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.270302    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a234f24-ca45-477a-9bac-38fe001042d6-registry-certificates\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:44.270504 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.270310    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j85bb\" (UniqueName: \"kubernetes.io/projected/3a1d53d4-c866-4375-a183-ecfaa11e9d0b-kube-api-access-j85bb\") pod \"console-operator-76dff48d59-cgx9r\" (UID: \"3a1d53d4-c866-4375-a183-ecfaa11e9d0b\") " pod="openshift-console-operator/console-operator-76dff48d59-cgx9r"
May 21 01:48:44.270504 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.270350    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fb97518-73b0-46b5-af75-6646323566c6-tmp\") pod \"insights-operator-78bdfb888c-g7xz9\" (UID: \"2fb97518-73b0-46b5-af75-6646323566c6\") " pod="openshift-insights/insights-operator-78bdfb888c-g7xz9"
May 21 01:48:44.270504 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.270374    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2fb97518-73b0-46b5-af75-6646323566c6-serving-cert\") pod \"insights-operator-78bdfb888c-g7xz9\" (UID: \"2fb97518-73b0-46b5-af75-6646323566c6\") " pod="openshift-insights/insights-operator-78bdfb888c-g7xz9"
May 21 01:48:44.270504 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.270412    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fb97518-73b0-46b5-af75-6646323566c6-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-g7xz9\" (UID: \"2fb97518-73b0-46b5-af75-6646323566c6\") " pod="openshift-insights/insights-operator-78bdfb888c-g7xz9"
May 21 01:48:44.270504 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.270446    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a1d53d4-c866-4375-a183-ecfaa11e9d0b-trusted-ca\") pod \"console-operator-76dff48d59-cgx9r\" (UID: \"3a1d53d4-c866-4375-a183-ecfaa11e9d0b\") " pod="openshift-console-operator/console-operator-76dff48d59-cgx9r"
May 21 01:48:44.270887 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.270518    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a234f24-ca45-477a-9bac-38fe001042d6-image-registry-private-configuration\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:44.270887 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.270601    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a234f24-ca45-477a-9bac-38fe001042d6-installation-pull-secrets\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:44.270887 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.270806    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a234f24-ca45-477a-9bac-38fe001042d6-trusted-ca\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:44.270887 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.270849    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fb97518-73b0-46b5-af75-6646323566c6-service-ca-bundle\") pod \"insights-operator-78bdfb888c-g7xz9\" (UID: \"2fb97518-73b0-46b5-af75-6646323566c6\") " pod="openshift-insights/insights-operator-78bdfb888c-g7xz9"
May 21 01:48:44.271203 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.270905    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fb97518-73b0-46b5-af75-6646323566c6-tmp\") pod \"insights-operator-78bdfb888c-g7xz9\" (UID: \"2fb97518-73b0-46b5-af75-6646323566c6\") " pod="openshift-insights/insights-operator-78bdfb888c-g7xz9"
May 21 01:48:44.271203 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.270986    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a1d53d4-c866-4375-a183-ecfaa11e9d0b-config\") pod \"console-operator-76dff48d59-cgx9r\" (UID: \"3a1d53d4-c866-4375-a183-ecfaa11e9d0b\") " pod="openshift-console-operator/console-operator-76dff48d59-cgx9r"
May 21 01:48:44.271509 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.271489    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a1d53d4-c866-4375-a183-ecfaa11e9d0b-trusted-ca\") pod \"console-operator-76dff48d59-cgx9r\" (UID: \"3a1d53d4-c866-4375-a183-ecfaa11e9d0b\") " pod="openshift-console-operator/console-operator-76dff48d59-cgx9r"
May 21 01:48:44.271807 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.271787    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fb97518-73b0-46b5-af75-6646323566c6-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-g7xz9\" (UID: \"2fb97518-73b0-46b5-af75-6646323566c6\") " pod="openshift-insights/insights-operator-78bdfb888c-g7xz9"
May 21 01:48:44.272378 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.272356    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a1d53d4-c866-4375-a183-ecfaa11e9d0b-serving-cert\") pod \"console-operator-76dff48d59-cgx9r\" (UID: \"3a1d53d4-c866-4375-a183-ecfaa11e9d0b\") " pod="openshift-console-operator/console-operator-76dff48d59-cgx9r"
May 21 01:48:44.273028 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.273006    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a234f24-ca45-477a-9bac-38fe001042d6-image-registry-private-configuration\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:44.273142 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.273126    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2fb97518-73b0-46b5-af75-6646323566c6-serving-cert\") pod \"insights-operator-78bdfb888c-g7xz9\" (UID: \"2fb97518-73b0-46b5-af75-6646323566c6\") " pod="openshift-insights/insights-operator-78bdfb888c-g7xz9"
May 21 01:48:44.273208 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.273181    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a234f24-ca45-477a-9bac-38fe001042d6-installation-pull-secrets\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:44.274068 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.274041    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w8fwv"
May 21 01:48:44.280358 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.280329    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-bound-sa-token\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:44.280689 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.280669    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7srs\" (UniqueName: \"kubernetes.io/projected/2fb97518-73b0-46b5-af75-6646323566c6-kube-api-access-z7srs\") pod \"insights-operator-78bdfb888c-g7xz9\" (UID: \"2fb97518-73b0-46b5-af75-6646323566c6\") " pod="openshift-insights/insights-operator-78bdfb888c-g7xz9"
May 21 01:48:44.280907 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.280889    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95jmm\" (UniqueName: \"kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-kube-api-access-95jmm\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:44.281000 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.280980    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j85bb\" (UniqueName: \"kubernetes.io/projected/3a1d53d4-c866-4375-a183-ecfaa11e9d0b-kube-api-access-j85bb\") pod \"console-operator-76dff48d59-cgx9r\" (UID: \"3a1d53d4-c866-4375-a183-ecfaa11e9d0b\") " pod="openshift-console-operator/console-operator-76dff48d59-cgx9r"
May 21 01:48:44.384019 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.383992    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-cgx9r"
May 21 01:48:44.399997 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.399973    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-g7xz9"
May 21 01:48:44.414831 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.414808    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w8fwv"]
May 21 01:48:44.418648 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:48:44.418622    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72f54f15_db03_429e_90e5_e3b11d5bc31f.slice/crio-0c2d0c922091608d178551c3c9e376d8ebd01d13869cd4d4b4d8d29d69246303 WatchSource:0}: Error finding container 0c2d0c922091608d178551c3c9e376d8ebd01d13869cd4d4b4d8d29d69246303: Status 404 returned error can't find the container with id 0c2d0c922091608d178551c3c9e376d8ebd01d13869cd4d4b4d8d29d69246303
May 21 01:48:44.504689 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.504663    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-cgx9r"]
May 21 01:48:44.506867 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:48:44.506837    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a1d53d4_c866_4375_a183_ecfaa11e9d0b.slice/crio-c8063c4fbd1898c38aaa25822782de94f93091859e0ec5467ae81609b601b8dc WatchSource:0}: Error finding container c8063c4fbd1898c38aaa25822782de94f93091859e0ec5467ae81609b601b8dc: Status 404 returned error can't find the container with id c8063c4fbd1898c38aaa25822782de94f93091859e0ec5467ae81609b601b8dc
May 21 01:48:44.524149 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.524099    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-g7xz9"]
May 21 01:48:44.526811 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:48:44.526790    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb97518_73b0_46b5_af75_6646323566c6.slice/crio-d904e18250022e7c5b65191352977047b52476cabf09a667f6c183c917592c35 WatchSource:0}: Error finding container d904e18250022e7c5b65191352977047b52476cabf09a667f6c183c917592c35: Status 404 returned error can't find the container with id d904e18250022e7c5b65191352977047b52476cabf09a667f6c183c917592c35
May 21 01:48:44.585144 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.585115    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w8fwv" event={"ID":"72f54f15-db03-429e-90e5-e3b11d5bc31f","Type":"ContainerStarted","Data":"0c2d0c922091608d178551c3c9e376d8ebd01d13869cd4d4b4d8d29d69246303"}
May 21 01:48:44.586043 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.586016    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-cgx9r" event={"ID":"3a1d53d4-c866-4375-a183-ecfaa11e9d0b","Type":"ContainerStarted","Data":"c8063c4fbd1898c38aaa25822782de94f93091859e0ec5467ae81609b601b8dc"}
May 21 01:48:44.586841 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.586821    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-g7xz9" event={"ID":"2fb97518-73b0-46b5-af75-6646323566c6","Type":"ContainerStarted","Data":"d904e18250022e7c5b65191352977047b52476cabf09a667f6c183c917592c35"}
May 21 01:48:44.673713 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.673693    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0be9025-02e4-41be-8824-d6d2ae0efdb5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-9cxjs\" (UID: \"f0be9025-02e4-41be-8824-d6d2ae0efdb5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-9cxjs"
May 21 01:48:44.673812 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:44.673801    2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 21 01:48:44.673855 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:44.673849    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0be9025-02e4-41be-8824-d6d2ae0efdb5-samples-operator-tls podName:f0be9025-02e4-41be-8824-d6d2ae0efdb5 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:45.673834868 +0000 UTC m=+63.961081623 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f0be9025-02e4-41be-8824-d6d2ae0efdb5-samples-operator-tls") pod "cluster-samples-operator-697587599-9cxjs" (UID: "f0be9025-02e4-41be-8824-d6d2ae0efdb5") : secret "samples-operator-tls" not found
May 21 01:48:44.774751 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:44.774703    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-registry-tls\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:44.774886 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:44.774869    2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 01:48:44.774942 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:44.774890    2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bcb44468d-kzbm2: secret "image-registry-tls" not found
May 21 01:48:44.774999 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:44.774948    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-registry-tls podName:5a234f24-ca45-477a-9bac-38fe001042d6 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:45.774929932 +0000 UTC m=+64.062176701 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-registry-tls") pod "image-registry-bcb44468d-kzbm2" (UID: "5a234f24-ca45-477a-9bac-38fe001042d6") : secret "image-registry-tls" not found
May 21 01:48:45.681241 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:45.681206    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0be9025-02e4-41be-8824-d6d2ae0efdb5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-9cxjs\" (UID: \"f0be9025-02e4-41be-8824-d6d2ae0efdb5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-9cxjs"
May 21 01:48:45.681695 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:45.681362    2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 21 01:48:45.681695 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:45.681425    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0be9025-02e4-41be-8824-d6d2ae0efdb5-samples-operator-tls podName:f0be9025-02e4-41be-8824-d6d2ae0efdb5 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:47.681408313 +0000 UTC m=+65.968655074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f0be9025-02e4-41be-8824-d6d2ae0efdb5-samples-operator-tls") pod "cluster-samples-operator-697587599-9cxjs" (UID: "f0be9025-02e4-41be-8824-d6d2ae0efdb5") : secret "samples-operator-tls" not found
May 21 01:48:45.781560 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:45.781526    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-registry-tls\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:45.781734 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:45.781669    2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 01:48:45.781734 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:45.781703    2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bcb44468d-kzbm2: secret "image-registry-tls" not found
May 21 01:48:45.781808 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:45.781760    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-registry-tls podName:5a234f24-ca45-477a-9bac-38fe001042d6 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:47.781746938 +0000 UTC m=+66.068993698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-registry-tls") pod "image-registry-bcb44468d-kzbm2" (UID: "5a234f24-ca45-477a-9bac-38fe001042d6") : secret "image-registry-tls" not found
May 21 01:48:46.991994 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:46.991957    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs\") pod \"network-metrics-daemon-hn6dl\" (UID: \"95930799-a903-46cc-b0ac-b157dfbd4bb8\") " pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:48:46.994643 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:46.994614    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 01:48:47.002864 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:47.002834    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 01:48:47.002991 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:47.002912    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs podName:95930799-a903-46cc-b0ac-b157dfbd4bb8 nodeName:}" failed. No retries permitted until 2026-05-21 01:49:51.002888538 +0000 UTC m=+129.290135296 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs") pod "network-metrics-daemon-hn6dl" (UID: "95930799-a903-46cc-b0ac-b157dfbd4bb8") : secret "metrics-daemon-secret" not found
May 21 01:48:47.092892 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:47.092858    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5c4f\" (UniqueName: \"kubernetes.io/projected/5eed9975-086b-4431-910d-aa0d9cf2dc74-kube-api-access-l5c4f\") pod \"network-check-target-6ld5n\" (UID: \"5eed9975-086b-4431-910d-aa0d9cf2dc74\") " pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:48:47.095761 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:47.095740    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 01:48:47.106192 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:47.106172    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 01:48:47.116717 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:47.116698    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5c4f\" (UniqueName: \"kubernetes.io/projected/5eed9975-086b-4431-910d-aa0d9cf2dc74-kube-api-access-l5c4f\") pod \"network-check-target-6ld5n\" (UID: \"5eed9975-086b-4431-910d-aa0d9cf2dc74\") " pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:48:47.329269 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:47.329192    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8dzcp\""
May 21 01:48:47.337295 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:47.337262    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:48:47.395650 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:47.395628    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-cert\") pod \"ingress-canary-748dc\" (UID: \"0d7dcaae-df99-4c98-a24b-a13f5cad4b75\") " pod="openshift-ingress-canary/ingress-canary-748dc"
May 21 01:48:47.395774 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:47.395754    2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 01:48:47.396021 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:47.396001    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-cert podName:0d7dcaae-df99-4c98-a24b-a13f5cad4b75 nodeName:}" failed. No retries permitted until 2026-05-21 01:49:19.395974614 +0000 UTC m=+97.683221368 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-cert") pod "ingress-canary-748dc" (UID: "0d7dcaae-df99-4c98-a24b-a13f5cad4b75") : secret "canary-serving-cert" not found
May 21 01:48:47.496091 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:47.496066    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-metrics-tls\") pod \"dns-default-msfwg\" (UID: \"7309acd7-d8d3-4e93-9eee-df1cbc2af69e\") " pod="openshift-dns/dns-default-msfwg"
May 21 01:48:47.496199 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:47.496160    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 01:48:47.496237 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:47.496213    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-metrics-tls podName:7309acd7-d8d3-4e93-9eee-df1cbc2af69e nodeName:}" failed. No retries permitted until 2026-05-21 01:49:19.496201211 +0000 UTC m=+97.783447967 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-metrics-tls") pod "dns-default-msfwg" (UID: "7309acd7-d8d3-4e93-9eee-df1cbc2af69e") : secret "dns-default-metrics-tls" not found
May 21 01:48:47.697056 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:47.697029    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0be9025-02e4-41be-8824-d6d2ae0efdb5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-9cxjs\" (UID: \"f0be9025-02e4-41be-8824-d6d2ae0efdb5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-9cxjs"
May 21 01:48:47.697142 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:47.697118    2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 21 01:48:47.697185 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:47.697169    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0be9025-02e4-41be-8824-d6d2ae0efdb5-samples-operator-tls podName:f0be9025-02e4-41be-8824-d6d2ae0efdb5 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:51.697156763 +0000 UTC m=+69.984403518 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f0be9025-02e4-41be-8824-d6d2ae0efdb5-samples-operator-tls") pod "cluster-samples-operator-697587599-9cxjs" (UID: "f0be9025-02e4-41be-8824-d6d2ae0efdb5") : secret "samples-operator-tls" not found
May 21 01:48:47.798130 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:47.798107    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-registry-tls\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:47.798266 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:47.798249    2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 01:48:47.798305 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:47.798268    2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bcb44468d-kzbm2: secret "image-registry-tls" not found
May 21 01:48:47.798342 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:47.798312    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-registry-tls podName:5a234f24-ca45-477a-9bac-38fe001042d6 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:51.798299493 +0000 UTC m=+70.085546249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-registry-tls") pod "image-registry-bcb44468d-kzbm2" (UID: "5a234f24-ca45-477a-9bac-38fe001042d6") : secret "image-registry-tls" not found
May 21 01:48:47.966229 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:47.966204    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6ld5n"]
May 21 01:48:47.968824 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:48:47.968803    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eed9975_086b_4431_910d_aa0d9cf2dc74.slice/crio-e7ae098b0ff6cb9bd5fe1613f248183db615a0465275e6bacbcda68fac852a01 WatchSource:0}: Error finding container e7ae098b0ff6cb9bd5fe1613f248183db615a0465275e6bacbcda68fac852a01: Status 404 returned error can't find the container with id e7ae098b0ff6cb9bd5fe1613f248183db615a0465275e6bacbcda68fac852a01
May 21 01:48:48.595473 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:48.595441    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cgx9r_3a1d53d4-c866-4375-a183-ecfaa11e9d0b/console-operator/0.log"
May 21 01:48:48.595919 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:48.595493    2552 generic.go:358] "Generic (PLEG): container finished" podID="3a1d53d4-c866-4375-a183-ecfaa11e9d0b" containerID="09d7eefd31c64d17f832e8f45687ff64f541e9a2ad374c8d3d3d6ea0d23164a2" exitCode=255
May 21 01:48:48.595919 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:48.595534    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-cgx9r" event={"ID":"3a1d53d4-c866-4375-a183-ecfaa11e9d0b","Type":"ContainerDied","Data":"09d7eefd31c64d17f832e8f45687ff64f541e9a2ad374c8d3d3d6ea0d23164a2"}
May 21 01:48:48.595919 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:48.595831    2552 scope.go:117] "RemoveContainer" containerID="09d7eefd31c64d17f832e8f45687ff64f541e9a2ad374c8d3d3d6ea0d23164a2"
May 21 01:48:48.597672 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:48.597639    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w8fwv" event={"ID":"72f54f15-db03-429e-90e5-e3b11d5bc31f","Type":"ContainerStarted","Data":"e0de5b39d1eb42e348d979d4dff9e6c1cb9e4ad4d996c4d37e256bd8d5720c25"}
May 21 01:48:48.599150 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:48.599123    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6ld5n" event={"ID":"5eed9975-086b-4431-910d-aa0d9cf2dc74","Type":"ContainerStarted","Data":"e7ae098b0ff6cb9bd5fe1613f248183db615a0465275e6bacbcda68fac852a01"}
May 21 01:48:48.600737 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:48.600559    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-g7xz9" event={"ID":"2fb97518-73b0-46b5-af75-6646323566c6","Type":"ContainerStarted","Data":"f4fccad52f2b1147b216093ec0c4ed8939771b9140d6fd2030f4444f563db8b9"}
May 21 01:48:48.629103 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:48.629056    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-g7xz9" podStartSLOduration=1.3157323380000001 podStartE2EDuration="4.629040406s" podCreationTimestamp="2026-05-21 01:48:44 +0000 UTC" firstStartedPulling="2026-05-21 01:48:44.52845182 +0000 UTC m=+62.815698575" lastFinishedPulling="2026-05-21 01:48:47.841759886 +0000 UTC m=+66.129006643" observedRunningTime="2026-05-21 01:48:48.627765147 +0000 UTC m=+66.915011924" watchObservedRunningTime="2026-05-21 01:48:48.629040406 +0000 UTC m=+66.916287184"
May 21 01:48:48.640591 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:48.640523    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-w8fwv" podStartSLOduration=2.220219451 podStartE2EDuration="5.640512304s" podCreationTimestamp="2026-05-21 01:48:43 +0000 UTC" firstStartedPulling="2026-05-21 01:48:44.421542309 +0000 UTC m=+62.708789077" lastFinishedPulling="2026-05-21 01:48:47.841835161 +0000 UTC m=+66.129081930" observedRunningTime="2026-05-21 01:48:48.640170748 +0000 UTC m=+66.927417526" watchObservedRunningTime="2026-05-21 01:48:48.640512304 +0000 UTC m=+66.927759082"
May 21 01:48:49.604846 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:49.604813    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cgx9r_3a1d53d4-c866-4375-a183-ecfaa11e9d0b/console-operator/1.log"
May 21 01:48:49.605285 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:49.605271    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cgx9r_3a1d53d4-c866-4375-a183-ecfaa11e9d0b/console-operator/0.log"
May 21 01:48:49.605353 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:49.605315    2552 generic.go:358] "Generic (PLEG): container finished" podID="3a1d53d4-c866-4375-a183-ecfaa11e9d0b" containerID="13c4da916cb53028d52d80d2c62f7ddef9c0c218ee7913d15cc71235cccbe7c7" exitCode=255
May 21 01:48:49.605488 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:49.605413    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-cgx9r" event={"ID":"3a1d53d4-c866-4375-a183-ecfaa11e9d0b","Type":"ContainerDied","Data":"13c4da916cb53028d52d80d2c62f7ddef9c0c218ee7913d15cc71235cccbe7c7"}
May 21 01:48:49.605488 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:49.605459    2552 scope.go:117] "RemoveContainer" containerID="09d7eefd31c64d17f832e8f45687ff64f541e9a2ad374c8d3d3d6ea0d23164a2"
May 21 01:48:49.606048 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:49.606020    2552 scope.go:117] "RemoveContainer" containerID="13c4da916cb53028d52d80d2c62f7ddef9c0c218ee7913d15cc71235cccbe7c7"
May 21 01:48:49.606235 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:49.606208    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-cgx9r_openshift-console-operator(3a1d53d4-c866-4375-a183-ecfaa11e9d0b)\"" pod="openshift-console-operator/console-operator-76dff48d59-cgx9r" podUID="3a1d53d4-c866-4375-a183-ecfaa11e9d0b"
May 21 01:48:50.531249 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:50.531220    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2jn8b_c246e67d-eb3e-4599-8d35-e25d77dc3d6b/dns-node-resolver/0.log"
May 21 01:48:50.608239 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:50.608212    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cgx9r_3a1d53d4-c866-4375-a183-ecfaa11e9d0b/console-operator/1.log"
May 21 01:48:50.608678 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:50.608659    2552 scope.go:117] "RemoveContainer" containerID="13c4da916cb53028d52d80d2c62f7ddef9c0c218ee7913d15cc71235cccbe7c7"
May 21 01:48:50.608897 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:50.608876    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-cgx9r_openshift-console-operator(3a1d53d4-c866-4375-a183-ecfaa11e9d0b)\"" pod="openshift-console-operator/console-operator-76dff48d59-cgx9r" podUID="3a1d53d4-c866-4375-a183-ecfaa11e9d0b"
May 21 01:48:51.537329 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:51.537303    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-49shb_a4b8a809-3e02-4dd9-aba5-092aa39a344f/node-ca/0.log"
May 21 01:48:51.611220 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:51.611181    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6ld5n" event={"ID":"5eed9975-086b-4431-910d-aa0d9cf2dc74","Type":"ContainerStarted","Data":"161014313bad24a0ac2dbb1e6bbbad72c2ad19d2a4b0c0b10478789a9e4afdac"}
May 21 01:48:51.611594 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:51.611333    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:48:51.625155 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:51.625109    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6ld5n" podStartSLOduration=66.96372313 podStartE2EDuration="1m9.625097777s" podCreationTimestamp="2026-05-21 01:47:42 +0000 UTC" firstStartedPulling="2026-05-21 01:48:47.970807847 +0000 UTC m=+66.258054602" lastFinishedPulling="2026-05-21 01:48:50.632182478 +0000 UTC m=+68.919429249" observedRunningTime="2026-05-21 01:48:51.624945966 +0000 UTC m=+69.912192749" watchObservedRunningTime="2026-05-21 01:48:51.625097777 +0000 UTC m=+69.912344555"
May 21 01:48:51.730616 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:51.730592    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0be9025-02e4-41be-8824-d6d2ae0efdb5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-9cxjs\" (UID: \"f0be9025-02e4-41be-8824-d6d2ae0efdb5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-9cxjs"
May 21 01:48:51.730760 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:51.730744    2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 21 01:48:51.730839 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:51.730825    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0be9025-02e4-41be-8824-d6d2ae0efdb5-samples-operator-tls podName:f0be9025-02e4-41be-8824-d6d2ae0efdb5 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:59.730805737 +0000 UTC m=+78.018052494 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f0be9025-02e4-41be-8824-d6d2ae0efdb5-samples-operator-tls") pod "cluster-samples-operator-697587599-9cxjs" (UID: "f0be9025-02e4-41be-8824-d6d2ae0efdb5") : secret "samples-operator-tls" not found
May 21 01:48:51.831127 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:51.831069    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-registry-tls\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:51.831206 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:51.831166    2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 01:48:51.831206 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:51.831176    2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bcb44468d-kzbm2: secret "image-registry-tls" not found
May 21 01:48:51.831272 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:51.831212    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-registry-tls podName:5a234f24-ca45-477a-9bac-38fe001042d6 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:59.831202403 +0000 UTC m=+78.118449158 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-registry-tls") pod "image-registry-bcb44468d-kzbm2" (UID: "5a234f24-ca45-477a-9bac-38fe001042d6") : secret "image-registry-tls" not found
May 21 01:48:54.384964 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:54.384936    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-cgx9r"
May 21 01:48:54.384964 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:54.384963    2552 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-cgx9r"
May 21 01:48:54.385356 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:54.385246    2552 scope.go:117] "RemoveContainer" containerID="13c4da916cb53028d52d80d2c62f7ddef9c0c218ee7913d15cc71235cccbe7c7"
May 21 01:48:54.385403 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:48:54.385386    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-cgx9r_openshift-console-operator(3a1d53d4-c866-4375-a183-ecfaa11e9d0b)\"" pod="openshift-console-operator/console-operator-76dff48d59-cgx9r" podUID="3a1d53d4-c866-4375-a183-ecfaa11e9d0b"
May 21 01:48:59.789464 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:59.789434    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0be9025-02e4-41be-8824-d6d2ae0efdb5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-9cxjs\" (UID: \"f0be9025-02e4-41be-8824-d6d2ae0efdb5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-9cxjs"
May 21 01:48:59.791643 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:59.791612    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0be9025-02e4-41be-8824-d6d2ae0efdb5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-9cxjs\" (UID: \"f0be9025-02e4-41be-8824-d6d2ae0efdb5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-9cxjs"
May 21 01:48:59.879748 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:59.879722    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-9cxjs"
May 21 01:48:59.890478 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:59.890453    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-registry-tls\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:59.892846 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:59.892822    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-registry-tls\") pod \"image-registry-bcb44468d-kzbm2\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") " pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:48:59.992743 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:59.992718    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-9cxjs"]
May 21 01:48:59.994802 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:48:59.994778    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:49:00.113275 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:00.113247    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bcb44468d-kzbm2"]
May 21 01:49:00.116358 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:49:00.116327    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a234f24_ca45_477a_9bac_38fe001042d6.slice/crio-43b2f9c02c076118702b31d3b94326b207a368c3c6b79ff913c05220d1d01c6d WatchSource:0}: Error finding container 43b2f9c02c076118702b31d3b94326b207a368c3c6b79ff913c05220d1d01c6d: Status 404 returned error can't find the container with id 43b2f9c02c076118702b31d3b94326b207a368c3c6b79ff913c05220d1d01c6d
May 21 01:49:00.632074 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:00.630584    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bcb44468d-kzbm2" event={"ID":"5a234f24-ca45-477a-9bac-38fe001042d6","Type":"ContainerStarted","Data":"253c33f1e838c7b429238c25f7b6bd47adb5ae65b2d1a420cfde3023ad9b422d"}
May 21 01:49:00.632074 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:00.630652    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bcb44468d-kzbm2" event={"ID":"5a234f24-ca45-477a-9bac-38fe001042d6","Type":"ContainerStarted","Data":"43b2f9c02c076118702b31d3b94326b207a368c3c6b79ff913c05220d1d01c6d"}
May 21 01:49:00.632074 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:00.631222    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:49:00.632563 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:00.632510    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-9cxjs" event={"ID":"f0be9025-02e4-41be-8824-d6d2ae0efdb5","Type":"ContainerStarted","Data":"fed73b29aa36040abf94cb29fe20df0199a43f923576fe63844ec0b2b7bf873c"}
May 21 01:49:00.650884 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:00.650842    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-bcb44468d-kzbm2" podStartSLOduration=16.650827777 podStartE2EDuration="16.650827777s" podCreationTimestamp="2026-05-21 01:48:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 01:49:00.649903548 +0000 UTC m=+78.937150326" watchObservedRunningTime="2026-05-21 01:49:00.650827777 +0000 UTC m=+78.938074581"
May 21 01:49:02.638345 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:02.638307    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-9cxjs" event={"ID":"f0be9025-02e4-41be-8824-d6d2ae0efdb5","Type":"ContainerStarted","Data":"f8f8fd0a0766e84103fb763e22071f6d0e5b4add8ca2dcabbf0752ed56a5a30e"}
May 21 01:49:02.638345 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:02.638340    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-9cxjs" event={"ID":"f0be9025-02e4-41be-8824-d6d2ae0efdb5","Type":"ContainerStarted","Data":"47312e3d5e9e816f2c70c421de8db9bbda42acd935fab7a45ef126e25a3882b2"}
May 21 01:49:02.653380 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:02.653323    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-9cxjs" podStartSLOduration=18.100210711 podStartE2EDuration="19.653308785s" podCreationTimestamp="2026-05-21 01:48:43 +0000 UTC" firstStartedPulling="2026-05-21 01:49:00.033507625 +0000 UTC m=+78.320754380" lastFinishedPulling="2026-05-21 01:49:01.586605696 +0000 UTC m=+79.873852454" observedRunningTime="2026-05-21 01:49:02.653176017 +0000 UTC m=+80.940422795" watchObservedRunningTime="2026-05-21 01:49:02.653308785 +0000 UTC m=+80.940555563"
May 21 01:49:06.320911 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:06.320882    2552 scope.go:117] "RemoveContainer" containerID="13c4da916cb53028d52d80d2c62f7ddef9c0c218ee7913d15cc71235cccbe7c7"
May 21 01:49:06.648308 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:06.648249    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cgx9r_3a1d53d4-c866-4375-a183-ecfaa11e9d0b/console-operator/2.log"
May 21 01:49:06.648657 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:06.648641    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cgx9r_3a1d53d4-c866-4375-a183-ecfaa11e9d0b/console-operator/1.log"
May 21 01:49:06.648708 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:06.648674    2552 generic.go:358] "Generic (PLEG): container finished" podID="3a1d53d4-c866-4375-a183-ecfaa11e9d0b" containerID="aab69ee8da9be2122d847bb449c27f7cfe15dbaa4301542cfbc2d9a74ead922a" exitCode=255
May 21 01:49:06.648743 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:06.648719    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-cgx9r" event={"ID":"3a1d53d4-c866-4375-a183-ecfaa11e9d0b","Type":"ContainerDied","Data":"aab69ee8da9be2122d847bb449c27f7cfe15dbaa4301542cfbc2d9a74ead922a"}
May 21 01:49:06.648776 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:06.648746    2552 scope.go:117] "RemoveContainer" containerID="13c4da916cb53028d52d80d2c62f7ddef9c0c218ee7913d15cc71235cccbe7c7"
May 21 01:49:06.649077 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:06.649062    2552 scope.go:117] "RemoveContainer" containerID="aab69ee8da9be2122d847bb449c27f7cfe15dbaa4301542cfbc2d9a74ead922a"
May 21 01:49:06.649255 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:49:06.649225    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-cgx9r_openshift-console-operator(3a1d53d4-c866-4375-a183-ecfaa11e9d0b)\"" pod="openshift-console-operator/console-operator-76dff48d59-cgx9r" podUID="3a1d53d4-c866-4375-a183-ecfaa11e9d0b"
May 21 01:49:07.652758 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:07.652731    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cgx9r_3a1d53d4-c866-4375-a183-ecfaa11e9d0b/console-operator/2.log"
May 21 01:49:12.533779 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.533746    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-45zcp"]
May 21 01:49:12.537943 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.537924    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-45zcp"
May 21 01:49:12.540261 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.540241    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xzj4n\""
May 21 01:49:12.541634 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.541611    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 21 01:49:12.541791 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.541772    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 21 01:49:12.542787 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.542771    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bcb44468d-kzbm2"]
May 21 01:49:12.546447 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.546411    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-n8lc5"]
May 21 01:49:12.549771 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.549752    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-45zcp"]
May 21 01:49:12.549865 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.549846    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n8lc5"
May 21 01:49:12.552503 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.552487    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 21 01:49:12.552913 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.552802    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pnbl7\""
May 21 01:49:12.552913 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.552819    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 21 01:49:12.559740 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.559720    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n8lc5"]
May 21 01:49:12.575209 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.575185    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9445cc9fd-5pns8"]
May 21 01:49:12.577993 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.577975    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.591019 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.591000    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9445cc9fd-5pns8"]
May 21 01:49:12.678780 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.678760    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c5416ce-b7f8-4361-82d8-5fc911786d0f-registry-tls\") pod \"image-registry-9445cc9fd-5pns8\" (UID: \"4c5416ce-b7f8-4361-82d8-5fc911786d0f\") " pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.678900 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.678804    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c5416ce-b7f8-4361-82d8-5fc911786d0f-trusted-ca\") pod \"image-registry-9445cc9fd-5pns8\" (UID: \"4c5416ce-b7f8-4361-82d8-5fc911786d0f\") " pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.678900 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.678826    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4f2e354c-ffc1-4e58-bd46-9da06b775bfe-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-45zcp\" (UID: \"4f2e354c-ffc1-4e58-bd46-9da06b775bfe\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-45zcp"
May 21 01:49:12.678900 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.678856    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0933cbc7-7406-4c3e-9a83-9fc541f11c95-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n8lc5\" (UID: \"0933cbc7-7406-4c3e-9a83-9fc541f11c95\") " pod="openshift-insights/insights-runtime-extractor-n8lc5"
May 21 01:49:12.678900 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.678898    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ssm5\" (UniqueName: \"kubernetes.io/projected/0933cbc7-7406-4c3e-9a83-9fc541f11c95-kube-api-access-7ssm5\") pod \"insights-runtime-extractor-n8lc5\" (UID: \"0933cbc7-7406-4c3e-9a83-9fc541f11c95\") " pod="openshift-insights/insights-runtime-extractor-n8lc5"
May 21 01:49:12.679077 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.678951    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0933cbc7-7406-4c3e-9a83-9fc541f11c95-crio-socket\") pod \"insights-runtime-extractor-n8lc5\" (UID: \"0933cbc7-7406-4c3e-9a83-9fc541f11c95\") " pod="openshift-insights/insights-runtime-extractor-n8lc5"
May 21 01:49:12.679077 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.678974    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c5416ce-b7f8-4361-82d8-5fc911786d0f-installation-pull-secrets\") pod \"image-registry-9445cc9fd-5pns8\" (UID: \"4c5416ce-b7f8-4361-82d8-5fc911786d0f\") " pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.679077 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.679005    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c5416ce-b7f8-4361-82d8-5fc911786d0f-ca-trust-extracted\") pod \"image-registry-9445cc9fd-5pns8\" (UID: \"4c5416ce-b7f8-4361-82d8-5fc911786d0f\") " pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.679077 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.679029    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0933cbc7-7406-4c3e-9a83-9fc541f11c95-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n8lc5\" (UID: \"0933cbc7-7406-4c3e-9a83-9fc541f11c95\") " pod="openshift-insights/insights-runtime-extractor-n8lc5"
May 21 01:49:12.679288 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.679083    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c5416ce-b7f8-4361-82d8-5fc911786d0f-bound-sa-token\") pod \"image-registry-9445cc9fd-5pns8\" (UID: \"4c5416ce-b7f8-4361-82d8-5fc911786d0f\") " pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.679288 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.679131    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c5416ce-b7f8-4361-82d8-5fc911786d0f-registry-certificates\") pod \"image-registry-9445cc9fd-5pns8\" (UID: \"4c5416ce-b7f8-4361-82d8-5fc911786d0f\") " pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.679288 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.679163    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c5416ce-b7f8-4361-82d8-5fc911786d0f-image-registry-private-configuration\") pod \"image-registry-9445cc9fd-5pns8\" (UID: \"4c5416ce-b7f8-4361-82d8-5fc911786d0f\") " pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.679288 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.679206    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdxgv\" (UniqueName: \"kubernetes.io/projected/4c5416ce-b7f8-4361-82d8-5fc911786d0f-kube-api-access-vdxgv\") pod \"image-registry-9445cc9fd-5pns8\" (UID: \"4c5416ce-b7f8-4361-82d8-5fc911786d0f\") " pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.679288 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.679251    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4f2e354c-ffc1-4e58-bd46-9da06b775bfe-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-45zcp\" (UID: \"4f2e354c-ffc1-4e58-bd46-9da06b775bfe\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-45zcp"
May 21 01:49:12.679288 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.679277    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0933cbc7-7406-4c3e-9a83-9fc541f11c95-data-volume\") pod \"insights-runtime-extractor-n8lc5\" (UID: \"0933cbc7-7406-4c3e-9a83-9fc541f11c95\") " pod="openshift-insights/insights-runtime-extractor-n8lc5"
May 21 01:49:12.779884 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.779860    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c5416ce-b7f8-4361-82d8-5fc911786d0f-bound-sa-token\") pod \"image-registry-9445cc9fd-5pns8\" (UID: \"4c5416ce-b7f8-4361-82d8-5fc911786d0f\") " pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.779990 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.779893    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c5416ce-b7f8-4361-82d8-5fc911786d0f-registry-certificates\") pod \"image-registry-9445cc9fd-5pns8\" (UID: \"4c5416ce-b7f8-4361-82d8-5fc911786d0f\") " pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.779990 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.779917    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c5416ce-b7f8-4361-82d8-5fc911786d0f-image-registry-private-configuration\") pod \"image-registry-9445cc9fd-5pns8\" (UID: \"4c5416ce-b7f8-4361-82d8-5fc911786d0f\") " pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.779990 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.779954    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vdxgv\" (UniqueName: \"kubernetes.io/projected/4c5416ce-b7f8-4361-82d8-5fc911786d0f-kube-api-access-vdxgv\") pod \"image-registry-9445cc9fd-5pns8\" (UID: \"4c5416ce-b7f8-4361-82d8-5fc911786d0f\") " pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.779990 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.779981    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4f2e354c-ffc1-4e58-bd46-9da06b775bfe-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-45zcp\" (UID: \"4f2e354c-ffc1-4e58-bd46-9da06b775bfe\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-45zcp"
May 21 01:49:12.780188 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.780005    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0933cbc7-7406-4c3e-9a83-9fc541f11c95-data-volume\") pod \"insights-runtime-extractor-n8lc5\" (UID: \"0933cbc7-7406-4c3e-9a83-9fc541f11c95\") " pod="openshift-insights/insights-runtime-extractor-n8lc5"
May 21 01:49:12.780188 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.780029    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c5416ce-b7f8-4361-82d8-5fc911786d0f-registry-tls\") pod \"image-registry-9445cc9fd-5pns8\" (UID: \"4c5416ce-b7f8-4361-82d8-5fc911786d0f\") " pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.780288 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.780191    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c5416ce-b7f8-4361-82d8-5fc911786d0f-trusted-ca\") pod \"image-registry-9445cc9fd-5pns8\" (UID: \"4c5416ce-b7f8-4361-82d8-5fc911786d0f\") " pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.780288 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.780231    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4f2e354c-ffc1-4e58-bd46-9da06b775bfe-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-45zcp\" (UID: \"4f2e354c-ffc1-4e58-bd46-9da06b775bfe\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-45zcp"
May 21 01:49:12.781043 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.780437    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0933cbc7-7406-4c3e-9a83-9fc541f11c95-data-volume\") pod \"insights-runtime-extractor-n8lc5\" (UID: \"0933cbc7-7406-4c3e-9a83-9fc541f11c95\") " pod="openshift-insights/insights-runtime-extractor-n8lc5"
May 21 01:49:12.781043 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.780438    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0933cbc7-7406-4c3e-9a83-9fc541f11c95-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n8lc5\" (UID: \"0933cbc7-7406-4c3e-9a83-9fc541f11c95\") " pod="openshift-insights/insights-runtime-extractor-n8lc5"
May 21 01:49:12.781043 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.780515    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ssm5\" (UniqueName: \"kubernetes.io/projected/0933cbc7-7406-4c3e-9a83-9fc541f11c95-kube-api-access-7ssm5\") pod \"insights-runtime-extractor-n8lc5\" (UID: \"0933cbc7-7406-4c3e-9a83-9fc541f11c95\") " pod="openshift-insights/insights-runtime-extractor-n8lc5"
May 21 01:49:12.781043 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.780584    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0933cbc7-7406-4c3e-9a83-9fc541f11c95-crio-socket\") pod \"insights-runtime-extractor-n8lc5\" (UID: \"0933cbc7-7406-4c3e-9a83-9fc541f11c95\") " pod="openshift-insights/insights-runtime-extractor-n8lc5"
May 21 01:49:12.781043 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.780617    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c5416ce-b7f8-4361-82d8-5fc911786d0f-installation-pull-secrets\") pod \"image-registry-9445cc9fd-5pns8\" (UID: \"4c5416ce-b7f8-4361-82d8-5fc911786d0f\") " pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.781043 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.780656    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c5416ce-b7f8-4361-82d8-5fc911786d0f-ca-trust-extracted\") pod \"image-registry-9445cc9fd-5pns8\" (UID: \"4c5416ce-b7f8-4361-82d8-5fc911786d0f\") " pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.781043 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.780684    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0933cbc7-7406-4c3e-9a83-9fc541f11c95-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n8lc5\" (UID: \"0933cbc7-7406-4c3e-9a83-9fc541f11c95\") " pod="openshift-insights/insights-runtime-extractor-n8lc5"
May 21 01:49:12.781043 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.780815    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4f2e354c-ffc1-4e58-bd46-9da06b775bfe-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-45zcp\" (UID: \"4f2e354c-ffc1-4e58-bd46-9da06b775bfe\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-45zcp"
May 21 01:49:12.781043 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.780893    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0933cbc7-7406-4c3e-9a83-9fc541f11c95-crio-socket\") pod \"insights-runtime-extractor-n8lc5\" (UID: \"0933cbc7-7406-4c3e-9a83-9fc541f11c95\") " pod="openshift-insights/insights-runtime-extractor-n8lc5"
May 21 01:49:12.781043 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.780956    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c5416ce-b7f8-4361-82d8-5fc911786d0f-registry-certificates\") pod \"image-registry-9445cc9fd-5pns8\" (UID: \"4c5416ce-b7f8-4361-82d8-5fc911786d0f\") " pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.781043 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.780956    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0933cbc7-7406-4c3e-9a83-9fc541f11c95-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n8lc5\" (UID: \"0933cbc7-7406-4c3e-9a83-9fc541f11c95\") " pod="openshift-insights/insights-runtime-extractor-n8lc5"
May 21 01:49:12.781672 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.781216    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c5416ce-b7f8-4361-82d8-5fc911786d0f-trusted-ca\") pod \"image-registry-9445cc9fd-5pns8\" (UID: \"4c5416ce-b7f8-4361-82d8-5fc911786d0f\") " pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.781672 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.781284    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c5416ce-b7f8-4361-82d8-5fc911786d0f-ca-trust-extracted\") pod \"image-registry-9445cc9fd-5pns8\" (UID: \"4c5416ce-b7f8-4361-82d8-5fc911786d0f\") " pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.782782 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.782756    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c5416ce-b7f8-4361-82d8-5fc911786d0f-image-registry-private-configuration\") pod \"image-registry-9445cc9fd-5pns8\" (UID: \"4c5416ce-b7f8-4361-82d8-5fc911786d0f\") " pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.783084 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.783061    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c5416ce-b7f8-4361-82d8-5fc911786d0f-registry-tls\") pod \"image-registry-9445cc9fd-5pns8\" (UID: \"4c5416ce-b7f8-4361-82d8-5fc911786d0f\") " pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.783170 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.783062    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4f2e354c-ffc1-4e58-bd46-9da06b775bfe-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-45zcp\" (UID: \"4f2e354c-ffc1-4e58-bd46-9da06b775bfe\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-45zcp"
May 21 01:49:12.783170 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.783095    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0933cbc7-7406-4c3e-9a83-9fc541f11c95-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n8lc5\" (UID: \"0933cbc7-7406-4c3e-9a83-9fc541f11c95\") " pod="openshift-insights/insights-runtime-extractor-n8lc5"
May 21 01:49:12.783235 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.783211    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c5416ce-b7f8-4361-82d8-5fc911786d0f-installation-pull-secrets\") pod \"image-registry-9445cc9fd-5pns8\" (UID: \"4c5416ce-b7f8-4361-82d8-5fc911786d0f\") " pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.787342 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.787278    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c5416ce-b7f8-4361-82d8-5fc911786d0f-bound-sa-token\") pod \"image-registry-9445cc9fd-5pns8\" (UID: \"4c5416ce-b7f8-4361-82d8-5fc911786d0f\") " pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.788098 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.788075    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdxgv\" (UniqueName: \"kubernetes.io/projected/4c5416ce-b7f8-4361-82d8-5fc911786d0f-kube-api-access-vdxgv\") pod \"image-registry-9445cc9fd-5pns8\" (UID: \"4c5416ce-b7f8-4361-82d8-5fc911786d0f\") " pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.788262 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.788244    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ssm5\" (UniqueName: \"kubernetes.io/projected/0933cbc7-7406-4c3e-9a83-9fc541f11c95-kube-api-access-7ssm5\") pod \"insights-runtime-extractor-n8lc5\" (UID: \"0933cbc7-7406-4c3e-9a83-9fc541f11c95\") " pod="openshift-insights/insights-runtime-extractor-n8lc5"
May 21 01:49:12.847663 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.847642    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-45zcp"
May 21 01:49:12.859226 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.859206    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n8lc5"
May 21 01:49:12.886055 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.886010    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:12.987028 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:12.986987    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-45zcp"]
May 21 01:49:12.991113 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:49:12.991087    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f2e354c_ffc1_4e58_bd46_9da06b775bfe.slice/crio-70ce915e4a2e56407d8c010447f3d0b0ff8a5aee40ae915019c43a1d376c7913 WatchSource:0}: Error finding container 70ce915e4a2e56407d8c010447f3d0b0ff8a5aee40ae915019c43a1d376c7913: Status 404 returned error can't find the container with id 70ce915e4a2e56407d8c010447f3d0b0ff8a5aee40ae915019c43a1d376c7913
May 21 01:49:13.006300 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:13.006275    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n8lc5"]
May 21 01:49:13.009516 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:49:13.009487    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0933cbc7_7406_4c3e_9a83_9fc541f11c95.slice/crio-e0538438fbc03b06da420c4f74167d8345b29798afcc346123d23ac6416b3fd2 WatchSource:0}: Error finding container e0538438fbc03b06da420c4f74167d8345b29798afcc346123d23ac6416b3fd2: Status 404 returned error can't find the container with id e0538438fbc03b06da420c4f74167d8345b29798afcc346123d23ac6416b3fd2
May 21 01:49:13.032908 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:13.032887    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9445cc9fd-5pns8"]
May 21 01:49:13.035705 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:49:13.035677    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c5416ce_b7f8_4361_82d8_5fc911786d0f.slice/crio-81dbda93b0a225ead93d13f0a4937d3d227e2fb5d6f1bf16b831022de625a665 WatchSource:0}: Error finding container 81dbda93b0a225ead93d13f0a4937d3d227e2fb5d6f1bf16b831022de625a665: Status 404 returned error can't find the container with id 81dbda93b0a225ead93d13f0a4937d3d227e2fb5d6f1bf16b831022de625a665
May 21 01:49:13.671611 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:13.671539    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9445cc9fd-5pns8" event={"ID":"4c5416ce-b7f8-4361-82d8-5fc911786d0f","Type":"ContainerStarted","Data":"3faed11d930eb8188a54f3b8831178fc478c0060144d541d0ac59a5f6e799817"}
May 21 01:49:13.671611 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:13.671600    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9445cc9fd-5pns8" event={"ID":"4c5416ce-b7f8-4361-82d8-5fc911786d0f","Type":"ContainerStarted","Data":"81dbda93b0a225ead93d13f0a4937d3d227e2fb5d6f1bf16b831022de625a665"}
May 21 01:49:13.672101 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:13.671695    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:13.673093 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:13.673063    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n8lc5" event={"ID":"0933cbc7-7406-4c3e-9a83-9fc541f11c95","Type":"ContainerStarted","Data":"6aa91be5a6cf312b705515502f677af3179073cce9a572727865a6d5d7a2fecb"}
May 21 01:49:13.673239 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:13.673094    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n8lc5" event={"ID":"0933cbc7-7406-4c3e-9a83-9fc541f11c95","Type":"ContainerStarted","Data":"e0538438fbc03b06da420c4f74167d8345b29798afcc346123d23ac6416b3fd2"}
May 21 01:49:13.674082 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:13.674059    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-45zcp" event={"ID":"4f2e354c-ffc1-4e58-bd46-9da06b775bfe","Type":"ContainerStarted","Data":"70ce915e4a2e56407d8c010447f3d0b0ff8a5aee40ae915019c43a1d376c7913"}
May 21 01:49:13.690483 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:13.690432    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-9445cc9fd-5pns8" podStartSLOduration=1.6904136090000002 podStartE2EDuration="1.690413609s" podCreationTimestamp="2026-05-21 01:49:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 01:49:13.68902628 +0000 UTC m=+91.976273057" watchObservedRunningTime="2026-05-21 01:49:13.690413609 +0000 UTC m=+91.977660386"
May 21 01:49:14.384853 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:14.384821    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-cgx9r"
May 21 01:49:14.385001 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:14.384860    2552 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-cgx9r"
May 21 01:49:14.385196 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:14.385175    2552 scope.go:117] "RemoveContainer" containerID="aab69ee8da9be2122d847bb449c27f7cfe15dbaa4301542cfbc2d9a74ead922a"
May 21 01:49:14.385374 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:49:14.385349    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-cgx9r_openshift-console-operator(3a1d53d4-c866-4375-a183-ecfaa11e9d0b)\"" pod="openshift-console-operator/console-operator-76dff48d59-cgx9r" podUID="3a1d53d4-c866-4375-a183-ecfaa11e9d0b"
May 21 01:49:14.678605 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:14.678507    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n8lc5" event={"ID":"0933cbc7-7406-4c3e-9a83-9fc541f11c95","Type":"ContainerStarted","Data":"eb9f102e05703fcea3a641734b0c44d5f91d62c2cf9e67b46683552b5539b370"}
May 21 01:49:14.680082 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:14.680035    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-45zcp" event={"ID":"4f2e354c-ffc1-4e58-bd46-9da06b775bfe","Type":"ContainerStarted","Data":"af57fba5b270749b50f748a22f42ea05f1f338c1de5eeab539bfe99775c04fca"}
May 21 01:49:14.694353 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:14.694311    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-45zcp" podStartSLOduration=1.746754429 podStartE2EDuration="2.694297712s" podCreationTimestamp="2026-05-21 01:49:12 +0000 UTC" firstStartedPulling="2026-05-21 01:49:12.993481607 +0000 UTC m=+91.280728366" lastFinishedPulling="2026-05-21 01:49:13.941024891 +0000 UTC m=+92.228271649" observedRunningTime="2026-05-21 01:49:14.693415205 +0000 UTC m=+92.980661982" watchObservedRunningTime="2026-05-21 01:49:14.694297712 +0000 UTC m=+92.981544486"
May 21 01:49:15.684596 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:15.684567    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n8lc5" event={"ID":"0933cbc7-7406-4c3e-9a83-9fc541f11c95","Type":"ContainerStarted","Data":"d383aba1aac3925396486b40b649b2dd2c4808a9620adc19a31729a57e24b80d"}
May 21 01:49:15.702790 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:15.702741    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-n8lc5" podStartSLOduration=1.665496793 podStartE2EDuration="3.702728745s" podCreationTimestamp="2026-05-21 01:49:12 +0000 UTC" firstStartedPulling="2026-05-21 01:49:13.071025927 +0000 UTC m=+91.358272682" lastFinishedPulling="2026-05-21 01:49:15.108257878 +0000 UTC m=+93.395504634" observedRunningTime="2026-05-21 01:49:15.70140821 +0000 UTC m=+93.988654993" watchObservedRunningTime="2026-05-21 01:49:15.702728745 +0000 UTC m=+93.989975522"
May 21 01:49:18.453526 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:18.453496    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lxwgf"]
May 21 01:49:18.456870 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:18.456847    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lxwgf"
May 21 01:49:18.460508 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:18.460487    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-rdbgn\""
May 21 01:49:18.460597 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:18.460506    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 21 01:49:18.463686 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:18.463666    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lxwgf"]
May 21 01:49:18.523777 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:18.523750    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/21c7c3fa-0919-4d6e-b3e2-d5f9498b056c-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-lxwgf\" (UID: \"21c7c3fa-0919-4d6e-b3e2-d5f9498b056c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lxwgf"
May 21 01:49:18.624297 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:18.624259    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/21c7c3fa-0919-4d6e-b3e2-d5f9498b056c-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-lxwgf\" (UID: \"21c7c3fa-0919-4d6e-b3e2-d5f9498b056c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lxwgf"
May 21 01:49:18.626346 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:18.626328    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/21c7c3fa-0919-4d6e-b3e2-d5f9498b056c-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-lxwgf\" (UID: \"21c7c3fa-0919-4d6e-b3e2-d5f9498b056c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lxwgf"
May 21 01:49:18.765656 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:18.765635    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lxwgf"
May 21 01:49:18.881326 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:18.881272    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lxwgf"]
May 21 01:49:18.884181 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:49:18.884154    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c7c3fa_0919_4d6e_b3e2_d5f9498b056c.slice/crio-8a944c274833cc6a057c5768ef5a956cb233327525f73a204a13e50742e862c2 WatchSource:0}: Error finding container 8a944c274833cc6a057c5768ef5a956cb233327525f73a204a13e50742e862c2: Status 404 returned error can't find the container with id 8a944c274833cc6a057c5768ef5a956cb233327525f73a204a13e50742e862c2
May 21 01:49:19.430665 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:19.430623    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-cert\") pod \"ingress-canary-748dc\" (UID: \"0d7dcaae-df99-4c98-a24b-a13f5cad4b75\") " pod="openshift-ingress-canary/ingress-canary-748dc"
May 21 01:49:19.433141 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:19.433116    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d7dcaae-df99-4c98-a24b-a13f5cad4b75-cert\") pod \"ingress-canary-748dc\" (UID: \"0d7dcaae-df99-4c98-a24b-a13f5cad4b75\") " pod="openshift-ingress-canary/ingress-canary-748dc"
May 21 01:49:19.497697 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:19.497671    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bvhf9\""
May 21 01:49:19.505954 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:19.505925    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-748dc"
May 21 01:49:19.531808 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:19.531780    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-metrics-tls\") pod \"dns-default-msfwg\" (UID: \"7309acd7-d8d3-4e93-9eee-df1cbc2af69e\") " pod="openshift-dns/dns-default-msfwg"
May 21 01:49:19.534114 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:19.534084    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7309acd7-d8d3-4e93-9eee-df1cbc2af69e-metrics-tls\") pod \"dns-default-msfwg\" (UID: \"7309acd7-d8d3-4e93-9eee-df1cbc2af69e\") " pod="openshift-dns/dns-default-msfwg"
May 21 01:49:19.639689 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:19.639661    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-748dc"]
May 21 01:49:19.695764 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:19.695722    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lxwgf" event={"ID":"21c7c3fa-0919-4d6e-b3e2-d5f9498b056c","Type":"ContainerStarted","Data":"8a944c274833cc6a057c5768ef5a956cb233327525f73a204a13e50742e862c2"}
May 21 01:49:19.822447 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:19.822419    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qjjsz\""
May 21 01:49:19.829676 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:19.829650    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-msfwg"
May 21 01:49:19.876010 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:49:19.875955    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d7dcaae_df99_4c98_a24b_a13f5cad4b75.slice/crio-7ea4dd660c417affba78b5b5c188b8062273ed0ea8dee90d0fd269c1b4dc4571 WatchSource:0}: Error finding container 7ea4dd660c417affba78b5b5c188b8062273ed0ea8dee90d0fd269c1b4dc4571: Status 404 returned error can't find the container with id 7ea4dd660c417affba78b5b5c188b8062273ed0ea8dee90d0fd269c1b4dc4571
May 21 01:49:19.992677 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:19.992627    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-msfwg"]
May 21 01:49:20.063356 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:49:20.063324    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7309acd7_d8d3_4e93_9eee_df1cbc2af69e.slice/crio-437720b0be4fe5654f5a88c76048332d0cc34e1b0d7b060fa97e6faa30d02ba2 WatchSource:0}: Error finding container 437720b0be4fe5654f5a88c76048332d0cc34e1b0d7b060fa97e6faa30d02ba2: Status 404 returned error can't find the container with id 437720b0be4fe5654f5a88c76048332d0cc34e1b0d7b060fa97e6faa30d02ba2
May 21 01:49:20.701064 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:20.701005    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lxwgf" event={"ID":"21c7c3fa-0919-4d6e-b3e2-d5f9498b056c","Type":"ContainerStarted","Data":"dea7c8978bdd97a9b8c82be00bd24f1823a7a7d05fa10b5aba6d97bae4972be0"}
May 21 01:49:20.701510 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:20.701307    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lxwgf"
May 21 01:49:20.702499 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:20.702460    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-msfwg" event={"ID":"7309acd7-d8d3-4e93-9eee-df1cbc2af69e","Type":"ContainerStarted","Data":"437720b0be4fe5654f5a88c76048332d0cc34e1b0d7b060fa97e6faa30d02ba2"}
May 21 01:49:20.703777 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:20.703751    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-748dc" event={"ID":"0d7dcaae-df99-4c98-a24b-a13f5cad4b75","Type":"ContainerStarted","Data":"7ea4dd660c417affba78b5b5c188b8062273ed0ea8dee90d0fd269c1b4dc4571"}
May 21 01:49:20.706741 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:20.706718    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lxwgf"
May 21 01:49:20.716314 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:20.716265    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-lxwgf" podStartSLOduration=1.5106592989999998 podStartE2EDuration="2.716250375s" podCreationTimestamp="2026-05-21 01:49:18 +0000 UTC" firstStartedPulling="2026-05-21 01:49:18.88603135 +0000 UTC m=+97.173278105" lastFinishedPulling="2026-05-21 01:49:20.091622425 +0000 UTC m=+98.378869181" observedRunningTime="2026-05-21 01:49:20.714636442 +0000 UTC m=+99.001883230" watchObservedRunningTime="2026-05-21 01:49:20.716250375 +0000 UTC m=+99.003497151"
May 21 01:49:22.548289 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:22.548259    2552 patch_prober.go:28] interesting pod/image-registry-bcb44468d-kzbm2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 21 01:49:22.548664 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:22.548303    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-bcb44468d-kzbm2" podUID="5a234f24-ca45-477a-9bac-38fe001042d6" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 21 01:49:22.615110 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:22.615085    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6ld5n"
May 21 01:49:22.710914 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:22.710835    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-msfwg" event={"ID":"7309acd7-d8d3-4e93-9eee-df1cbc2af69e","Type":"ContainerStarted","Data":"0e87b07d2d274add56582d73d2cced36dff7ba56cea09cb66f81ee8d9d4e53f5"}
May 21 01:49:22.710914 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:22.710879    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-msfwg" event={"ID":"7309acd7-d8d3-4e93-9eee-df1cbc2af69e","Type":"ContainerStarted","Data":"6f2d924ec10a92d448c6b030b751fd2e9f03f9c6cb0ae94490d868535d22c6e8"}
May 21 01:49:22.711105 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:22.711052    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-msfwg"
May 21 01:49:22.712132 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:22.712110    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-748dc" event={"ID":"0d7dcaae-df99-4c98-a24b-a13f5cad4b75","Type":"ContainerStarted","Data":"a0856d2f888eaa64c1bd14805cfbf963206ab3e66eb86369107ef8951db84791"}
May 21 01:49:22.728188 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:22.728151    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-msfwg" podStartSLOduration=65.685759751 podStartE2EDuration="1m7.728139466s" podCreationTimestamp="2026-05-21 01:48:15 +0000 UTC" firstStartedPulling="2026-05-21 01:49:20.08843332 +0000 UTC m=+98.375680089" lastFinishedPulling="2026-05-21 01:49:22.130813049 +0000 UTC m=+100.418059804" observedRunningTime="2026-05-21 01:49:22.727949769 +0000 UTC m=+101.015196557" watchObservedRunningTime="2026-05-21 01:49:22.728139466 +0000 UTC m=+101.015386243"
May 21 01:49:22.742570 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:22.742522    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-748dc" podStartSLOduration=65.493941268 podStartE2EDuration="1m7.742510883s" podCreationTimestamp="2026-05-21 01:48:15 +0000 UTC" firstStartedPulling="2026-05-21 01:49:19.878607526 +0000 UTC m=+98.165854281" lastFinishedPulling="2026-05-21 01:49:22.127177124 +0000 UTC m=+100.414423896" observedRunningTime="2026-05-21 01:49:22.741734666 +0000 UTC m=+101.028981443" watchObservedRunningTime="2026-05-21 01:49:22.742510883 +0000 UTC m=+101.029757700"
May 21 01:49:25.846988 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.846956    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-wkvdh"]
May 21 01:49:25.849137 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.849112    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-wkvdh"
May 21 01:49:25.851449 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.851425    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 21 01:49:25.851914 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.851897    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-bfz52\""
May 21 01:49:25.851914 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.851905    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 21 01:49:25.852956 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.852935    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 21 01:49:25.852956 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.852953    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 21 01:49:25.853106 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.853026    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 21 01:49:25.861659 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.861638    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-wkvdh"]
May 21 01:49:25.871494 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.871472    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jwkbz"]
May 21 01:49:25.873646 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.873600    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:25.876075 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.876050    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 21 01:49:25.876075 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.876061    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bsgjt\""
May 21 01:49:25.876075 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.876075    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 21 01:49:25.876349 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.876332    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 21 01:49:25.979470 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.979451    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/669ca936-566e-4bd2-9518-580b2b801ca0-node-exporter-tls\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:25.979470 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.979476    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5jd8\" (UniqueName: \"kubernetes.io/projected/669ca936-566e-4bd2-9518-580b2b801ca0-kube-api-access-s5jd8\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:25.979643 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.979496    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27ac9d1b-8dee-43d8-bd76-71130a367415-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-wkvdh\" (UID: \"27ac9d1b-8dee-43d8-bd76-71130a367415\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wkvdh"
May 21 01:49:25.979643 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.979516    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/669ca936-566e-4bd2-9518-580b2b801ca0-sys\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:25.979643 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.979606    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9mg8\" (UniqueName: \"kubernetes.io/projected/27ac9d1b-8dee-43d8-bd76-71130a367415-kube-api-access-n9mg8\") pod \"openshift-state-metrics-9c959559f-wkvdh\" (UID: \"27ac9d1b-8dee-43d8-bd76-71130a367415\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wkvdh"
May 21 01:49:25.979643 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.979635    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/669ca936-566e-4bd2-9518-580b2b801ca0-node-exporter-wtmp\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:25.979768 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.979655    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/669ca936-566e-4bd2-9518-580b2b801ca0-root\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:25.979768 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.979670    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27ac9d1b-8dee-43d8-bd76-71130a367415-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-wkvdh\" (UID: \"27ac9d1b-8dee-43d8-bd76-71130a367415\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wkvdh"
May 21 01:49:25.979768 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.979688    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27ac9d1b-8dee-43d8-bd76-71130a367415-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-wkvdh\" (UID: \"27ac9d1b-8dee-43d8-bd76-71130a367415\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wkvdh"
May 21 01:49:25.979768 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.979707    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/669ca936-566e-4bd2-9518-580b2b801ca0-node-exporter-accelerators-collector-config\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:25.979768 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.979751    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/669ca936-566e-4bd2-9518-580b2b801ca0-metrics-client-ca\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:25.979909 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.979771    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/669ca936-566e-4bd2-9518-580b2b801ca0-node-exporter-textfile\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:25.979909 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:25.979786    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/669ca936-566e-4bd2-9518-580b2b801ca0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:26.080469 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.080442    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/669ca936-566e-4bd2-9518-580b2b801ca0-node-exporter-wtmp\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:26.080592 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.080472    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/669ca936-566e-4bd2-9518-580b2b801ca0-root\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:26.080592 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.080490    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27ac9d1b-8dee-43d8-bd76-71130a367415-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-wkvdh\" (UID: \"27ac9d1b-8dee-43d8-bd76-71130a367415\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wkvdh"
May 21 01:49:26.080592 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.080508    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27ac9d1b-8dee-43d8-bd76-71130a367415-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-wkvdh\" (UID: \"27ac9d1b-8dee-43d8-bd76-71130a367415\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wkvdh"
May 21 01:49:26.080592 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.080529    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/669ca936-566e-4bd2-9518-580b2b801ca0-node-exporter-accelerators-collector-config\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:26.080592 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.080575    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/669ca936-566e-4bd2-9518-580b2b801ca0-metrics-client-ca\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:26.080848 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.080584    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/669ca936-566e-4bd2-9518-580b2b801ca0-root\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:26.080848 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.080634    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/669ca936-566e-4bd2-9518-580b2b801ca0-node-exporter-wtmp\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:26.080984 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.080961    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/669ca936-566e-4bd2-9518-580b2b801ca0-node-exporter-textfile\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:26.081063 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.081003    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/669ca936-566e-4bd2-9518-580b2b801ca0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:26.081126 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.081078    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/669ca936-566e-4bd2-9518-580b2b801ca0-node-exporter-tls\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:26.081126 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.081104    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5jd8\" (UniqueName: \"kubernetes.io/projected/669ca936-566e-4bd2-9518-580b2b801ca0-kube-api-access-s5jd8\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:26.081233 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.081128    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27ac9d1b-8dee-43d8-bd76-71130a367415-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-wkvdh\" (UID: \"27ac9d1b-8dee-43d8-bd76-71130a367415\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wkvdh"
May 21 01:49:26.081233 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.081185    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/669ca936-566e-4bd2-9518-580b2b801ca0-node-exporter-accelerators-collector-config\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:26.081488 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.081465    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27ac9d1b-8dee-43d8-bd76-71130a367415-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-wkvdh\" (UID: \"27ac9d1b-8dee-43d8-bd76-71130a367415\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wkvdh"
May 21 01:49:26.081659 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.081298    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/669ca936-566e-4bd2-9518-580b2b801ca0-metrics-client-ca\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:26.081754 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.081736    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/669ca936-566e-4bd2-9518-580b2b801ca0-sys\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:26.081814 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.081737    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/669ca936-566e-4bd2-9518-580b2b801ca0-node-exporter-textfile\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:26.081899 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.081159    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/669ca936-566e-4bd2-9518-580b2b801ca0-sys\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:26.081951 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.081925    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n9mg8\" (UniqueName: \"kubernetes.io/projected/27ac9d1b-8dee-43d8-bd76-71130a367415-kube-api-access-n9mg8\") pod \"openshift-state-metrics-9c959559f-wkvdh\" (UID: \"27ac9d1b-8dee-43d8-bd76-71130a367415\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wkvdh"
May 21 01:49:26.083682 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.083634    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27ac9d1b-8dee-43d8-bd76-71130a367415-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-wkvdh\" (UID: \"27ac9d1b-8dee-43d8-bd76-71130a367415\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wkvdh"
May 21 01:49:26.084376 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.084351    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/669ca936-566e-4bd2-9518-580b2b801ca0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:26.084608 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.084579    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27ac9d1b-8dee-43d8-bd76-71130a367415-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-wkvdh\" (UID: \"27ac9d1b-8dee-43d8-bd76-71130a367415\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wkvdh"
May 21 01:49:26.084954 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.084934    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/669ca936-566e-4bd2-9518-580b2b801ca0-node-exporter-tls\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:26.088720 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.088695    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5jd8\" (UniqueName: \"kubernetes.io/projected/669ca936-566e-4bd2-9518-580b2b801ca0-kube-api-access-s5jd8\") pod \"node-exporter-jwkbz\" (UID: \"669ca936-566e-4bd2-9518-580b2b801ca0\") " pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:26.089158 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.089139    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9mg8\" (UniqueName: \"kubernetes.io/projected/27ac9d1b-8dee-43d8-bd76-71130a367415-kube-api-access-n9mg8\") pod \"openshift-state-metrics-9c959559f-wkvdh\" (UID: \"27ac9d1b-8dee-43d8-bd76-71130a367415\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wkvdh"
May 21 01:49:26.158164 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.158117    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-wkvdh"
May 21 01:49:26.181811 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.181788    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jwkbz"
May 21 01:49:26.189185 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:49:26.189156    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod669ca936_566e_4bd2_9518_580b2b801ca0.slice/crio-b3c635d99383fbad3b24167e9a2412207b4b93ebc2c1a40665689fec8950a983 WatchSource:0}: Error finding container b3c635d99383fbad3b24167e9a2412207b4b93ebc2c1a40665689fec8950a983: Status 404 returned error can't find the container with id b3c635d99383fbad3b24167e9a2412207b4b93ebc2c1a40665689fec8950a983
May 21 01:49:26.279477 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.279354    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-wkvdh"]
May 21 01:49:26.281711 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:49:26.281681    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ac9d1b_8dee_43d8_bd76_71130a367415.slice/crio-2a1d76660a004e81ad1bf7366990d5366d7c9256316c33da101db3add41f3fb5 WatchSource:0}: Error finding container 2a1d76660a004e81ad1bf7366990d5366d7c9256316c33da101db3add41f3fb5: Status 404 returned error can't find the container with id 2a1d76660a004e81ad1bf7366990d5366d7c9256316c33da101db3add41f3fb5
May 21 01:49:26.724362 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.724324    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jwkbz" event={"ID":"669ca936-566e-4bd2-9518-580b2b801ca0","Type":"ContainerStarted","Data":"b3c635d99383fbad3b24167e9a2412207b4b93ebc2c1a40665689fec8950a983"}
May 21 01:49:26.726153 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.726122    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-wkvdh" event={"ID":"27ac9d1b-8dee-43d8-bd76-71130a367415","Type":"ContainerStarted","Data":"87cab3859412ef5fa63efe1a1832f421695c41b47550aa4c17a228c9fa92b5ef"}
May 21 01:49:26.726295 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.726159    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-wkvdh" event={"ID":"27ac9d1b-8dee-43d8-bd76-71130a367415","Type":"ContainerStarted","Data":"e20043428649059d3c2f5bc8aee8a4ae0bd663bde82b1bac235c8d5fa3823c4b"}
May 21 01:49:26.726295 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.726175    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-wkvdh" event={"ID":"27ac9d1b-8dee-43d8-bd76-71130a367415","Type":"ContainerStarted","Data":"2a1d76660a004e81ad1bf7366990d5366d7c9256316c33da101db3add41f3fb5"}
May 21 01:49:26.934391 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.934359    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 01:49:26.939284 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.939249    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:26.943059 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.943032    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pvkgx\""
May 21 01:49:26.943318 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.943297    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 21 01:49:26.943459 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.943439    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 21 01:49:26.943526 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.943305    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 21 01:49:26.943673 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.943655    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 21 01:49:26.943820 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.943792    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 21 01:49:26.944000 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.943784    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 21 01:49:26.944859 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.944564    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 21 01:49:26.945003 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.944984    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 21 01:49:26.951202 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.951183    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 01:49:26.951575 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:26.951538    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 21 01:49:27.091593 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.091542    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deeccb08-77fa-48bd-aedc-d6a40a4158a6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.091761 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.091610    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/deeccb08-77fa-48bd-aedc-d6a40a4158a6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.091761 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.091639    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deeccb08-77fa-48bd-aedc-d6a40a4158a6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.091761 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.091678    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/deeccb08-77fa-48bd-aedc-d6a40a4158a6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.091761 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.091707    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncfs6\" (UniqueName: \"kubernetes.io/projected/deeccb08-77fa-48bd-aedc-d6a40a4158a6-kube-api-access-ncfs6\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.092029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.091770    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/deeccb08-77fa-48bd-aedc-d6a40a4158a6-config-out\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.092029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.091855    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.092029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.091940    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.092029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.091973    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.092029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.092003    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-config-volume\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.092286 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.092032    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.092286 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.092056    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-web-config\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.092286 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.092084    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.192660 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.192626    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deeccb08-77fa-48bd-aedc-d6a40a4158a6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.192828 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.192675    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/deeccb08-77fa-48bd-aedc-d6a40a4158a6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.192828 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.192703    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deeccb08-77fa-48bd-aedc-d6a40a4158a6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.192828 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.192744    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/deeccb08-77fa-48bd-aedc-d6a40a4158a6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.192828 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.192770    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ncfs6\" (UniqueName: \"kubernetes.io/projected/deeccb08-77fa-48bd-aedc-d6a40a4158a6-kube-api-access-ncfs6\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.192828 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.192800    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/deeccb08-77fa-48bd-aedc-d6a40a4158a6-config-out\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.193103 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.192842    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.193103 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.192906    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.193103 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.192939    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.193103 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.192967    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-config-volume\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.193103 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.192997    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.193103 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.193026    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-web-config\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.193103 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.193057    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.193446 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.193209    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/deeccb08-77fa-48bd-aedc-d6a40a4158a6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.194351 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.193654    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deeccb08-77fa-48bd-aedc-d6a40a4158a6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.194351 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.193684    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deeccb08-77fa-48bd-aedc-d6a40a4158a6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.194351 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:49:27.193769    2552 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
May 21 01:49:27.194351 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:49:27.193826    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-main-tls podName:deeccb08-77fa-48bd-aedc-d6a40a4158a6 nodeName:}" failed. No retries permitted until 2026-05-21 01:49:27.693806884 +0000 UTC m=+105.981053656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "deeccb08-77fa-48bd-aedc-d6a40a4158a6") : secret "alertmanager-main-tls" not found
May 21 01:49:27.195900 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.195868    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.196123 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.196077    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/deeccb08-77fa-48bd-aedc-d6a40a4158a6-config-out\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.196321 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.196300    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.196386 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.196364    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.196856 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.196829    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/deeccb08-77fa-48bd-aedc-d6a40a4158a6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.196856 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.196849    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.197103 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.197080    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-config-volume\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.197494 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.197470    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-web-config\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.203682 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.203659    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncfs6\" (UniqueName: \"kubernetes.io/projected/deeccb08-77fa-48bd-aedc-d6a40a4158a6-kube-api-access-ncfs6\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.696995 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.696918    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.699002 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.698982    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.729679 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.729646    2552 generic.go:358] "Generic (PLEG): container finished" podID="669ca936-566e-4bd2-9518-580b2b801ca0" containerID="4f57b20f34b48c32a09c0363502960706f5972002c33d93acb059026ade148bb" exitCode=0
May 21 01:49:27.729772 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.729727    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jwkbz" event={"ID":"669ca936-566e-4bd2-9518-580b2b801ca0","Type":"ContainerDied","Data":"4f57b20f34b48c32a09c0363502960706f5972002c33d93acb059026ade148bb"}
May 21 01:49:27.731594 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.731542    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-wkvdh" event={"ID":"27ac9d1b-8dee-43d8-bd76-71130a367415","Type":"ContainerStarted","Data":"8b81d0b4afbfd606d3f7f13e31626c33c70983109d02b5e68502855be3f5738f"}
May 21 01:49:27.760678 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.760639    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-wkvdh" podStartSLOduration=1.7918632570000002 podStartE2EDuration="2.76062801s" podCreationTimestamp="2026-05-21 01:49:25 +0000 UTC" firstStartedPulling="2026-05-21 01:49:26.39513803 +0000 UTC m=+104.682384785" lastFinishedPulling="2026-05-21 01:49:27.363902783 +0000 UTC m=+105.651149538" observedRunningTime="2026-05-21 01:49:27.759860377 +0000 UTC m=+106.047107154" watchObservedRunningTime="2026-05-21 01:49:27.76062801 +0000 UTC m=+106.047874787"
May 21 01:49:27.852697 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.852669    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 01:49:27.980763 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:27.980741    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 01:49:27.982935 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:49:27.982910    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeeccb08_77fa_48bd_aedc_d6a40a4158a6.slice/crio-1107a28cfdeca5a82800ab95fbd7b91af89b3f8ed392e109983cb239f02f112a WatchSource:0}: Error finding container 1107a28cfdeca5a82800ab95fbd7b91af89b3f8ed392e109983cb239f02f112a: Status 404 returned error can't find the container with id 1107a28cfdeca5a82800ab95fbd7b91af89b3f8ed392e109983cb239f02f112a
May 21 01:49:28.737192 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:28.737123    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jwkbz" event={"ID":"669ca936-566e-4bd2-9518-580b2b801ca0","Type":"ContainerStarted","Data":"9348581eb90339aec4189f10740cf0b2c6ade30e850024b290a3f3737f100896"}
May 21 01:49:28.737192 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:28.737166    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jwkbz" event={"ID":"669ca936-566e-4bd2-9518-580b2b801ca0","Type":"ContainerStarted","Data":"d2152884ce53f7eb177ef3748b78e1086c8e7a5db1fd2868465d3dbec991e66e"}
May 21 01:49:28.738502 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:28.738472    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"deeccb08-77fa-48bd-aedc-d6a40a4158a6","Type":"ContainerStarted","Data":"1107a28cfdeca5a82800ab95fbd7b91af89b3f8ed392e109983cb239f02f112a"}
May 21 01:49:28.757991 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:28.757933    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jwkbz" podStartSLOduration=2.608536977 podStartE2EDuration="3.757916512s" podCreationTimestamp="2026-05-21 01:49:25 +0000 UTC" firstStartedPulling="2026-05-21 01:49:26.190818613 +0000 UTC m=+104.478065368" lastFinishedPulling="2026-05-21 01:49:27.340198133 +0000 UTC m=+105.627444903" observedRunningTime="2026-05-21 01:49:28.75541173 +0000 UTC m=+107.042658518" watchObservedRunningTime="2026-05-21 01:49:28.757916512 +0000 UTC m=+107.045163289"
May 21 01:49:28.943132 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:28.943100    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-546559fdb7-hjhkj"]
May 21 01:49:28.945625 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:28.945607    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:28.948019 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:28.947998    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 21 01:49:28.948118 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:28.948061    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 21 01:49:28.948185 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:28.948070    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-eqjn2vh7u3e9s\""
May 21 01:49:28.948238 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:28.948182    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-h7nwc\""
May 21 01:49:28.948293 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:28.948190    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 21 01:49:28.948341 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:28.948327    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 21 01:49:28.948441 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:28.948336    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 21 01:49:28.956055 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:28.956028    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-546559fdb7-hjhkj"]
May 21 01:49:29.109950 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.109925    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/49f4bf49-3780-44fe-b29f-cefda31f9b11-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-546559fdb7-hjhkj\" (UID: \"49f4bf49-3780-44fe-b29f-cefda31f9b11\") " pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:29.110210 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.109960    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49f4bf49-3780-44fe-b29f-cefda31f9b11-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-546559fdb7-hjhkj\" (UID: \"49f4bf49-3780-44fe-b29f-cefda31f9b11\") " pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:29.110210 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.109992    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49f4bf49-3780-44fe-b29f-cefda31f9b11-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-546559fdb7-hjhkj\" (UID: \"49f4bf49-3780-44fe-b29f-cefda31f9b11\") " pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:29.110210 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.110042    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/49f4bf49-3780-44fe-b29f-cefda31f9b11-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-546559fdb7-hjhkj\" (UID: \"49f4bf49-3780-44fe-b29f-cefda31f9b11\") " pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:29.110210 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.110061    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49f4bf49-3780-44fe-b29f-cefda31f9b11-metrics-client-ca\") pod \"thanos-querier-546559fdb7-hjhkj\" (UID: \"49f4bf49-3780-44fe-b29f-cefda31f9b11\") " pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:29.110210 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.110149    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwntp\" (UniqueName: \"kubernetes.io/projected/49f4bf49-3780-44fe-b29f-cefda31f9b11-kube-api-access-cwntp\") pod \"thanos-querier-546559fdb7-hjhkj\" (UID: \"49f4bf49-3780-44fe-b29f-cefda31f9b11\") " pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:29.110210 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.110187    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/49f4bf49-3780-44fe-b29f-cefda31f9b11-secret-thanos-querier-tls\") pod \"thanos-querier-546559fdb7-hjhkj\" (UID: \"49f4bf49-3780-44fe-b29f-cefda31f9b11\") " pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:29.110210 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.110206    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/49f4bf49-3780-44fe-b29f-cefda31f9b11-secret-grpc-tls\") pod \"thanos-querier-546559fdb7-hjhkj\" (UID: \"49f4bf49-3780-44fe-b29f-cefda31f9b11\") " pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:29.211072 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.211049    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cwntp\" (UniqueName: \"kubernetes.io/projected/49f4bf49-3780-44fe-b29f-cefda31f9b11-kube-api-access-cwntp\") pod \"thanos-querier-546559fdb7-hjhkj\" (UID: \"49f4bf49-3780-44fe-b29f-cefda31f9b11\") " pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:29.211160 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.211080    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/49f4bf49-3780-44fe-b29f-cefda31f9b11-secret-thanos-querier-tls\") pod \"thanos-querier-546559fdb7-hjhkj\" (UID: \"49f4bf49-3780-44fe-b29f-cefda31f9b11\") " pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:29.211160 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.211096    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/49f4bf49-3780-44fe-b29f-cefda31f9b11-secret-grpc-tls\") pod \"thanos-querier-546559fdb7-hjhkj\" (UID: \"49f4bf49-3780-44fe-b29f-cefda31f9b11\") " pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:29.211160 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.211123    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/49f4bf49-3780-44fe-b29f-cefda31f9b11-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-546559fdb7-hjhkj\" (UID: \"49f4bf49-3780-44fe-b29f-cefda31f9b11\") " pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:29.211160 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.211149    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49f4bf49-3780-44fe-b29f-cefda31f9b11-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-546559fdb7-hjhkj\" (UID: \"49f4bf49-3780-44fe-b29f-cefda31f9b11\") " pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:29.211345 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.211180    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49f4bf49-3780-44fe-b29f-cefda31f9b11-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-546559fdb7-hjhkj\" (UID: \"49f4bf49-3780-44fe-b29f-cefda31f9b11\") " pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:29.211345 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.211209    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/49f4bf49-3780-44fe-b29f-cefda31f9b11-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-546559fdb7-hjhkj\" (UID: \"49f4bf49-3780-44fe-b29f-cefda31f9b11\") " pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:29.211345 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.211234    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49f4bf49-3780-44fe-b29f-cefda31f9b11-metrics-client-ca\") pod \"thanos-querier-546559fdb7-hjhkj\" (UID: \"49f4bf49-3780-44fe-b29f-cefda31f9b11\") " pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:29.211982 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.211959    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49f4bf49-3780-44fe-b29f-cefda31f9b11-metrics-client-ca\") pod \"thanos-querier-546559fdb7-hjhkj\" (UID: \"49f4bf49-3780-44fe-b29f-cefda31f9b11\") " pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:29.213806 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.213778    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49f4bf49-3780-44fe-b29f-cefda31f9b11-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-546559fdb7-hjhkj\" (UID: \"49f4bf49-3780-44fe-b29f-cefda31f9b11\") " pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:29.213879 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.213821    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/49f4bf49-3780-44fe-b29f-cefda31f9b11-secret-grpc-tls\") pod \"thanos-querier-546559fdb7-hjhkj\" (UID: \"49f4bf49-3780-44fe-b29f-cefda31f9b11\") " pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:29.214003 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.213979    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49f4bf49-3780-44fe-b29f-cefda31f9b11-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-546559fdb7-hjhkj\" (UID: \"49f4bf49-3780-44fe-b29f-cefda31f9b11\") " pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:29.214062 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.214049    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/49f4bf49-3780-44fe-b29f-cefda31f9b11-secret-thanos-querier-tls\") pod \"thanos-querier-546559fdb7-hjhkj\" (UID: \"49f4bf49-3780-44fe-b29f-cefda31f9b11\") " pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:29.214197 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.214178    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/49f4bf49-3780-44fe-b29f-cefda31f9b11-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-546559fdb7-hjhkj\" (UID: \"49f4bf49-3780-44fe-b29f-cefda31f9b11\") " pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:29.214231 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.214221    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/49f4bf49-3780-44fe-b29f-cefda31f9b11-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-546559fdb7-hjhkj\" (UID: \"49f4bf49-3780-44fe-b29f-cefda31f9b11\") " pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:29.218699 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.218677    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwntp\" (UniqueName: \"kubernetes.io/projected/49f4bf49-3780-44fe-b29f-cefda31f9b11-kube-api-access-cwntp\") pod \"thanos-querier-546559fdb7-hjhkj\" (UID: \"49f4bf49-3780-44fe-b29f-cefda31f9b11\") " pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:29.290754 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.290704    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:29.414807 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.414780    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-546559fdb7-hjhkj"]
May 21 01:49:29.417648 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:49:29.417620    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f4bf49_3780_44fe_b29f_cefda31f9b11.slice/crio-b094fc9ac44f45aa53160d2b64e0485cf03db94362ef0375267b8e16392c3205 WatchSource:0}: Error finding container b094fc9ac44f45aa53160d2b64e0485cf03db94362ef0375267b8e16392c3205: Status 404 returned error can't find the container with id b094fc9ac44f45aa53160d2b64e0485cf03db94362ef0375267b8e16392c3205
May 21 01:49:29.742515 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.742482    2552 generic.go:358] "Generic (PLEG): container finished" podID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerID="116ff838aaec36d1e78f83da65fefcd49a9c8b766cc13cb7b0ab4d54da889763" exitCode=0
May 21 01:49:29.742694 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.742568    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"deeccb08-77fa-48bd-aedc-d6a40a4158a6","Type":"ContainerDied","Data":"116ff838aaec36d1e78f83da65fefcd49a9c8b766cc13cb7b0ab4d54da889763"}
May 21 01:49:29.743606 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:29.743582    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj" event={"ID":"49f4bf49-3780-44fe-b29f-cefda31f9b11","Type":"ContainerStarted","Data":"b094fc9ac44f45aa53160d2b64e0485cf03db94362ef0375267b8e16392c3205"}
May 21 01:49:30.318109 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:30.317997    2552 scope.go:117] "RemoveContainer" containerID="aab69ee8da9be2122d847bb449c27f7cfe15dbaa4301542cfbc2d9a74ead922a"
May 21 01:49:30.625538 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:30.625457    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-8g95c"]
May 21 01:49:30.628842 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:30.628820    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8g95c"
May 21 01:49:30.631484 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:30.631462    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-2zzdx\""
May 21 01:49:30.631628 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:30.631472    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 21 01:49:30.635005 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:30.634981    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-8g95c"]
May 21 01:49:30.724588 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:30.724542    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6eae7b5-96c4-4160-934b-e33199f0262c-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-8g95c\" (UID: \"a6eae7b5-96c4-4160-934b-e33199f0262c\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-8g95c"
May 21 01:49:30.748872 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:30.748846    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cgx9r_3a1d53d4-c866-4375-a183-ecfaa11e9d0b/console-operator/2.log"
May 21 01:49:30.749012 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:30.748917    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-cgx9r" event={"ID":"3a1d53d4-c866-4375-a183-ecfaa11e9d0b","Type":"ContainerStarted","Data":"3b593eac8170f7c65e5477aa2668c4a41198a709fc9c53313e6eec1dcb77caf4"}
May 21 01:49:30.749252 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:30.749226    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-cgx9r"
May 21 01:49:30.764127 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:30.764071    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-cgx9r" podStartSLOduration=43.430902807 podStartE2EDuration="46.764054385s" podCreationTimestamp="2026-05-21 01:48:44 +0000 UTC" firstStartedPulling="2026-05-21 01:48:44.508877753 +0000 UTC m=+62.796124509" lastFinishedPulling="2026-05-21 01:48:47.84202932 +0000 UTC m=+66.129276087" observedRunningTime="2026-05-21 01:49:30.763837973 +0000 UTC m=+109.051084751" watchObservedRunningTime="2026-05-21 01:49:30.764054385 +0000 UTC m=+109.051301177"
May 21 01:49:30.806276 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:30.806252    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-cgx9r"
May 21 01:49:30.826108 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:30.825498    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6eae7b5-96c4-4160-934b-e33199f0262c-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-8g95c\" (UID: \"a6eae7b5-96c4-4160-934b-e33199f0262c\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-8g95c"
May 21 01:49:30.834078 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:30.834026    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6eae7b5-96c4-4160-934b-e33199f0262c-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-8g95c\" (UID: \"a6eae7b5-96c4-4160-934b-e33199f0262c\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-8g95c"
May 21 01:49:30.942822 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:30.942736    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8g95c"
May 21 01:49:31.616041 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:31.616010    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-8g95c"]
May 21 01:49:31.619570 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:49:31.619524    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6eae7b5_96c4_4160_934b_e33199f0262c.slice/crio-8acd136cf46f589f5e9d9df12d6e05f319ae89f03d7cab26452e9b136195ef94 WatchSource:0}: Error finding container 8acd136cf46f589f5e9d9df12d6e05f319ae89f03d7cab26452e9b136195ef94: Status 404 returned error can't find the container with id 8acd136cf46f589f5e9d9df12d6e05f319ae89f03d7cab26452e9b136195ef94
May 21 01:49:31.759689 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:31.759658    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"deeccb08-77fa-48bd-aedc-d6a40a4158a6","Type":"ContainerStarted","Data":"af43be9eff9f68539c7d5ec7c8978d049c077a58f8b000c643044dfd7eeb003d"}
May 21 01:49:31.759810 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:31.759699    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"deeccb08-77fa-48bd-aedc-d6a40a4158a6","Type":"ContainerStarted","Data":"10f0cf777b5973fc4ce9591639b40a0085960f68b118000de98db935ac87c6d9"}
May 21 01:49:31.759810 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:31.759712    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"deeccb08-77fa-48bd-aedc-d6a40a4158a6","Type":"ContainerStarted","Data":"b275cffe3496155dbe822b93f18729fa806eccf74b197d473ec0ffe6592057e3"}
May 21 01:49:31.761706 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:31.761682    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj" event={"ID":"49f4bf49-3780-44fe-b29f-cefda31f9b11","Type":"ContainerStarted","Data":"fcf8940a63aa81f066ebb69f07b8ec12c9ad35ced6f56c4348039ff9462db275"}
May 21 01:49:31.761902 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:31.761882    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj" event={"ID":"49f4bf49-3780-44fe-b29f-cefda31f9b11","Type":"ContainerStarted","Data":"13ddcc57ce2812fe40a52a613de12f3f7993717b23e60265b30aa1be131e0350"}
May 21 01:49:31.762027 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:31.762013    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj" event={"ID":"49f4bf49-3780-44fe-b29f-cefda31f9b11","Type":"ContainerStarted","Data":"b2fc62d24c877a32d33d184d4d43f815a1d3a3f412e61b143d77ef2cf0b825f2"}
May 21 01:49:31.762866 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:31.762838    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8g95c" event={"ID":"a6eae7b5-96c4-4160-934b-e33199f0262c","Type":"ContainerStarted","Data":"8acd136cf46f589f5e9d9df12d6e05f319ae89f03d7cab26452e9b136195ef94"}
May 21 01:49:32.548752 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:32.548711    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:49:32.718085 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:32.718001    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-msfwg"
May 21 01:49:32.771115 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:32.771076    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"deeccb08-77fa-48bd-aedc-d6a40a4158a6","Type":"ContainerStarted","Data":"560df395eccfa3633f0fc0b16fccb705c7e2d0089c7d09adf04148dbe5a5c591"}
May 21 01:49:32.771115 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:32.771122    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"deeccb08-77fa-48bd-aedc-d6a40a4158a6","Type":"ContainerStarted","Data":"5647c1a42aeb174495f01b9385de44379de2cfa291f2be40766b7f735e424a22"}
May 21 01:49:32.771337 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:32.771137    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"deeccb08-77fa-48bd-aedc-d6a40a4158a6","Type":"ContainerStarted","Data":"cbf0d7349aa983fa9367ad9711323bda66994c890f955d7d958dbdd617194929"}
May 21 01:49:32.780400 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:32.780344    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj" event={"ID":"49f4bf49-3780-44fe-b29f-cefda31f9b11","Type":"ContainerStarted","Data":"9a5574d2008bde29f00a8cd3b84a9c886e83f258d71210f96aa82b4a78dc3399"}
May 21 01:49:32.801600 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:32.801531    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.32506321 podStartE2EDuration="6.801513868s" podCreationTimestamp="2026-05-21 01:49:26 +0000 UTC" firstStartedPulling="2026-05-21 01:49:27.984742968 +0000 UTC m=+106.271989723" lastFinishedPulling="2026-05-21 01:49:32.461193616 +0000 UTC m=+110.748440381" observedRunningTime="2026-05-21 01:49:32.800976852 +0000 UTC m=+111.088223630" watchObservedRunningTime="2026-05-21 01:49:32.801513868 +0000 UTC m=+111.088760646"
May 21 01:49:32.890677 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:32.890651    2552 patch_prober.go:28] interesting pod/image-registry-9445cc9fd-5pns8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 21 01:49:32.890774 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:32.890699    2552 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-9445cc9fd-5pns8" podUID="4c5416ce-b7f8-4361-82d8-5fc911786d0f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 21 01:49:33.786299 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:33.786262    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj" event={"ID":"49f4bf49-3780-44fe-b29f-cefda31f9b11","Type":"ContainerStarted","Data":"0420538e9fc9e065fb54029e01d24b24fe763bd76a3c893990d98555b5cc28ab"}
May 21 01:49:33.786299 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:33.786305    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj" event={"ID":"49f4bf49-3780-44fe-b29f-cefda31f9b11","Type":"ContainerStarted","Data":"4afa4c045b78c734cb7763c8b3590e30312ed2504367ca58f846f6210f67a772"}
May 21 01:49:33.786798 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:33.786420    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:33.787678 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:33.787652    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8g95c" event={"ID":"a6eae7b5-96c4-4160-934b-e33199f0262c","Type":"ContainerStarted","Data":"8025ee856d6de7da01404adfde0f966fc2dff75134403a955ee74616be3bc151"}
May 21 01:49:33.809725 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:33.809680    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj" podStartSLOduration=2.769843973 podStartE2EDuration="5.809664571s" podCreationTimestamp="2026-05-21 01:49:28 +0000 UTC" firstStartedPulling="2026-05-21 01:49:29.419504446 +0000 UTC m=+107.706751214" lastFinishedPulling="2026-05-21 01:49:32.459325044 +0000 UTC m=+110.746571812" observedRunningTime="2026-05-21 01:49:33.807963073 +0000 UTC m=+112.095209852" watchObservedRunningTime="2026-05-21 01:49:33.809664571 +0000 UTC m=+112.096911349"
May 21 01:49:33.822115 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:33.822078    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8g95c" podStartSLOduration=2.560166099 podStartE2EDuration="3.822065943s" podCreationTimestamp="2026-05-21 01:49:30 +0000 UTC" firstStartedPulling="2026-05-21 01:49:31.621958766 +0000 UTC m=+109.909205521" lastFinishedPulling="2026-05-21 01:49:32.883858608 +0000 UTC m=+111.171105365" observedRunningTime="2026-05-21 01:49:33.821135495 +0000 UTC m=+112.108382490" watchObservedRunningTime="2026-05-21 01:49:33.822065943 +0000 UTC m=+112.109312720"
May 21 01:49:34.684503 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:34.684473    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-9445cc9fd-5pns8"
May 21 01:49:34.790768 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:34.790747    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8g95c"
May 21 01:49:34.794974 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:34.794952    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8g95c"
May 21 01:49:36.496287 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.496255    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-8ff6d7d4c-rgstp"]
May 21 01:49:36.499898 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.499879    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:49:36.502621 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.502591    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 21 01:49:36.502621 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.502605    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 21 01:49:36.503795 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.503764    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 21 01:49:36.503795 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.503784    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 21 01:49:36.503939 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.503801    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 21 01:49:36.503939 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.503835    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 21 01:49:36.503939 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.503906    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-42gdp\""
May 21 01:49:36.504160 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.504144    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 21 01:49:36.507628 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.507600    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8ff6d7d4c-rgstp"]
May 21 01:49:36.678191 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.678165    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04370457-bf03-4f7e-81c2-fb702fd09fc4-oauth-serving-cert\") pod \"console-8ff6d7d4c-rgstp\" (UID: \"04370457-bf03-4f7e-81c2-fb702fd09fc4\") " pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:49:36.678313 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.678205    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04370457-bf03-4f7e-81c2-fb702fd09fc4-service-ca\") pod \"console-8ff6d7d4c-rgstp\" (UID: \"04370457-bf03-4f7e-81c2-fb702fd09fc4\") " pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:49:36.678313 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.678226    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04370457-bf03-4f7e-81c2-fb702fd09fc4-console-oauth-config\") pod \"console-8ff6d7d4c-rgstp\" (UID: \"04370457-bf03-4f7e-81c2-fb702fd09fc4\") " pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:49:36.678313 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.678280    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04370457-bf03-4f7e-81c2-fb702fd09fc4-console-serving-cert\") pod \"console-8ff6d7d4c-rgstp\" (UID: \"04370457-bf03-4f7e-81c2-fb702fd09fc4\") " pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:49:36.678453 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.678323    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2lxk\" (UniqueName: \"kubernetes.io/projected/04370457-bf03-4f7e-81c2-fb702fd09fc4-kube-api-access-j2lxk\") pod \"console-8ff6d7d4c-rgstp\" (UID: \"04370457-bf03-4f7e-81c2-fb702fd09fc4\") " pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:49:36.678453 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.678367    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04370457-bf03-4f7e-81c2-fb702fd09fc4-console-config\") pod \"console-8ff6d7d4c-rgstp\" (UID: \"04370457-bf03-4f7e-81c2-fb702fd09fc4\") " pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:49:36.779149 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.779087    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04370457-bf03-4f7e-81c2-fb702fd09fc4-service-ca\") pod \"console-8ff6d7d4c-rgstp\" (UID: \"04370457-bf03-4f7e-81c2-fb702fd09fc4\") " pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:49:36.779149 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.779119    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04370457-bf03-4f7e-81c2-fb702fd09fc4-console-oauth-config\") pod \"console-8ff6d7d4c-rgstp\" (UID: \"04370457-bf03-4f7e-81c2-fb702fd09fc4\") " pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:49:36.779149 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.779143    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04370457-bf03-4f7e-81c2-fb702fd09fc4-console-serving-cert\") pod \"console-8ff6d7d4c-rgstp\" (UID: \"04370457-bf03-4f7e-81c2-fb702fd09fc4\") " pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:49:36.779349 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.779165    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j2lxk\" (UniqueName: \"kubernetes.io/projected/04370457-bf03-4f7e-81c2-fb702fd09fc4-kube-api-access-j2lxk\") pod \"console-8ff6d7d4c-rgstp\" (UID: \"04370457-bf03-4f7e-81c2-fb702fd09fc4\") " pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:49:36.779349 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.779215    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04370457-bf03-4f7e-81c2-fb702fd09fc4-console-config\") pod \"console-8ff6d7d4c-rgstp\" (UID: \"04370457-bf03-4f7e-81c2-fb702fd09fc4\") " pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:49:36.779349 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.779281    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04370457-bf03-4f7e-81c2-fb702fd09fc4-oauth-serving-cert\") pod \"console-8ff6d7d4c-rgstp\" (UID: \"04370457-bf03-4f7e-81c2-fb702fd09fc4\") " pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:49:36.779927 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.779903    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04370457-bf03-4f7e-81c2-fb702fd09fc4-oauth-serving-cert\") pod \"console-8ff6d7d4c-rgstp\" (UID: \"04370457-bf03-4f7e-81c2-fb702fd09fc4\") " pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:49:36.780018 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.779952    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04370457-bf03-4f7e-81c2-fb702fd09fc4-console-config\") pod \"console-8ff6d7d4c-rgstp\" (UID: \"04370457-bf03-4f7e-81c2-fb702fd09fc4\") " pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:49:36.780018 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.779957    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04370457-bf03-4f7e-81c2-fb702fd09fc4-service-ca\") pod \"console-8ff6d7d4c-rgstp\" (UID: \"04370457-bf03-4f7e-81c2-fb702fd09fc4\") " pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:49:36.781483 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.781462    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04370457-bf03-4f7e-81c2-fb702fd09fc4-console-oauth-config\") pod \"console-8ff6d7d4c-rgstp\" (UID: \"04370457-bf03-4f7e-81c2-fb702fd09fc4\") " pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:49:36.781581 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.781534    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04370457-bf03-4f7e-81c2-fb702fd09fc4-console-serving-cert\") pod \"console-8ff6d7d4c-rgstp\" (UID: \"04370457-bf03-4f7e-81c2-fb702fd09fc4\") " pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:49:36.786969 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.786949    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2lxk\" (UniqueName: \"kubernetes.io/projected/04370457-bf03-4f7e-81c2-fb702fd09fc4-kube-api-access-j2lxk\") pod \"console-8ff6d7d4c-rgstp\" (UID: \"04370457-bf03-4f7e-81c2-fb702fd09fc4\") " pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:49:36.808930 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.808910    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:49:36.941794 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:36.941704    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8ff6d7d4c-rgstp"]
May 21 01:49:36.944257 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:49:36.944229    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04370457_bf03_4f7e_81c2_fb702fd09fc4.slice/crio-7e57cd0fe10ae766a860fb2b75a0176170168db5915d816cf909bc8afb6f8fa0 WatchSource:0}: Error finding container 7e57cd0fe10ae766a860fb2b75a0176170168db5915d816cf909bc8afb6f8fa0: Status 404 returned error can't find the container with id 7e57cd0fe10ae766a860fb2b75a0176170168db5915d816cf909bc8afb6f8fa0
May 21 01:49:37.564692 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:37.564647    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-bcb44468d-kzbm2" podUID="5a234f24-ca45-477a-9bac-38fe001042d6" containerName="registry" containerID="cri-o://253c33f1e838c7b429238c25f7b6bd47adb5ae65b2d1a420cfde3023ad9b422d" gracePeriod=30
May 21 01:49:37.804359 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:37.804285    2552 generic.go:358] "Generic (PLEG): container finished" podID="5a234f24-ca45-477a-9bac-38fe001042d6" containerID="253c33f1e838c7b429238c25f7b6bd47adb5ae65b2d1a420cfde3023ad9b422d" exitCode=0
May 21 01:49:37.804479 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:37.804367    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bcb44468d-kzbm2" event={"ID":"5a234f24-ca45-477a-9bac-38fe001042d6","Type":"ContainerDied","Data":"253c33f1e838c7b429238c25f7b6bd47adb5ae65b2d1a420cfde3023ad9b422d"}
May 21 01:49:37.805636 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:37.805607    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8ff6d7d4c-rgstp" event={"ID":"04370457-bf03-4f7e-81c2-fb702fd09fc4","Type":"ContainerStarted","Data":"7e57cd0fe10ae766a860fb2b75a0176170168db5915d816cf909bc8afb6f8fa0"}
May 21 01:49:37.820480 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:37.820420    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:49:37.994512 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:37.994482    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a234f24-ca45-477a-9bac-38fe001042d6-registry-certificates\") pod \"5a234f24-ca45-477a-9bac-38fe001042d6\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") "
May 21 01:49:37.994764 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:37.994513    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a234f24-ca45-477a-9bac-38fe001042d6-trusted-ca\") pod \"5a234f24-ca45-477a-9bac-38fe001042d6\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") "
May 21 01:49:37.994764 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:37.994690    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a234f24-ca45-477a-9bac-38fe001042d6-ca-trust-extracted\") pod \"5a234f24-ca45-477a-9bac-38fe001042d6\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") "
May 21 01:49:37.994764 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:37.994751    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95jmm\" (UniqueName: \"kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-kube-api-access-95jmm\") pod \"5a234f24-ca45-477a-9bac-38fe001042d6\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") "
May 21 01:49:37.994917 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:37.994812    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a234f24-ca45-477a-9bac-38fe001042d6-installation-pull-secrets\") pod \"5a234f24-ca45-477a-9bac-38fe001042d6\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") "
May 21 01:49:37.994917 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:37.994844    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-registry-tls\") pod \"5a234f24-ca45-477a-9bac-38fe001042d6\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") "
May 21 01:49:37.994917 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:37.994882    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-bound-sa-token\") pod \"5a234f24-ca45-477a-9bac-38fe001042d6\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") "
May 21 01:49:37.995066 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:37.994916    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a234f24-ca45-477a-9bac-38fe001042d6-image-registry-private-configuration\") pod \"5a234f24-ca45-477a-9bac-38fe001042d6\" (UID: \"5a234f24-ca45-477a-9bac-38fe001042d6\") "
May 21 01:49:37.995066 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:37.994996    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a234f24-ca45-477a-9bac-38fe001042d6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5a234f24-ca45-477a-9bac-38fe001042d6" (UID: "5a234f24-ca45-477a-9bac-38fe001042d6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 01:49:37.995066 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:37.995049    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a234f24-ca45-477a-9bac-38fe001042d6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5a234f24-ca45-477a-9bac-38fe001042d6" (UID: "5a234f24-ca45-477a-9bac-38fe001042d6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 01:49:37.995273 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:37.995252    2552 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a234f24-ca45-477a-9bac-38fe001042d6-registry-certificates\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:49:37.995355 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:37.995279    2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a234f24-ca45-477a-9bac-38fe001042d6-trusted-ca\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:49:37.997754 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:37.997727    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a234f24-ca45-477a-9bac-38fe001042d6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5a234f24-ca45-477a-9bac-38fe001042d6" (UID: "5a234f24-ca45-477a-9bac-38fe001042d6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:49:37.997754 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:37.997741    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-kube-api-access-95jmm" (OuterVolumeSpecName: "kube-api-access-95jmm") pod "5a234f24-ca45-477a-9bac-38fe001042d6" (UID: "5a234f24-ca45-477a-9bac-38fe001042d6"). InnerVolumeSpecName "kube-api-access-95jmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:49:37.998053 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:37.997919    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5a234f24-ca45-477a-9bac-38fe001042d6" (UID: "5a234f24-ca45-477a-9bac-38fe001042d6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:49:37.998053 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:37.997967    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a234f24-ca45-477a-9bac-38fe001042d6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5a234f24-ca45-477a-9bac-38fe001042d6" (UID: "5a234f24-ca45-477a-9bac-38fe001042d6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:49:37.998921 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:37.998895    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5a234f24-ca45-477a-9bac-38fe001042d6" (UID: "5a234f24-ca45-477a-9bac-38fe001042d6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:49:38.005366 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:38.005343    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a234f24-ca45-477a-9bac-38fe001042d6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5a234f24-ca45-477a-9bac-38fe001042d6" (UID: "5a234f24-ca45-477a-9bac-38fe001042d6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:49:38.096278 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:38.096219    2552 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a234f24-ca45-477a-9bac-38fe001042d6-ca-trust-extracted\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:49:38.096278 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:38.096241    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95jmm\" (UniqueName: \"kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-kube-api-access-95jmm\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:49:38.096278 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:38.096257    2552 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a234f24-ca45-477a-9bac-38fe001042d6-installation-pull-secrets\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:49:38.096278 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:38.096272    2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-registry-tls\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:49:38.096535 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:38.096287    2552 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a234f24-ca45-477a-9bac-38fe001042d6-bound-sa-token\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:49:38.096535 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:38.096301    2552 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a234f24-ca45-477a-9bac-38fe001042d6-image-registry-private-configuration\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:49:38.810194 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:38.810154    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bcb44468d-kzbm2" event={"ID":"5a234f24-ca45-477a-9bac-38fe001042d6","Type":"ContainerDied","Data":"43b2f9c02c076118702b31d3b94326b207a368c3c6b79ff913c05220d1d01c6d"}
May 21 01:49:38.810650 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:38.810212    2552 scope.go:117] "RemoveContainer" containerID="253c33f1e838c7b429238c25f7b6bd47adb5ae65b2d1a420cfde3023ad9b422d"
May 21 01:49:38.810650 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:38.810244    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bcb44468d-kzbm2"
May 21 01:49:38.827822 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:38.827791    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bcb44468d-kzbm2"]
May 21 01:49:38.833223 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:38.833203    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-bcb44468d-kzbm2"]
May 21 01:49:39.797049 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:39.796976    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-546559fdb7-hjhkj"
May 21 01:49:39.815049 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:39.815023    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8ff6d7d4c-rgstp" event={"ID":"04370457-bf03-4f7e-81c2-fb702fd09fc4","Type":"ContainerStarted","Data":"4a103f8dec7f187fd370b342b64b514acbf8a8083026ba3e7ddc042a03a2fea1"}
May 21 01:49:39.834611 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:39.834525    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-8ff6d7d4c-rgstp" podStartSLOduration=1.245824611 podStartE2EDuration="3.834507356s" podCreationTimestamp="2026-05-21 01:49:36 +0000 UTC" firstStartedPulling="2026-05-21 01:49:36.946273842 +0000 UTC m=+115.233520600" lastFinishedPulling="2026-05-21 01:49:39.534956587 +0000 UTC m=+117.822203345" observedRunningTime="2026-05-21 01:49:39.833158803 +0000 UTC m=+118.120405581" watchObservedRunningTime="2026-05-21 01:49:39.834507356 +0000 UTC m=+118.121754138"
May 21 01:49:40.321200 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:40.321170    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a234f24-ca45-477a-9bac-38fe001042d6" path="/var/lib/kubelet/pods/5a234f24-ca45-477a-9bac-38fe001042d6/volumes"
May 21 01:49:46.809241 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:46.809199    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:49:46.809624 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:46.809258    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:49:46.813989 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:46.813966    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:49:46.838457 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:46.838436    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:49:46.877175 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:46.877150    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-d75c7ccc7-j25r8"]
May 21 01:49:46.877479 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:46.877466    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a234f24-ca45-477a-9bac-38fe001042d6" containerName="registry"
May 21 01:49:46.877521 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:46.877481    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a234f24-ca45-477a-9bac-38fe001042d6" containerName="registry"
May 21 01:49:46.877574 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:46.877531    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="5a234f24-ca45-477a-9bac-38fe001042d6" containerName="registry"
May 21 01:49:46.881502 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:46.881485    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:46.889174 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:46.889140    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 21 01:49:46.891149 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:46.891127    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d75c7ccc7-j25r8"]
May 21 01:49:46.955087 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:46.955057    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-service-ca\") pod \"console-d75c7ccc7-j25r8\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") " pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:46.955184 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:46.955100    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-console-serving-cert\") pod \"console-d75c7ccc7-j25r8\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") " pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:46.955184 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:46.955129    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-console-config\") pod \"console-d75c7ccc7-j25r8\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") " pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:46.955257 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:46.955184    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-trusted-ca-bundle\") pod \"console-d75c7ccc7-j25r8\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") " pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:46.955257 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:46.955207    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88p2s\" (UniqueName: \"kubernetes.io/projected/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-kube-api-access-88p2s\") pod \"console-d75c7ccc7-j25r8\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") " pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:46.955332 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:46.955314    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-oauth-serving-cert\") pod \"console-d75c7ccc7-j25r8\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") " pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:46.955369 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:46.955352    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-console-oauth-config\") pod \"console-d75c7ccc7-j25r8\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") " pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:47.056524 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:47.056501    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-console-oauth-config\") pod \"console-d75c7ccc7-j25r8\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") " pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:47.056636 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:47.056529    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-service-ca\") pod \"console-d75c7ccc7-j25r8\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") " pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:47.056636 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:47.056573    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-console-serving-cert\") pod \"console-d75c7ccc7-j25r8\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") " pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:47.056636 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:47.056600    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-console-config\") pod \"console-d75c7ccc7-j25r8\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") " pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:47.056636 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:47.056627    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-trusted-ca-bundle\") pod \"console-d75c7ccc7-j25r8\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") " pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:47.056831 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:47.056650    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88p2s\" (UniqueName: \"kubernetes.io/projected/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-kube-api-access-88p2s\") pod \"console-d75c7ccc7-j25r8\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") " pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:47.056960 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:47.056932    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-oauth-serving-cert\") pod \"console-d75c7ccc7-j25r8\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") " pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:47.057300 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:47.057269    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-service-ca\") pod \"console-d75c7ccc7-j25r8\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") " pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:47.057400 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:47.057384    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-console-config\") pod \"console-d75c7ccc7-j25r8\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") " pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:47.057536 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:47.057517    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-oauth-serving-cert\") pod \"console-d75c7ccc7-j25r8\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") " pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:47.057761 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:47.057738    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-trusted-ca-bundle\") pod \"console-d75c7ccc7-j25r8\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") " pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:47.058977 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:47.058956    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-console-serving-cert\") pod \"console-d75c7ccc7-j25r8\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") " pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:47.059055 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:47.058994    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-console-oauth-config\") pod \"console-d75c7ccc7-j25r8\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") " pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:47.064971 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:47.064921    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88p2s\" (UniqueName: \"kubernetes.io/projected/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-kube-api-access-88p2s\") pod \"console-d75c7ccc7-j25r8\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") " pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:47.191313 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:47.191287    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:47.312595 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:47.312416    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d75c7ccc7-j25r8"]
May 21 01:49:47.315171 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:49:47.315114    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9589b2bc_8ccb_4ca4_b0f9_99a82effeec9.slice/crio-4a557a4e4e08d4fe98ae9613cec94a20d67684e817ccbce8528693a2837009fb WatchSource:0}: Error finding container 4a557a4e4e08d4fe98ae9613cec94a20d67684e817ccbce8528693a2837009fb: Status 404 returned error can't find the container with id 4a557a4e4e08d4fe98ae9613cec94a20d67684e817ccbce8528693a2837009fb
May 21 01:49:47.838329 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:47.838292    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d75c7ccc7-j25r8" event={"ID":"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9","Type":"ContainerStarted","Data":"f66ecabec363a38d890eeefc265d31ddfed11d57f30177321532b37b91e21f22"}
May 21 01:49:47.838702 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:47.838336    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d75c7ccc7-j25r8" event={"ID":"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9","Type":"ContainerStarted","Data":"4a557a4e4e08d4fe98ae9613cec94a20d67684e817ccbce8528693a2837009fb"}
May 21 01:49:47.856356 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:47.856309    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-d75c7ccc7-j25r8" podStartSLOduration=1.856292539 podStartE2EDuration="1.856292539s" podCreationTimestamp="2026-05-21 01:49:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 01:49:47.854506646 +0000 UTC m=+126.141753424" watchObservedRunningTime="2026-05-21 01:49:47.856292539 +0000 UTC m=+126.143539319"
May 21 01:49:51.090890 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:51.090845    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs\") pod \"network-metrics-daemon-hn6dl\" (UID: \"95930799-a903-46cc-b0ac-b157dfbd4bb8\") " pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:49:51.093128 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:51.093101    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95930799-a903-46cc-b0ac-b157dfbd4bb8-metrics-certs\") pod \"network-metrics-daemon-hn6dl\" (UID: \"95930799-a903-46cc-b0ac-b157dfbd4bb8\") " pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:49:51.233739 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:51.233712    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ng7kc\""
May 21 01:49:51.241933 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:51.241914    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn6dl"
May 21 01:49:51.359746 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:51.359679    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hn6dl"]
May 21 01:49:51.362371 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:49:51.362343    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95930799_a903_46cc_b0ac_b157dfbd4bb8.slice/crio-661f268cfd44cc6395dbff88820abdbaff44c254820cf1c26d21f14ca99a4d4c WatchSource:0}: Error finding container 661f268cfd44cc6395dbff88820abdbaff44c254820cf1c26d21f14ca99a4d4c: Status 404 returned error can't find the container with id 661f268cfd44cc6395dbff88820abdbaff44c254820cf1c26d21f14ca99a4d4c
May 21 01:49:51.852155 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:51.852122    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hn6dl" event={"ID":"95930799-a903-46cc-b0ac-b157dfbd4bb8","Type":"ContainerStarted","Data":"661f268cfd44cc6395dbff88820abdbaff44c254820cf1c26d21f14ca99a4d4c"}
May 21 01:49:52.857147 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:52.857110    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hn6dl" event={"ID":"95930799-a903-46cc-b0ac-b157dfbd4bb8","Type":"ContainerStarted","Data":"dffd774a3bbb11aef2899063036022cc4231baceb9e75307fe811fb82471ac12"}
May 21 01:49:52.857147 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:52.857150    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hn6dl" event={"ID":"95930799-a903-46cc-b0ac-b157dfbd4bb8","Type":"ContainerStarted","Data":"dfd99ab3f102abbffe0778f60f3f9e62f7361120b95e249eb99fcff48df42876"}
May 21 01:49:52.872154 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:52.872100    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hn6dl" podStartSLOduration=129.964358886 podStartE2EDuration="2m10.87208501s" podCreationTimestamp="2026-05-21 01:47:42 +0000 UTC" firstStartedPulling="2026-05-21 01:49:51.364433945 +0000 UTC m=+129.651680704" lastFinishedPulling="2026-05-21 01:49:52.272160065 +0000 UTC m=+130.559406828" observedRunningTime="2026-05-21 01:49:52.871188977 +0000 UTC m=+131.158435756" watchObservedRunningTime="2026-05-21 01:49:52.87208501 +0000 UTC m=+131.159331786"
May 21 01:49:57.192183 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:57.192147    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:57.192183 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:57.192185    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:57.197524 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:57.197502    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:57.878823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:57.878790    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:49:57.920629 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:49:57.920601    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8ff6d7d4c-rgstp"]
May 21 01:50:18.931304 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:18.931273    2552 generic.go:358] "Generic (PLEG): container finished" podID="2fb97518-73b0-46b5-af75-6646323566c6" containerID="f4fccad52f2b1147b216093ec0c4ed8939771b9140d6fd2030f4444f563db8b9" exitCode=0
May 21 01:50:18.931730 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:18.931352    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-g7xz9" event={"ID":"2fb97518-73b0-46b5-af75-6646323566c6","Type":"ContainerDied","Data":"f4fccad52f2b1147b216093ec0c4ed8939771b9140d6fd2030f4444f563db8b9"}
May 21 01:50:18.931778 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:18.931736    2552 scope.go:117] "RemoveContainer" containerID="f4fccad52f2b1147b216093ec0c4ed8939771b9140d6fd2030f4444f563db8b9"
May 21 01:50:19.938298 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:19.938251    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-g7xz9" event={"ID":"2fb97518-73b0-46b5-af75-6646323566c6","Type":"ContainerStarted","Data":"d724d0ef09cf3cbcbbf2dd3f53c3db52af0269fa5ff608868571e8bf6fe62126"}
May 21 01:50:22.946196 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:22.946139    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-8ff6d7d4c-rgstp" podUID="04370457-bf03-4f7e-81c2-fb702fd09fc4" containerName="console" containerID="cri-o://4a103f8dec7f187fd370b342b64b514acbf8a8083026ba3e7ddc042a03a2fea1" gracePeriod=15
May 21 01:50:23.182243 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.182222    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8ff6d7d4c-rgstp_04370457-bf03-4f7e-81c2-fb702fd09fc4/console/0.log"
May 21 01:50:23.182353 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.182282    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:50:23.328300 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.328277    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04370457-bf03-4f7e-81c2-fb702fd09fc4-service-ca\") pod \"04370457-bf03-4f7e-81c2-fb702fd09fc4\" (UID: \"04370457-bf03-4f7e-81c2-fb702fd09fc4\") "
May 21 01:50:23.328428 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.328319    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04370457-bf03-4f7e-81c2-fb702fd09fc4-oauth-serving-cert\") pod \"04370457-bf03-4f7e-81c2-fb702fd09fc4\" (UID: \"04370457-bf03-4f7e-81c2-fb702fd09fc4\") "
May 21 01:50:23.328428 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.328356    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04370457-bf03-4f7e-81c2-fb702fd09fc4-console-serving-cert\") pod \"04370457-bf03-4f7e-81c2-fb702fd09fc4\" (UID: \"04370457-bf03-4f7e-81c2-fb702fd09fc4\") "
May 21 01:50:23.328428 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.328396    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2lxk\" (UniqueName: \"kubernetes.io/projected/04370457-bf03-4f7e-81c2-fb702fd09fc4-kube-api-access-j2lxk\") pod \"04370457-bf03-4f7e-81c2-fb702fd09fc4\" (UID: \"04370457-bf03-4f7e-81c2-fb702fd09fc4\") "
May 21 01:50:23.328428 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.328424    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04370457-bf03-4f7e-81c2-fb702fd09fc4-console-config\") pod \"04370457-bf03-4f7e-81c2-fb702fd09fc4\" (UID: \"04370457-bf03-4f7e-81c2-fb702fd09fc4\") "
May 21 01:50:23.328664 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.328479    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04370457-bf03-4f7e-81c2-fb702fd09fc4-console-oauth-config\") pod \"04370457-bf03-4f7e-81c2-fb702fd09fc4\" (UID: \"04370457-bf03-4f7e-81c2-fb702fd09fc4\") "
May 21 01:50:23.328791 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.328721    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04370457-bf03-4f7e-81c2-fb702fd09fc4-service-ca" (OuterVolumeSpecName: "service-ca") pod "04370457-bf03-4f7e-81c2-fb702fd09fc4" (UID: "04370457-bf03-4f7e-81c2-fb702fd09fc4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 01:50:23.328876 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.328816    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04370457-bf03-4f7e-81c2-fb702fd09fc4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "04370457-bf03-4f7e-81c2-fb702fd09fc4" (UID: "04370457-bf03-4f7e-81c2-fb702fd09fc4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 01:50:23.328937 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.328885    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04370457-bf03-4f7e-81c2-fb702fd09fc4-console-config" (OuterVolumeSpecName: "console-config") pod "04370457-bf03-4f7e-81c2-fb702fd09fc4" (UID: "04370457-bf03-4f7e-81c2-fb702fd09fc4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 01:50:23.330690 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.330666    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04370457-bf03-4f7e-81c2-fb702fd09fc4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "04370457-bf03-4f7e-81c2-fb702fd09fc4" (UID: "04370457-bf03-4f7e-81c2-fb702fd09fc4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:50:23.330818 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.330688    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04370457-bf03-4f7e-81c2-fb702fd09fc4-kube-api-access-j2lxk" (OuterVolumeSpecName: "kube-api-access-j2lxk") pod "04370457-bf03-4f7e-81c2-fb702fd09fc4" (UID: "04370457-bf03-4f7e-81c2-fb702fd09fc4"). InnerVolumeSpecName "kube-api-access-j2lxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:50:23.330818 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.330774    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04370457-bf03-4f7e-81c2-fb702fd09fc4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "04370457-bf03-4f7e-81c2-fb702fd09fc4" (UID: "04370457-bf03-4f7e-81c2-fb702fd09fc4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:50:23.429494 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.429461    2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04370457-bf03-4f7e-81c2-fb702fd09fc4-service-ca\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:50:23.429494 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.429494    2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04370457-bf03-4f7e-81c2-fb702fd09fc4-oauth-serving-cert\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:50:23.429651 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.429508    2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04370457-bf03-4f7e-81c2-fb702fd09fc4-console-serving-cert\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:50:23.429651 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.429522    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2lxk\" (UniqueName: \"kubernetes.io/projected/04370457-bf03-4f7e-81c2-fb702fd09fc4-kube-api-access-j2lxk\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:50:23.429651 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.429535    2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04370457-bf03-4f7e-81c2-fb702fd09fc4-console-config\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:50:23.429651 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.429570    2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04370457-bf03-4f7e-81c2-fb702fd09fc4-console-oauth-config\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:50:23.950978 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.950954    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8ff6d7d4c-rgstp_04370457-bf03-4f7e-81c2-fb702fd09fc4/console/0.log"
May 21 01:50:23.951322 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.950995    2552 generic.go:358] "Generic (PLEG): container finished" podID="04370457-bf03-4f7e-81c2-fb702fd09fc4" containerID="4a103f8dec7f187fd370b342b64b514acbf8a8083026ba3e7ddc042a03a2fea1" exitCode=2
May 21 01:50:23.951322 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.951029    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8ff6d7d4c-rgstp" event={"ID":"04370457-bf03-4f7e-81c2-fb702fd09fc4","Type":"ContainerDied","Data":"4a103f8dec7f187fd370b342b64b514acbf8a8083026ba3e7ddc042a03a2fea1"}
May 21 01:50:23.951322 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.951067    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8ff6d7d4c-rgstp" event={"ID":"04370457-bf03-4f7e-81c2-fb702fd09fc4","Type":"ContainerDied","Data":"7e57cd0fe10ae766a860fb2b75a0176170168db5915d816cf909bc8afb6f8fa0"}
May 21 01:50:23.951322 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.951068    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8ff6d7d4c-rgstp"
May 21 01:50:23.951322 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.951082    2552 scope.go:117] "RemoveContainer" containerID="4a103f8dec7f187fd370b342b64b514acbf8a8083026ba3e7ddc042a03a2fea1"
May 21 01:50:23.959196 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.959177    2552 scope.go:117] "RemoveContainer" containerID="4a103f8dec7f187fd370b342b64b514acbf8a8083026ba3e7ddc042a03a2fea1"
May 21 01:50:23.959455 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:50:23.959437    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a103f8dec7f187fd370b342b64b514acbf8a8083026ba3e7ddc042a03a2fea1\": container with ID starting with 4a103f8dec7f187fd370b342b64b514acbf8a8083026ba3e7ddc042a03a2fea1 not found: ID does not exist" containerID="4a103f8dec7f187fd370b342b64b514acbf8a8083026ba3e7ddc042a03a2fea1"
May 21 01:50:23.959508 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.959464    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a103f8dec7f187fd370b342b64b514acbf8a8083026ba3e7ddc042a03a2fea1"} err="failed to get container status \"4a103f8dec7f187fd370b342b64b514acbf8a8083026ba3e7ddc042a03a2fea1\": rpc error: code = NotFound desc = could not find container \"4a103f8dec7f187fd370b342b64b514acbf8a8083026ba3e7ddc042a03a2fea1\": container with ID starting with 4a103f8dec7f187fd370b342b64b514acbf8a8083026ba3e7ddc042a03a2fea1 not found: ID does not exist"
May 21 01:50:23.985761 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.985739    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8ff6d7d4c-rgstp"]
May 21 01:50:23.992617 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:23.992594    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8ff6d7d4c-rgstp"]
May 21 01:50:24.323580 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:24.323531    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04370457-bf03-4f7e-81c2-fb702fd09fc4" path="/var/lib/kubelet/pods/04370457-bf03-4f7e-81c2-fb702fd09fc4/volumes"
May 21 01:50:46.105043 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:46.105010    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 01:50:46.105496 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:46.105431    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="alertmanager" containerID="cri-o://b275cffe3496155dbe822b93f18729fa806eccf74b197d473ec0ffe6592057e3" gracePeriod=120
May 21 01:50:46.105668 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:46.105493    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="kube-rbac-proxy-metric" containerID="cri-o://cbf0d7349aa983fa9367ad9711323bda66994c890f955d7d958dbdd617194929" gracePeriod=120
May 21 01:50:46.105668 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:46.105531    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="kube-rbac-proxy-web" containerID="cri-o://af43be9eff9f68539c7d5ec7c8978d049c077a58f8b000c643044dfd7eeb003d" gracePeriod=120
May 21 01:50:46.105668 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:46.105596    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="config-reloader" containerID="cri-o://10f0cf777b5973fc4ce9591639b40a0085960f68b118000de98db935ac87c6d9" gracePeriod=120
May 21 01:50:46.105855 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:46.105596    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="prom-label-proxy" containerID="cri-o://5647c1a42aeb174495f01b9385de44379de2cfa291f2be40766b7f735e424a22" gracePeriod=120
May 21 01:50:46.106420 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:46.106089    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="kube-rbac-proxy" containerID="cri-o://560df395eccfa3633f0fc0b16fccb705c7e2d0089c7d09adf04148dbe5a5c591" gracePeriod=120
May 21 01:50:47.021304 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.021274    2552 generic.go:358] "Generic (PLEG): container finished" podID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerID="5647c1a42aeb174495f01b9385de44379de2cfa291f2be40766b7f735e424a22" exitCode=0
May 21 01:50:47.021304 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.021299    2552 generic.go:358] "Generic (PLEG): container finished" podID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerID="560df395eccfa3633f0fc0b16fccb705c7e2d0089c7d09adf04148dbe5a5c591" exitCode=0
May 21 01:50:47.021304 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.021307    2552 generic.go:358] "Generic (PLEG): container finished" podID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerID="10f0cf777b5973fc4ce9591639b40a0085960f68b118000de98db935ac87c6d9" exitCode=0
May 21 01:50:47.021304 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.021313    2552 generic.go:358] "Generic (PLEG): container finished" podID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerID="b275cffe3496155dbe822b93f18729fa806eccf74b197d473ec0ffe6592057e3" exitCode=0
May 21 01:50:47.021618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.021346    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"deeccb08-77fa-48bd-aedc-d6a40a4158a6","Type":"ContainerDied","Data":"5647c1a42aeb174495f01b9385de44379de2cfa291f2be40766b7f735e424a22"}
May 21 01:50:47.021618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.021379    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"deeccb08-77fa-48bd-aedc-d6a40a4158a6","Type":"ContainerDied","Data":"560df395eccfa3633f0fc0b16fccb705c7e2d0089c7d09adf04148dbe5a5c591"}
May 21 01:50:47.021618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.021391    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"deeccb08-77fa-48bd-aedc-d6a40a4158a6","Type":"ContainerDied","Data":"10f0cf777b5973fc4ce9591639b40a0085960f68b118000de98db935ac87c6d9"}
May 21 01:50:47.021618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.021400    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"deeccb08-77fa-48bd-aedc-d6a40a4158a6","Type":"ContainerDied","Data":"b275cffe3496155dbe822b93f18729fa806eccf74b197d473ec0ffe6592057e3"}
May 21 01:50:47.353971 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.353602    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:47.501306 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.501275    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/deeccb08-77fa-48bd-aedc-d6a40a4158a6-config-out\") pod \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") "
May 21 01:50:47.501476 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.501321    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/deeccb08-77fa-48bd-aedc-d6a40a4158a6-alertmanager-main-db\") pod \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") "
May 21 01:50:47.501476 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.501339    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-web-config\") pod \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") "
May 21 01:50:47.501476 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.501360    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-cluster-tls-config\") pod \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") "
May 21 01:50:47.501476 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.501385    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") "
May 21 01:50:47.501476 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.501404    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-kube-rbac-proxy\") pod \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") "
May 21 01:50:47.501476 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.501422    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/deeccb08-77fa-48bd-aedc-d6a40a4158a6-tls-assets\") pod \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") "
May 21 01:50:47.501476 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.501442    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deeccb08-77fa-48bd-aedc-d6a40a4158a6-metrics-client-ca\") pod \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") "
May 21 01:50:47.501476 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.501479    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deeccb08-77fa-48bd-aedc-d6a40a4158a6-alertmanager-trusted-ca-bundle\") pod \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") "
May 21 01:50:47.501920 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.501517    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-config-volume\") pod \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") "
May 21 01:50:47.501920 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.501583    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncfs6\" (UniqueName: \"kubernetes.io/projected/deeccb08-77fa-48bd-aedc-d6a40a4158a6-kube-api-access-ncfs6\") pod \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") "
May 21 01:50:47.501920 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.501609    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-kube-rbac-proxy-web\") pod \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") "
May 21 01:50:47.501920 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.501647    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-main-tls\") pod \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\" (UID: \"deeccb08-77fa-48bd-aedc-d6a40a4158a6\") "
May 21 01:50:47.501920 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.501726    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deeccb08-77fa-48bd-aedc-d6a40a4158a6-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "deeccb08-77fa-48bd-aedc-d6a40a4158a6" (UID: "deeccb08-77fa-48bd-aedc-d6a40a4158a6"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:50:47.501920 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.501916    2552 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/deeccb08-77fa-48bd-aedc-d6a40a4158a6-alertmanager-main-db\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:50:47.502514 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.502291    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deeccb08-77fa-48bd-aedc-d6a40a4158a6-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "deeccb08-77fa-48bd-aedc-d6a40a4158a6" (UID: "deeccb08-77fa-48bd-aedc-d6a40a4158a6"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 01:50:47.502713 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.502689    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deeccb08-77fa-48bd-aedc-d6a40a4158a6-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "deeccb08-77fa-48bd-aedc-d6a40a4158a6" (UID: "deeccb08-77fa-48bd-aedc-d6a40a4158a6"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 01:50:47.504221 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.504193    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "deeccb08-77fa-48bd-aedc-d6a40a4158a6" (UID: "deeccb08-77fa-48bd-aedc-d6a40a4158a6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:50:47.504471 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.504440    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "deeccb08-77fa-48bd-aedc-d6a40a4158a6" (UID: "deeccb08-77fa-48bd-aedc-d6a40a4158a6"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:50:47.504587 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.504471    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deeccb08-77fa-48bd-aedc-d6a40a4158a6-config-out" (OuterVolumeSpecName: "config-out") pod "deeccb08-77fa-48bd-aedc-d6a40a4158a6" (UID: "deeccb08-77fa-48bd-aedc-d6a40a4158a6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:50:47.504587 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.504484    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "deeccb08-77fa-48bd-aedc-d6a40a4158a6" (UID: "deeccb08-77fa-48bd-aedc-d6a40a4158a6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:50:47.504830 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.504802    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deeccb08-77fa-48bd-aedc-d6a40a4158a6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "deeccb08-77fa-48bd-aedc-d6a40a4158a6" (UID: "deeccb08-77fa-48bd-aedc-d6a40a4158a6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:50:47.505155 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.505132    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deeccb08-77fa-48bd-aedc-d6a40a4158a6-kube-api-access-ncfs6" (OuterVolumeSpecName: "kube-api-access-ncfs6") pod "deeccb08-77fa-48bd-aedc-d6a40a4158a6" (UID: "deeccb08-77fa-48bd-aedc-d6a40a4158a6"). InnerVolumeSpecName "kube-api-access-ncfs6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:50:47.506126 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.506100    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-config-volume" (OuterVolumeSpecName: "config-volume") pod "deeccb08-77fa-48bd-aedc-d6a40a4158a6" (UID: "deeccb08-77fa-48bd-aedc-d6a40a4158a6"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:50:47.506202 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.506184    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "deeccb08-77fa-48bd-aedc-d6a40a4158a6" (UID: "deeccb08-77fa-48bd-aedc-d6a40a4158a6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:50:47.508350 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.508327    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "deeccb08-77fa-48bd-aedc-d6a40a4158a6" (UID: "deeccb08-77fa-48bd-aedc-d6a40a4158a6"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:50:47.515211 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.515187    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-web-config" (OuterVolumeSpecName: "web-config") pod "deeccb08-77fa-48bd-aedc-d6a40a4158a6" (UID: "deeccb08-77fa-48bd-aedc-d6a40a4158a6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:50:47.602369 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.602316    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncfs6\" (UniqueName: \"kubernetes.io/projected/deeccb08-77fa-48bd-aedc-d6a40a4158a6-kube-api-access-ncfs6\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:50:47.602369 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.602337    2552 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:50:47.602369 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.602349    2552 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-main-tls\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:50:47.602369 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.602359    2552 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/deeccb08-77fa-48bd-aedc-d6a40a4158a6-config-out\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:50:47.602369 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.602368    2552 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-web-config\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:50:47.602593 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.602375    2552 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-cluster-tls-config\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:50:47.602593 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.602385    2552 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:50:47.602593 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.602394    2552 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:50:47.602593 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.602402    2552 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/deeccb08-77fa-48bd-aedc-d6a40a4158a6-tls-assets\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:50:47.602593 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.602410    2552 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deeccb08-77fa-48bd-aedc-d6a40a4158a6-metrics-client-ca\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:50:47.602593 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.602418    2552 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deeccb08-77fa-48bd-aedc-d6a40a4158a6-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:50:47.602593 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:47.602427    2552 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/deeccb08-77fa-48bd-aedc-d6a40a4158a6-config-volume\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:50:48.027248 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.027220    2552 generic.go:358] "Generic (PLEG): container finished" podID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerID="cbf0d7349aa983fa9367ad9711323bda66994c890f955d7d958dbdd617194929" exitCode=0
May 21 01:50:48.027248 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.027245    2552 generic.go:358] "Generic (PLEG): container finished" podID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerID="af43be9eff9f68539c7d5ec7c8978d049c077a58f8b000c643044dfd7eeb003d" exitCode=0
May 21 01:50:48.027484 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.027303    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"deeccb08-77fa-48bd-aedc-d6a40a4158a6","Type":"ContainerDied","Data":"cbf0d7349aa983fa9367ad9711323bda66994c890f955d7d958dbdd617194929"}
May 21 01:50:48.027484 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.027342    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"deeccb08-77fa-48bd-aedc-d6a40a4158a6","Type":"ContainerDied","Data":"af43be9eff9f68539c7d5ec7c8978d049c077a58f8b000c643044dfd7eeb003d"}
May 21 01:50:48.027484 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.027354    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"deeccb08-77fa-48bd-aedc-d6a40a4158a6","Type":"ContainerDied","Data":"1107a28cfdeca5a82800ab95fbd7b91af89b3f8ed392e109983cb239f02f112a"}
May 21 01:50:48.027484 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.027369    2552 scope.go:117] "RemoveContainer" containerID="5647c1a42aeb174495f01b9385de44379de2cfa291f2be40766b7f735e424a22"
May 21 01:50:48.027484 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.027377    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.034368 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.034350    2552 scope.go:117] "RemoveContainer" containerID="cbf0d7349aa983fa9367ad9711323bda66994c890f955d7d958dbdd617194929"
May 21 01:50:48.041517 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.041494    2552 scope.go:117] "RemoveContainer" containerID="560df395eccfa3633f0fc0b16fccb705c7e2d0089c7d09adf04148dbe5a5c591"
May 21 01:50:48.049503 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.049486    2552 scope.go:117] "RemoveContainer" containerID="af43be9eff9f68539c7d5ec7c8978d049c077a58f8b000c643044dfd7eeb003d"
May 21 01:50:48.050738 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.050601    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 01:50:48.055016 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.054996    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 01:50:48.056221 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.056206    2552 scope.go:117] "RemoveContainer" containerID="10f0cf777b5973fc4ce9591639b40a0085960f68b118000de98db935ac87c6d9"
May 21 01:50:48.062644 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.062626    2552 scope.go:117] "RemoveContainer" containerID="b275cffe3496155dbe822b93f18729fa806eccf74b197d473ec0ffe6592057e3"
May 21 01:50:48.068828 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.068811    2552 scope.go:117] "RemoveContainer" containerID="116ff838aaec36d1e78f83da65fefcd49a9c8b766cc13cb7b0ab4d54da889763"
May 21 01:50:48.075312 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.075296    2552 scope.go:117] "RemoveContainer" containerID="5647c1a42aeb174495f01b9385de44379de2cfa291f2be40766b7f735e424a22"
May 21 01:50:48.075537 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:50:48.075519    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5647c1a42aeb174495f01b9385de44379de2cfa291f2be40766b7f735e424a22\": container with ID starting with 5647c1a42aeb174495f01b9385de44379de2cfa291f2be40766b7f735e424a22 not found: ID does not exist" containerID="5647c1a42aeb174495f01b9385de44379de2cfa291f2be40766b7f735e424a22"
May 21 01:50:48.075593 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.075563    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5647c1a42aeb174495f01b9385de44379de2cfa291f2be40766b7f735e424a22"} err="failed to get container status \"5647c1a42aeb174495f01b9385de44379de2cfa291f2be40766b7f735e424a22\": rpc error: code = NotFound desc = could not find container \"5647c1a42aeb174495f01b9385de44379de2cfa291f2be40766b7f735e424a22\": container with ID starting with 5647c1a42aeb174495f01b9385de44379de2cfa291f2be40766b7f735e424a22 not found: ID does not exist"
May 21 01:50:48.075593 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.075586    2552 scope.go:117] "RemoveContainer" containerID="cbf0d7349aa983fa9367ad9711323bda66994c890f955d7d958dbdd617194929"
May 21 01:50:48.075830 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:50:48.075814    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbf0d7349aa983fa9367ad9711323bda66994c890f955d7d958dbdd617194929\": container with ID starting with cbf0d7349aa983fa9367ad9711323bda66994c890f955d7d958dbdd617194929 not found: ID does not exist" containerID="cbf0d7349aa983fa9367ad9711323bda66994c890f955d7d958dbdd617194929"
May 21 01:50:48.075874 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.075836    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbf0d7349aa983fa9367ad9711323bda66994c890f955d7d958dbdd617194929"} err="failed to get container status \"cbf0d7349aa983fa9367ad9711323bda66994c890f955d7d958dbdd617194929\": rpc error: code = NotFound desc = could not find container \"cbf0d7349aa983fa9367ad9711323bda66994c890f955d7d958dbdd617194929\": container with ID starting with cbf0d7349aa983fa9367ad9711323bda66994c890f955d7d958dbdd617194929 not found: ID does not exist"
May 21 01:50:48.075874 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.075851    2552 scope.go:117] "RemoveContainer" containerID="560df395eccfa3633f0fc0b16fccb705c7e2d0089c7d09adf04148dbe5a5c591"
May 21 01:50:48.076041 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:50:48.076027    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"560df395eccfa3633f0fc0b16fccb705c7e2d0089c7d09adf04148dbe5a5c591\": container with ID starting with 560df395eccfa3633f0fc0b16fccb705c7e2d0089c7d09adf04148dbe5a5c591 not found: ID does not exist" containerID="560df395eccfa3633f0fc0b16fccb705c7e2d0089c7d09adf04148dbe5a5c591"
May 21 01:50:48.076077 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.076045    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"560df395eccfa3633f0fc0b16fccb705c7e2d0089c7d09adf04148dbe5a5c591"} err="failed to get container status \"560df395eccfa3633f0fc0b16fccb705c7e2d0089c7d09adf04148dbe5a5c591\": rpc error: code = NotFound desc = could not find container \"560df395eccfa3633f0fc0b16fccb705c7e2d0089c7d09adf04148dbe5a5c591\": container with ID starting with 560df395eccfa3633f0fc0b16fccb705c7e2d0089c7d09adf04148dbe5a5c591 not found: ID does not exist"
May 21 01:50:48.076077 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.076058    2552 scope.go:117] "RemoveContainer" containerID="af43be9eff9f68539c7d5ec7c8978d049c077a58f8b000c643044dfd7eeb003d"
May 21 01:50:48.076232 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:50:48.076216    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af43be9eff9f68539c7d5ec7c8978d049c077a58f8b000c643044dfd7eeb003d\": container with ID starting with af43be9eff9f68539c7d5ec7c8978d049c077a58f8b000c643044dfd7eeb003d not found: ID does not exist" containerID="af43be9eff9f68539c7d5ec7c8978d049c077a58f8b000c643044dfd7eeb003d"
May 21 01:50:48.076267 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.076237    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af43be9eff9f68539c7d5ec7c8978d049c077a58f8b000c643044dfd7eeb003d"} err="failed to get container status \"af43be9eff9f68539c7d5ec7c8978d049c077a58f8b000c643044dfd7eeb003d\": rpc error: code = NotFound desc = could not find container \"af43be9eff9f68539c7d5ec7c8978d049c077a58f8b000c643044dfd7eeb003d\": container with ID starting with af43be9eff9f68539c7d5ec7c8978d049c077a58f8b000c643044dfd7eeb003d not found: ID does not exist"
May 21 01:50:48.076267 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.076250    2552 scope.go:117] "RemoveContainer" containerID="10f0cf777b5973fc4ce9591639b40a0085960f68b118000de98db935ac87c6d9"
May 21 01:50:48.076448 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:50:48.076427    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10f0cf777b5973fc4ce9591639b40a0085960f68b118000de98db935ac87c6d9\": container with ID starting with 10f0cf777b5973fc4ce9591639b40a0085960f68b118000de98db935ac87c6d9 not found: ID does not exist" containerID="10f0cf777b5973fc4ce9591639b40a0085960f68b118000de98db935ac87c6d9"
May 21 01:50:48.076482 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.076454    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10f0cf777b5973fc4ce9591639b40a0085960f68b118000de98db935ac87c6d9"} err="failed to get container status \"10f0cf777b5973fc4ce9591639b40a0085960f68b118000de98db935ac87c6d9\": rpc error: code = NotFound desc = could not find container \"10f0cf777b5973fc4ce9591639b40a0085960f68b118000de98db935ac87c6d9\": container with ID starting with 10f0cf777b5973fc4ce9591639b40a0085960f68b118000de98db935ac87c6d9 not found: ID does not exist"
May 21 01:50:48.076482 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.076469    2552 scope.go:117] "RemoveContainer" containerID="b275cffe3496155dbe822b93f18729fa806eccf74b197d473ec0ffe6592057e3"
May 21 01:50:48.076838 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:50:48.076813    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b275cffe3496155dbe822b93f18729fa806eccf74b197d473ec0ffe6592057e3\": container with ID starting with b275cffe3496155dbe822b93f18729fa806eccf74b197d473ec0ffe6592057e3 not found: ID does not exist" containerID="b275cffe3496155dbe822b93f18729fa806eccf74b197d473ec0ffe6592057e3"
May 21 01:50:48.076940 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.076861    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b275cffe3496155dbe822b93f18729fa806eccf74b197d473ec0ffe6592057e3"} err="failed to get container status \"b275cffe3496155dbe822b93f18729fa806eccf74b197d473ec0ffe6592057e3\": rpc error: code = NotFound desc = could not find container \"b275cffe3496155dbe822b93f18729fa806eccf74b197d473ec0ffe6592057e3\": container with ID starting with b275cffe3496155dbe822b93f18729fa806eccf74b197d473ec0ffe6592057e3 not found: ID does not exist"
May 21 01:50:48.076940 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.076883    2552 scope.go:117] "RemoveContainer" containerID="116ff838aaec36d1e78f83da65fefcd49a9c8b766cc13cb7b0ab4d54da889763"
May 21 01:50:48.077157 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:50:48.077134    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"116ff838aaec36d1e78f83da65fefcd49a9c8b766cc13cb7b0ab4d54da889763\": container with ID starting with 116ff838aaec36d1e78f83da65fefcd49a9c8b766cc13cb7b0ab4d54da889763 not found: ID does not exist" containerID="116ff838aaec36d1e78f83da65fefcd49a9c8b766cc13cb7b0ab4d54da889763"
May 21 01:50:48.077217 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.077161    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"116ff838aaec36d1e78f83da65fefcd49a9c8b766cc13cb7b0ab4d54da889763"} err="failed to get container status \"116ff838aaec36d1e78f83da65fefcd49a9c8b766cc13cb7b0ab4d54da889763\": rpc error: code = NotFound desc = could not find container \"116ff838aaec36d1e78f83da65fefcd49a9c8b766cc13cb7b0ab4d54da889763\": container with ID starting with 116ff838aaec36d1e78f83da65fefcd49a9c8b766cc13cb7b0ab4d54da889763 not found: ID does not exist"
May 21 01:50:48.077217 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.077182    2552 scope.go:117] "RemoveContainer" containerID="5647c1a42aeb174495f01b9385de44379de2cfa291f2be40766b7f735e424a22"
May 21 01:50:48.077475 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.077456    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5647c1a42aeb174495f01b9385de44379de2cfa291f2be40766b7f735e424a22"} err="failed to get container status \"5647c1a42aeb174495f01b9385de44379de2cfa291f2be40766b7f735e424a22\": rpc error: code = NotFound desc = could not find container \"5647c1a42aeb174495f01b9385de44379de2cfa291f2be40766b7f735e424a22\": container with ID starting with 5647c1a42aeb174495f01b9385de44379de2cfa291f2be40766b7f735e424a22 not found: ID does not exist"
May 21 01:50:48.077575 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.077488    2552 scope.go:117] "RemoveContainer" containerID="cbf0d7349aa983fa9367ad9711323bda66994c890f955d7d958dbdd617194929"
May 21 01:50:48.077805 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.077777    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbf0d7349aa983fa9367ad9711323bda66994c890f955d7d958dbdd617194929"} err="failed to get container status \"cbf0d7349aa983fa9367ad9711323bda66994c890f955d7d958dbdd617194929\": rpc error: code = NotFound desc = could not find container \"cbf0d7349aa983fa9367ad9711323bda66994c890f955d7d958dbdd617194929\": container with ID starting with cbf0d7349aa983fa9367ad9711323bda66994c890f955d7d958dbdd617194929 not found: ID does not exist"
May 21 01:50:48.077889 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.077824    2552 scope.go:117] "RemoveContainer" containerID="560df395eccfa3633f0fc0b16fccb705c7e2d0089c7d09adf04148dbe5a5c591"
May 21 01:50:48.078083 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.078062    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"560df395eccfa3633f0fc0b16fccb705c7e2d0089c7d09adf04148dbe5a5c591"} err="failed to get container status \"560df395eccfa3633f0fc0b16fccb705c7e2d0089c7d09adf04148dbe5a5c591\": rpc error: code = NotFound desc = could not find container \"560df395eccfa3633f0fc0b16fccb705c7e2d0089c7d09adf04148dbe5a5c591\": container with ID starting with 560df395eccfa3633f0fc0b16fccb705c7e2d0089c7d09adf04148dbe5a5c591 not found: ID does not exist"
May 21 01:50:48.078170 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.078085    2552 scope.go:117] "RemoveContainer" containerID="af43be9eff9f68539c7d5ec7c8978d049c077a58f8b000c643044dfd7eeb003d"
May 21 01:50:48.078345 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.078328    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af43be9eff9f68539c7d5ec7c8978d049c077a58f8b000c643044dfd7eeb003d"} err="failed to get container status \"af43be9eff9f68539c7d5ec7c8978d049c077a58f8b000c643044dfd7eeb003d\": rpc error: code = NotFound desc = could not find container \"af43be9eff9f68539c7d5ec7c8978d049c077a58f8b000c643044dfd7eeb003d\": container with ID starting with af43be9eff9f68539c7d5ec7c8978d049c077a58f8b000c643044dfd7eeb003d not found: ID does not exist"
May 21 01:50:48.078411 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.078347    2552 scope.go:117] "RemoveContainer" containerID="10f0cf777b5973fc4ce9591639b40a0085960f68b118000de98db935ac87c6d9"
May 21 01:50:48.078525 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.078508    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 01:50:48.078633 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.078593    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10f0cf777b5973fc4ce9591639b40a0085960f68b118000de98db935ac87c6d9"} err="failed to get container status \"10f0cf777b5973fc4ce9591639b40a0085960f68b118000de98db935ac87c6d9\": rpc error: code = NotFound desc = could not find container \"10f0cf777b5973fc4ce9591639b40a0085960f68b118000de98db935ac87c6d9\": container with ID starting with 10f0cf777b5973fc4ce9591639b40a0085960f68b118000de98db935ac87c6d9 not found: ID does not exist"
May 21 01:50:48.078633 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.078612    2552 scope.go:117] "RemoveContainer" containerID="b275cffe3496155dbe822b93f18729fa806eccf74b197d473ec0ffe6592057e3"
May 21 01:50:48.078857 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.078839    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b275cffe3496155dbe822b93f18729fa806eccf74b197d473ec0ffe6592057e3"} err="failed to get container status \"b275cffe3496155dbe822b93f18729fa806eccf74b197d473ec0ffe6592057e3\": rpc error: code = NotFound desc = could not find container \"b275cffe3496155dbe822b93f18729fa806eccf74b197d473ec0ffe6592057e3\": container with ID starting with b275cffe3496155dbe822b93f18729fa806eccf74b197d473ec0ffe6592057e3 not found: ID does not exist"
May 21 01:50:48.078913 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.078863    2552 scope.go:117] "RemoveContainer" containerID="116ff838aaec36d1e78f83da65fefcd49a9c8b766cc13cb7b0ab4d54da889763"
May 21 01:50:48.078913 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.078885    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="init-config-reloader"
May 21 01:50:48.078913 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.078898    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="init-config-reloader"
May 21 01:50:48.079021 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.078914    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="kube-rbac-proxy-metric"
May 21 01:50:48.079021 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.078920    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="kube-rbac-proxy-metric"
May 21 01:50:48.079021 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.078927    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="prom-label-proxy"
May 21 01:50:48.079021 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.078931    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="prom-label-proxy"
May 21 01:50:48.079021 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.078945    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="kube-rbac-proxy"
May 21 01:50:48.079021 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.078954    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="kube-rbac-proxy"
May 21 01:50:48.079021 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.078963    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="alertmanager"
May 21 01:50:48.079021 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.078968    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="alertmanager"
May 21 01:50:48.079021 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.078978    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="config-reloader"
May 21 01:50:48.079021 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.078982    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="config-reloader"
May 21 01:50:48.079021 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.078988    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04370457-bf03-4f7e-81c2-fb702fd09fc4" containerName="console"
May 21 01:50:48.079021 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.078993    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="04370457-bf03-4f7e-81c2-fb702fd09fc4" containerName="console"
May 21 01:50:48.079021 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.078999    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="kube-rbac-proxy-web"
May 21 01:50:48.079021 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.079004    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="kube-rbac-proxy-web"
May 21 01:50:48.079452 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.079049    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="kube-rbac-proxy-web"
May 21 01:50:48.079452 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.079055    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="prom-label-proxy"
May 21 01:50:48.079452 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.079064    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="kube-rbac-proxy-metric"
May 21 01:50:48.079452 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.079072    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="config-reloader"
May 21 01:50:48.079452 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.079079    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="04370457-bf03-4f7e-81c2-fb702fd09fc4" containerName="console"
May 21 01:50:48.079452 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.079085    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="alertmanager"
May 21 01:50:48.079452 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.079090    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" containerName="kube-rbac-proxy"
May 21 01:50:48.079452 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.079106    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"116ff838aaec36d1e78f83da65fefcd49a9c8b766cc13cb7b0ab4d54da889763"} err="failed to get container status \"116ff838aaec36d1e78f83da65fefcd49a9c8b766cc13cb7b0ab4d54da889763\": rpc error: code = NotFound desc = could not find container \"116ff838aaec36d1e78f83da65fefcd49a9c8b766cc13cb7b0ab4d54da889763\": container with ID starting with 116ff838aaec36d1e78f83da65fefcd49a9c8b766cc13cb7b0ab4d54da889763 not found: ID does not exist"
May 21 01:50:48.084050 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.084033    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.086582 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.086536    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 21 01:50:48.086840 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.086819    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 21 01:50:48.086982 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.086848    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 21 01:50:48.086982 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.086890    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 21 01:50:48.086982 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.086903    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 21 01:50:48.086982 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.086920    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 21 01:50:48.086982 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.086922    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 21 01:50:48.086982 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.086980    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 21 01:50:48.087234 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.087141    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pvkgx\""
May 21 01:50:48.091440 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.091421    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 21 01:50:48.094520 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.094501    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 01:50:48.207742 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.207715    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eee54894-1321-485d-8741-deaad2c1bdfa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.207850 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.207756    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eee54894-1321-485d-8741-deaad2c1bdfa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.207850 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.207825    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eee54894-1321-485d-8741-deaad2c1bdfa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.207969 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.207874    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eee54894-1321-485d-8741-deaad2c1bdfa-web-config\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.207969 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.207900    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlzrl\" (UniqueName: \"kubernetes.io/projected/eee54894-1321-485d-8741-deaad2c1bdfa-kube-api-access-tlzrl\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.207969 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.207926    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eee54894-1321-485d-8741-deaad2c1bdfa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.208118 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.207990    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eee54894-1321-485d-8741-deaad2c1bdfa-config-volume\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.208118 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.208024    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eee54894-1321-485d-8741-deaad2c1bdfa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.208118 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.208067    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eee54894-1321-485d-8741-deaad2c1bdfa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.208118 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.208101    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eee54894-1321-485d-8741-deaad2c1bdfa-config-out\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.208294 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.208150    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eee54894-1321-485d-8741-deaad2c1bdfa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.208294 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.208176    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eee54894-1321-485d-8741-deaad2c1bdfa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.208294 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.208203    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eee54894-1321-485d-8741-deaad2c1bdfa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.309004 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.308948    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eee54894-1321-485d-8741-deaad2c1bdfa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.309004 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.308976    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eee54894-1321-485d-8741-deaad2c1bdfa-web-config\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.309004 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.308996    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tlzrl\" (UniqueName: \"kubernetes.io/projected/eee54894-1321-485d-8741-deaad2c1bdfa-kube-api-access-tlzrl\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.309205 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.309012    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eee54894-1321-485d-8741-deaad2c1bdfa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.309205 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.309142    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eee54894-1321-485d-8741-deaad2c1bdfa-config-volume\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.309205 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.309178    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eee54894-1321-485d-8741-deaad2c1bdfa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.309345 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.309211    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eee54894-1321-485d-8741-deaad2c1bdfa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.309345 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.309243    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eee54894-1321-485d-8741-deaad2c1bdfa-config-out\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.309345 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.309275    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eee54894-1321-485d-8741-deaad2c1bdfa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.309737 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.309708    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eee54894-1321-485d-8741-deaad2c1bdfa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.309833 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.309776    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eee54894-1321-485d-8741-deaad2c1bdfa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.309833 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.309809    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eee54894-1321-485d-8741-deaad2c1bdfa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.309997 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.309861    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eee54894-1321-485d-8741-deaad2c1bdfa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.309997 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.309898    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eee54894-1321-485d-8741-deaad2c1bdfa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.312155 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.311836    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eee54894-1321-485d-8741-deaad2c1bdfa-config-out\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.312155 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.312067    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eee54894-1321-485d-8741-deaad2c1bdfa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.312155 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.312095    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eee54894-1321-485d-8741-deaad2c1bdfa-web-config\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.312380 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.312157    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eee54894-1321-485d-8741-deaad2c1bdfa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.312380 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.312254    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eee54894-1321-485d-8741-deaad2c1bdfa-config-volume\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.312380 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.312370    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eee54894-1321-485d-8741-deaad2c1bdfa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.312593 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.312566    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eee54894-1321-485d-8741-deaad2c1bdfa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.312681 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.312660    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eee54894-1321-485d-8741-deaad2c1bdfa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.312985 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.312965    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eee54894-1321-485d-8741-deaad2c1bdfa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.313125 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.313104    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eee54894-1321-485d-8741-deaad2c1bdfa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.314021 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.313999    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eee54894-1321-485d-8741-deaad2c1bdfa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.321240 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.321215    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="deeccb08-77fa-48bd-aedc-d6a40a4158a6" path="/var/lib/kubelet/pods/deeccb08-77fa-48bd-aedc-d6a40a4158a6/volumes"
May 21 01:50:48.323946 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.323925    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlzrl\" (UniqueName: \"kubernetes.io/projected/eee54894-1321-485d-8741-deaad2c1bdfa-kube-api-access-tlzrl\") pod \"alertmanager-main-0\" (UID: \"eee54894-1321-485d-8741-deaad2c1bdfa\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.393116 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.393095    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 01:50:48.520351 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:48.520189    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 01:50:48.523097 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:50:48.523074    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeee54894_1321_485d_8741_deaad2c1bdfa.slice/crio-70a98f5587b68ad6e36ba608a7953e1b657abc1088aaf673eaec42d10ed813d3 WatchSource:0}: Error finding container 70a98f5587b68ad6e36ba608a7953e1b657abc1088aaf673eaec42d10ed813d3: Status 404 returned error can't find the container with id 70a98f5587b68ad6e36ba608a7953e1b657abc1088aaf673eaec42d10ed813d3
May 21 01:50:49.031133 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:49.031099    2552 generic.go:358] "Generic (PLEG): container finished" podID="eee54894-1321-485d-8741-deaad2c1bdfa" containerID="84b02348cbd7f96d3e3e6351547dc98263c33989c3dd94b0436e6fd5a028162a" exitCode=0
May 21 01:50:49.031274 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:49.031183    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eee54894-1321-485d-8741-deaad2c1bdfa","Type":"ContainerDied","Data":"84b02348cbd7f96d3e3e6351547dc98263c33989c3dd94b0436e6fd5a028162a"}
May 21 01:50:49.031274 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:49.031219    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eee54894-1321-485d-8741-deaad2c1bdfa","Type":"ContainerStarted","Data":"70a98f5587b68ad6e36ba608a7953e1b657abc1088aaf673eaec42d10ed813d3"}
May 21 01:50:50.037807 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.037768    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eee54894-1321-485d-8741-deaad2c1bdfa","Type":"ContainerStarted","Data":"edf084b27007f5210f24f1e4b75d49811a8c911f50fa2c9dbce7b7dee583de46"}
May 21 01:50:50.037807 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.037811    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eee54894-1321-485d-8741-deaad2c1bdfa","Type":"ContainerStarted","Data":"25ba08748a625cfbb46c3920f8fb72c62e10421804ca4af82f6a45d110a07a5a"}
May 21 01:50:50.038248 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.037826    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eee54894-1321-485d-8741-deaad2c1bdfa","Type":"ContainerStarted","Data":"7f0f85fe060683e1808535908a02acfa6172639163ee7123ec7bf69d62b7f4d5"}
May 21 01:50:50.038248 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.037839    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eee54894-1321-485d-8741-deaad2c1bdfa","Type":"ContainerStarted","Data":"13ee0648e1cfd1ec63334d1fbed7d2fda8012fc2736cae15a2c2a464e138f397"}
May 21 01:50:50.038248 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.037852    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eee54894-1321-485d-8741-deaad2c1bdfa","Type":"ContainerStarted","Data":"85e09ed7811a269d549f16c499ccfd5565e472c4ba11c1765f1a13fdb8efec88"}
May 21 01:50:50.038248 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.037866    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eee54894-1321-485d-8741-deaad2c1bdfa","Type":"ContainerStarted","Data":"ba84a474dde0b8b5e15d044cf79bdb1bc8bf88aa3fbbe4663ff6ce78adcabc5e"}
May 21 01:50:50.062798 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.062733    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.062719633 podStartE2EDuration="2.062719633s" podCreationTimestamp="2026-05-21 01:50:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 01:50:50.060968918 +0000 UTC m=+188.348215695" watchObservedRunningTime="2026-05-21 01:50:50.062719633 +0000 UTC m=+188.349966410"
May 21 01:50:50.133971 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.133946    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-54f6dc646-9b9fd"]
May 21 01:50:50.137396 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.137378    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.141057 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.141036    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 21 01:50:50.141159 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.141059    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-nr9xt\""
May 21 01:50:50.141492 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.141472    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 21 01:50:50.141618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.141480    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 21 01:50:50.141748 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.141722    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 21 01:50:50.141823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.141779    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 21 01:50:50.145512 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.145494    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 21 01:50:50.149690 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.149671    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-54f6dc646-9b9fd"]
May 21 01:50:50.225308 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.225282    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1ed7f816-35a4-47e8-892a-1f0441be15f2-secret-telemeter-client\") pod \"telemeter-client-54f6dc646-9b9fd\" (UID: \"1ed7f816-35a4-47e8-892a-1f0441be15f2\") " pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.225308 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.225310    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1ed7f816-35a4-47e8-892a-1f0441be15f2-federate-client-tls\") pod \"telemeter-client-54f6dc646-9b9fd\" (UID: \"1ed7f816-35a4-47e8-892a-1f0441be15f2\") " pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.225465 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.225327    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5q2f\" (UniqueName: \"kubernetes.io/projected/1ed7f816-35a4-47e8-892a-1f0441be15f2-kube-api-access-f5q2f\") pod \"telemeter-client-54f6dc646-9b9fd\" (UID: \"1ed7f816-35a4-47e8-892a-1f0441be15f2\") " pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.225465 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.225343    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ed7f816-35a4-47e8-892a-1f0441be15f2-serving-certs-ca-bundle\") pod \"telemeter-client-54f6dc646-9b9fd\" (UID: \"1ed7f816-35a4-47e8-892a-1f0441be15f2\") " pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.225465 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.225424    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ed7f816-35a4-47e8-892a-1f0441be15f2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-54f6dc646-9b9fd\" (UID: \"1ed7f816-35a4-47e8-892a-1f0441be15f2\") " pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.225623 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.225474    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1ed7f816-35a4-47e8-892a-1f0441be15f2-telemeter-client-tls\") pod \"telemeter-client-54f6dc646-9b9fd\" (UID: \"1ed7f816-35a4-47e8-892a-1f0441be15f2\") " pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.225623 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.225500    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ed7f816-35a4-47e8-892a-1f0441be15f2-metrics-client-ca\") pod \"telemeter-client-54f6dc646-9b9fd\" (UID: \"1ed7f816-35a4-47e8-892a-1f0441be15f2\") " pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.225623 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.225529    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ed7f816-35a4-47e8-892a-1f0441be15f2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-54f6dc646-9b9fd\" (UID: \"1ed7f816-35a4-47e8-892a-1f0441be15f2\") " pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.326161 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.326090    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f5q2f\" (UniqueName: \"kubernetes.io/projected/1ed7f816-35a4-47e8-892a-1f0441be15f2-kube-api-access-f5q2f\") pod \"telemeter-client-54f6dc646-9b9fd\" (UID: \"1ed7f816-35a4-47e8-892a-1f0441be15f2\") " pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.326161 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.326144    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ed7f816-35a4-47e8-892a-1f0441be15f2-serving-certs-ca-bundle\") pod \"telemeter-client-54f6dc646-9b9fd\" (UID: \"1ed7f816-35a4-47e8-892a-1f0441be15f2\") " pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.326330 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.326179    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ed7f816-35a4-47e8-892a-1f0441be15f2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-54f6dc646-9b9fd\" (UID: \"1ed7f816-35a4-47e8-892a-1f0441be15f2\") " pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.326330 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.326212    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1ed7f816-35a4-47e8-892a-1f0441be15f2-telemeter-client-tls\") pod \"telemeter-client-54f6dc646-9b9fd\" (UID: \"1ed7f816-35a4-47e8-892a-1f0441be15f2\") " pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.326330 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.326259    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ed7f816-35a4-47e8-892a-1f0441be15f2-metrics-client-ca\") pod \"telemeter-client-54f6dc646-9b9fd\" (UID: \"1ed7f816-35a4-47e8-892a-1f0441be15f2\") " pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.326330 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.326316    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ed7f816-35a4-47e8-892a-1f0441be15f2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-54f6dc646-9b9fd\" (UID: \"1ed7f816-35a4-47e8-892a-1f0441be15f2\") " pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.326520 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.326406    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1ed7f816-35a4-47e8-892a-1f0441be15f2-secret-telemeter-client\") pod \"telemeter-client-54f6dc646-9b9fd\" (UID: \"1ed7f816-35a4-47e8-892a-1f0441be15f2\") " pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.326520 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.326440    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1ed7f816-35a4-47e8-892a-1f0441be15f2-federate-client-tls\") pod \"telemeter-client-54f6dc646-9b9fd\" (UID: \"1ed7f816-35a4-47e8-892a-1f0441be15f2\") " pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.327266 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.327240    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ed7f816-35a4-47e8-892a-1f0441be15f2-serving-certs-ca-bundle\") pod \"telemeter-client-54f6dc646-9b9fd\" (UID: \"1ed7f816-35a4-47e8-892a-1f0441be15f2\") " pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.327374 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.327310    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ed7f816-35a4-47e8-892a-1f0441be15f2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-54f6dc646-9b9fd\" (UID: \"1ed7f816-35a4-47e8-892a-1f0441be15f2\") " pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.327374 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.327350    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ed7f816-35a4-47e8-892a-1f0441be15f2-metrics-client-ca\") pod \"telemeter-client-54f6dc646-9b9fd\" (UID: \"1ed7f816-35a4-47e8-892a-1f0441be15f2\") " pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.329040 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.328993    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ed7f816-35a4-47e8-892a-1f0441be15f2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-54f6dc646-9b9fd\" (UID: \"1ed7f816-35a4-47e8-892a-1f0441be15f2\") " pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.329160 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.329142    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1ed7f816-35a4-47e8-892a-1f0441be15f2-secret-telemeter-client\") pod \"telemeter-client-54f6dc646-9b9fd\" (UID: \"1ed7f816-35a4-47e8-892a-1f0441be15f2\") " pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.329314 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.329295    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1ed7f816-35a4-47e8-892a-1f0441be15f2-telemeter-client-tls\") pod \"telemeter-client-54f6dc646-9b9fd\" (UID: \"1ed7f816-35a4-47e8-892a-1f0441be15f2\") " pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.329372 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.329325    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1ed7f816-35a4-47e8-892a-1f0441be15f2-federate-client-tls\") pod \"telemeter-client-54f6dc646-9b9fd\" (UID: \"1ed7f816-35a4-47e8-892a-1f0441be15f2\") " pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.334681 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.334660    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5q2f\" (UniqueName: \"kubernetes.io/projected/1ed7f816-35a4-47e8-892a-1f0441be15f2-kube-api-access-f5q2f\") pod \"telemeter-client-54f6dc646-9b9fd\" (UID: \"1ed7f816-35a4-47e8-892a-1f0441be15f2\") " pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.447952 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.447928    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd"
May 21 01:50:50.589769 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:50.589745    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-54f6dc646-9b9fd"]
May 21 01:50:50.592014 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:50:50.591989    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ed7f816_35a4_47e8_892a_1f0441be15f2.slice/crio-78548a8d44a0552901ded9d83a8831dab41b12fb79c6a929ee691dd921f15600 WatchSource:0}: Error finding container 78548a8d44a0552901ded9d83a8831dab41b12fb79c6a929ee691dd921f15600: Status 404 returned error can't find the container with id 78548a8d44a0552901ded9d83a8831dab41b12fb79c6a929ee691dd921f15600
May 21 01:50:51.043480 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:51.043443    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd" event={"ID":"1ed7f816-35a4-47e8-892a-1f0441be15f2","Type":"ContainerStarted","Data":"78548a8d44a0552901ded9d83a8831dab41b12fb79c6a929ee691dd921f15600"}
May 21 01:50:53.051084 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.051044    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd" event={"ID":"1ed7f816-35a4-47e8-892a-1f0441be15f2","Type":"ContainerStarted","Data":"e09a352bd3838179d3c2e621a41b10a17c872e6222c426d6b0495984913343ec"}
May 21 01:50:53.051084 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.051085    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd" event={"ID":"1ed7f816-35a4-47e8-892a-1f0441be15f2","Type":"ContainerStarted","Data":"2910f4b2ee87397c1dd15d02d6a16302091fcb6d181688fbaf0185aa53bdea38"}
May 21 01:50:53.051084 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.051094    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd" event={"ID":"1ed7f816-35a4-47e8-892a-1f0441be15f2","Type":"ContainerStarted","Data":"a01584a9fcb8d9feaed93889d0782d7e590ea391e41b75b22e3d85802cd60c47"}
May 21 01:50:53.074881 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.074831    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-54f6dc646-9b9fd" podStartSLOduration=1.4863294950000001 podStartE2EDuration="3.074819063s" podCreationTimestamp="2026-05-21 01:50:50 +0000 UTC" firstStartedPulling="2026-05-21 01:50:50.594290081 +0000 UTC m=+188.881536848" lastFinishedPulling="2026-05-21 01:50:52.182779647 +0000 UTC m=+190.470026416" observedRunningTime="2026-05-21 01:50:53.073423458 +0000 UTC m=+191.360670257" watchObservedRunningTime="2026-05-21 01:50:53.074819063 +0000 UTC m=+191.362065868"
May 21 01:50:53.743671 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.743640    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-9d9bf5cbd-4vtvr"]
May 21 01:50:53.747422 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.747399    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:50:53.758737 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.758703    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9d9bf5cbd-4vtvr"]
May 21 01:50:53.854529 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.854495    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/874a6156-0d5c-4a51-a100-b9db216e4a54-oauth-serving-cert\") pod \"console-9d9bf5cbd-4vtvr\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") " pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:50:53.854696 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.854533    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/874a6156-0d5c-4a51-a100-b9db216e4a54-console-serving-cert\") pod \"console-9d9bf5cbd-4vtvr\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") " pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:50:53.854696 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.854612    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/874a6156-0d5c-4a51-a100-b9db216e4a54-trusted-ca-bundle\") pod \"console-9d9bf5cbd-4vtvr\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") " pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:50:53.854696 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.854672    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/874a6156-0d5c-4a51-a100-b9db216e4a54-service-ca\") pod \"console-9d9bf5cbd-4vtvr\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") " pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:50:53.854866 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.854699    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/874a6156-0d5c-4a51-a100-b9db216e4a54-console-oauth-config\") pod \"console-9d9bf5cbd-4vtvr\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") " pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:50:53.854866 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.854749    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/874a6156-0d5c-4a51-a100-b9db216e4a54-console-config\") pod \"console-9d9bf5cbd-4vtvr\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") " pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:50:53.854866 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.854840    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7rqf\" (UniqueName: \"kubernetes.io/projected/874a6156-0d5c-4a51-a100-b9db216e4a54-kube-api-access-p7rqf\") pod \"console-9d9bf5cbd-4vtvr\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") " pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:50:53.955433 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.955401    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/874a6156-0d5c-4a51-a100-b9db216e4a54-oauth-serving-cert\") pod \"console-9d9bf5cbd-4vtvr\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") " pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:50:53.955578 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.955449    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/874a6156-0d5c-4a51-a100-b9db216e4a54-console-serving-cert\") pod \"console-9d9bf5cbd-4vtvr\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") " pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:50:53.955578 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.955497    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/874a6156-0d5c-4a51-a100-b9db216e4a54-trusted-ca-bundle\") pod \"console-9d9bf5cbd-4vtvr\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") " pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:50:53.955578 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.955536    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/874a6156-0d5c-4a51-a100-b9db216e4a54-service-ca\") pod \"console-9d9bf5cbd-4vtvr\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") " pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:50:53.955767 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.955594    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/874a6156-0d5c-4a51-a100-b9db216e4a54-console-oauth-config\") pod \"console-9d9bf5cbd-4vtvr\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") " pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:50:53.955767 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.955626    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/874a6156-0d5c-4a51-a100-b9db216e4a54-console-config\") pod \"console-9d9bf5cbd-4vtvr\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") " pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:50:53.955767 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.955691    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p7rqf\" (UniqueName: \"kubernetes.io/projected/874a6156-0d5c-4a51-a100-b9db216e4a54-kube-api-access-p7rqf\") pod \"console-9d9bf5cbd-4vtvr\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") " pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:50:53.956189 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.956160    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/874a6156-0d5c-4a51-a100-b9db216e4a54-oauth-serving-cert\") pod \"console-9d9bf5cbd-4vtvr\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") " pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:50:53.956441 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.956408    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/874a6156-0d5c-4a51-a100-b9db216e4a54-trusted-ca-bundle\") pod \"console-9d9bf5cbd-4vtvr\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") " pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:50:53.956441 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.956426    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/874a6156-0d5c-4a51-a100-b9db216e4a54-console-config\") pod \"console-9d9bf5cbd-4vtvr\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") " pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:50:53.956732 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.956714    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/874a6156-0d5c-4a51-a100-b9db216e4a54-service-ca\") pod \"console-9d9bf5cbd-4vtvr\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") " pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:50:53.958034 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.958009    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/874a6156-0d5c-4a51-a100-b9db216e4a54-console-oauth-config\") pod \"console-9d9bf5cbd-4vtvr\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") " pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:50:53.958288 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.958270    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/874a6156-0d5c-4a51-a100-b9db216e4a54-console-serving-cert\") pod \"console-9d9bf5cbd-4vtvr\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") " pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:50:53.963038 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:53.963016    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7rqf\" (UniqueName: \"kubernetes.io/projected/874a6156-0d5c-4a51-a100-b9db216e4a54-kube-api-access-p7rqf\") pod \"console-9d9bf5cbd-4vtvr\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") " pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:50:54.058491 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:54.058435    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:50:54.185044 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:54.185019    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9d9bf5cbd-4vtvr"]
May 21 01:50:54.186712 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:50:54.186686    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod874a6156_0d5c_4a51_a100_b9db216e4a54.slice/crio-ca640e9d9a7014b9335890f062b49457eba661b003bcb0226357bb255fa92f97 WatchSource:0}: Error finding container ca640e9d9a7014b9335890f062b49457eba661b003bcb0226357bb255fa92f97: Status 404 returned error can't find the container with id ca640e9d9a7014b9335890f062b49457eba661b003bcb0226357bb255fa92f97
May 21 01:50:55.058301 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:55.058265    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9d9bf5cbd-4vtvr" event={"ID":"874a6156-0d5c-4a51-a100-b9db216e4a54","Type":"ContainerStarted","Data":"c327a9c456ab545cc1d7334622c51ad8dc493a0fbb3c2fe56923262b1d006363"}
May 21 01:50:55.058479 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:55.058308    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9d9bf5cbd-4vtvr" event={"ID":"874a6156-0d5c-4a51-a100-b9db216e4a54","Type":"ContainerStarted","Data":"ca640e9d9a7014b9335890f062b49457eba661b003bcb0226357bb255fa92f97"}
May 21 01:50:55.074660 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:50:55.074610    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-9d9bf5cbd-4vtvr" podStartSLOduration=2.074596643 podStartE2EDuration="2.074596643s" podCreationTimestamp="2026-05-21 01:50:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 01:50:55.073721582 +0000 UTC m=+193.360968358" watchObservedRunningTime="2026-05-21 01:50:55.074596643 +0000 UTC m=+193.361843421"
May 21 01:51:04.058571 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:04.058527    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:51:04.058571 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:04.058575    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:51:04.062877 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:04.062860    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:51:04.089795 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:04.089771    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:51:04.131228 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:04.131198    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d75c7ccc7-j25r8"]
May 21 01:51:29.150703 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:29.150643    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-d75c7ccc7-j25r8" podUID="9589b2bc-8ccb-4ca4-b0f9-99a82effeec9" containerName="console" containerID="cri-o://f66ecabec363a38d890eeefc265d31ddfed11d57f30177321532b37b91e21f22" gracePeriod=15
May 21 01:51:29.392024 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:29.392002    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d75c7ccc7-j25r8_9589b2bc-8ccb-4ca4-b0f9-99a82effeec9/console/0.log"
May 21 01:51:29.392122 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:29.392061    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:51:29.521163 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:29.521133    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-trusted-ca-bundle\") pod \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") "
May 21 01:51:29.521308 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:29.521188    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-console-serving-cert\") pod \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") "
May 21 01:51:29.521308 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:29.521216    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-oauth-serving-cert\") pod \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") "
May 21 01:51:29.521308 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:29.521266    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-console-config\") pod \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") "
May 21 01:51:29.521478 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:29.521331    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-console-oauth-config\") pod \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") "
May 21 01:51:29.521478 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:29.521377    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-service-ca\") pod \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") "
May 21 01:51:29.521478 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:29.521417    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88p2s\" (UniqueName: \"kubernetes.io/projected/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-kube-api-access-88p2s\") pod \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\" (UID: \"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9\") "
May 21 01:51:29.521666 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:29.521605    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9589b2bc-8ccb-4ca4-b0f9-99a82effeec9" (UID: "9589b2bc-8ccb-4ca4-b0f9-99a82effeec9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 01:51:29.521808 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:29.521745    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9589b2bc-8ccb-4ca4-b0f9-99a82effeec9" (UID: "9589b2bc-8ccb-4ca4-b0f9-99a82effeec9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 01:51:29.521808 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:29.521787    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-console-config" (OuterVolumeSpecName: "console-config") pod "9589b2bc-8ccb-4ca4-b0f9-99a82effeec9" (UID: "9589b2bc-8ccb-4ca4-b0f9-99a82effeec9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 01:51:29.521924 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:29.521835    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-service-ca" (OuterVolumeSpecName: "service-ca") pod "9589b2bc-8ccb-4ca4-b0f9-99a82effeec9" (UID: "9589b2bc-8ccb-4ca4-b0f9-99a82effeec9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 01:51:29.523273 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:29.523242    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9589b2bc-8ccb-4ca4-b0f9-99a82effeec9" (UID: "9589b2bc-8ccb-4ca4-b0f9-99a82effeec9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:51:29.523365 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:29.523286    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9589b2bc-8ccb-4ca4-b0f9-99a82effeec9" (UID: "9589b2bc-8ccb-4ca4-b0f9-99a82effeec9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:51:29.523692 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:29.523667    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-kube-api-access-88p2s" (OuterVolumeSpecName: "kube-api-access-88p2s") pod "9589b2bc-8ccb-4ca4-b0f9-99a82effeec9" (UID: "9589b2bc-8ccb-4ca4-b0f9-99a82effeec9"). InnerVolumeSpecName "kube-api-access-88p2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:51:29.622629 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:29.622610    2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-console-config\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:51:29.622629 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:29.622629    2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-console-oauth-config\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:51:29.622768 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:29.622639    2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-service-ca\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:51:29.622768 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:29.622648    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88p2s\" (UniqueName: \"kubernetes.io/projected/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-kube-api-access-88p2s\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:51:29.622768 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:29.622658    2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-trusted-ca-bundle\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:51:29.622768 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:29.622666    2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-console-serving-cert\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:51:29.622768 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:29.622676    2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9-oauth-serving-cert\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:51:30.161867 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:30.161844    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d75c7ccc7-j25r8_9589b2bc-8ccb-4ca4-b0f9-99a82effeec9/console/0.log"
May 21 01:51:30.162293 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:30.161880    2552 generic.go:358] "Generic (PLEG): container finished" podID="9589b2bc-8ccb-4ca4-b0f9-99a82effeec9" containerID="f66ecabec363a38d890eeefc265d31ddfed11d57f30177321532b37b91e21f22" exitCode=2
May 21 01:51:30.162293 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:30.161964    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d75c7ccc7-j25r8"
May 21 01:51:30.162293 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:30.161966    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d75c7ccc7-j25r8" event={"ID":"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9","Type":"ContainerDied","Data":"f66ecabec363a38d890eeefc265d31ddfed11d57f30177321532b37b91e21f22"}
May 21 01:51:30.162293 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:30.162001    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d75c7ccc7-j25r8" event={"ID":"9589b2bc-8ccb-4ca4-b0f9-99a82effeec9","Type":"ContainerDied","Data":"4a557a4e4e08d4fe98ae9613cec94a20d67684e817ccbce8528693a2837009fb"}
May 21 01:51:30.162293 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:30.162017    2552 scope.go:117] "RemoveContainer" containerID="f66ecabec363a38d890eeefc265d31ddfed11d57f30177321532b37b91e21f22"
May 21 01:51:30.170082 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:30.170067    2552 scope.go:117] "RemoveContainer" containerID="f66ecabec363a38d890eeefc265d31ddfed11d57f30177321532b37b91e21f22"
May 21 01:51:30.170295 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:51:30.170272    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f66ecabec363a38d890eeefc265d31ddfed11d57f30177321532b37b91e21f22\": container with ID starting with f66ecabec363a38d890eeefc265d31ddfed11d57f30177321532b37b91e21f22 not found: ID does not exist" containerID="f66ecabec363a38d890eeefc265d31ddfed11d57f30177321532b37b91e21f22"
May 21 01:51:30.170356 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:30.170307    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f66ecabec363a38d890eeefc265d31ddfed11d57f30177321532b37b91e21f22"} err="failed to get container status \"f66ecabec363a38d890eeefc265d31ddfed11d57f30177321532b37b91e21f22\": rpc error: code = NotFound desc = could not find container \"f66ecabec363a38d890eeefc265d31ddfed11d57f30177321532b37b91e21f22\": container with ID starting with f66ecabec363a38d890eeefc265d31ddfed11d57f30177321532b37b91e21f22 not found: ID does not exist"
May 21 01:51:30.209424 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:30.209401    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d75c7ccc7-j25r8"]
May 21 01:51:30.223350 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:30.223330    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d75c7ccc7-j25r8"]
May 21 01:51:30.321463 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:51:30.321438    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9589b2bc-8ccb-4ca4-b0f9-99a82effeec9" path="/var/lib/kubelet/pods/9589b2bc-8ccb-4ca4-b0f9-99a82effeec9/volumes"
May 21 01:52:13.617087 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.617050    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-f7d7d75b9-txv5c"]
May 21 01:52:13.617606 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.617380    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9589b2bc-8ccb-4ca4-b0f9-99a82effeec9" containerName="console"
May 21 01:52:13.617606 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.617395    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="9589b2bc-8ccb-4ca4-b0f9-99a82effeec9" containerName="console"
May 21 01:52:13.617606 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.617456    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="9589b2bc-8ccb-4ca4-b0f9-99a82effeec9" containerName="console"
May 21 01:52:13.619481 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.619460    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:13.651180 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.651157    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f7d7d75b9-txv5c"]
May 21 01:52:13.744809 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.744780    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18c12a74-ee04-4f20-8a73-96c90f4224cb-console-serving-cert\") pod \"console-f7d7d75b9-txv5c\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") " pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:13.744809 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.744811    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knmxn\" (UniqueName: \"kubernetes.io/projected/18c12a74-ee04-4f20-8a73-96c90f4224cb-kube-api-access-knmxn\") pod \"console-f7d7d75b9-txv5c\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") " pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:13.744969 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.744838    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18c12a74-ee04-4f20-8a73-96c90f4224cb-oauth-serving-cert\") pod \"console-f7d7d75b9-txv5c\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") " pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:13.744969 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.744917    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18c12a74-ee04-4f20-8a73-96c90f4224cb-console-config\") pod \"console-f7d7d75b9-txv5c\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") " pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:13.744969 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.744944    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18c12a74-ee04-4f20-8a73-96c90f4224cb-console-oauth-config\") pod \"console-f7d7d75b9-txv5c\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") " pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:13.744969 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.744966    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18c12a74-ee04-4f20-8a73-96c90f4224cb-trusted-ca-bundle\") pod \"console-f7d7d75b9-txv5c\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") " pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:13.745114 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.744998    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18c12a74-ee04-4f20-8a73-96c90f4224cb-service-ca\") pod \"console-f7d7d75b9-txv5c\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") " pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:13.845696 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.845669    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18c12a74-ee04-4f20-8a73-96c90f4224cb-oauth-serving-cert\") pod \"console-f7d7d75b9-txv5c\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") " pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:13.845814 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.845711    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18c12a74-ee04-4f20-8a73-96c90f4224cb-console-config\") pod \"console-f7d7d75b9-txv5c\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") " pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:13.845814 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.845752    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18c12a74-ee04-4f20-8a73-96c90f4224cb-console-oauth-config\") pod \"console-f7d7d75b9-txv5c\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") " pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:13.845814 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.845776    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18c12a74-ee04-4f20-8a73-96c90f4224cb-trusted-ca-bundle\") pod \"console-f7d7d75b9-txv5c\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") " pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:13.845814 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.845808    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18c12a74-ee04-4f20-8a73-96c90f4224cb-service-ca\") pod \"console-f7d7d75b9-txv5c\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") " pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:13.846005 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.845850    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18c12a74-ee04-4f20-8a73-96c90f4224cb-console-serving-cert\") pod \"console-f7d7d75b9-txv5c\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") " pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:13.846057 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.846035    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-knmxn\" (UniqueName: \"kubernetes.io/projected/18c12a74-ee04-4f20-8a73-96c90f4224cb-kube-api-access-knmxn\") pod \"console-f7d7d75b9-txv5c\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") " pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:13.846482 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.846451    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18c12a74-ee04-4f20-8a73-96c90f4224cb-oauth-serving-cert\") pod \"console-f7d7d75b9-txv5c\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") " pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:13.846614 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.846488    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18c12a74-ee04-4f20-8a73-96c90f4224cb-console-config\") pod \"console-f7d7d75b9-txv5c\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") " pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:13.846614 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.846577    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18c12a74-ee04-4f20-8a73-96c90f4224cb-service-ca\") pod \"console-f7d7d75b9-txv5c\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") " pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:13.846706 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.846643    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18c12a74-ee04-4f20-8a73-96c90f4224cb-trusted-ca-bundle\") pod \"console-f7d7d75b9-txv5c\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") " pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:13.848211 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.848183    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18c12a74-ee04-4f20-8a73-96c90f4224cb-console-oauth-config\") pod \"console-f7d7d75b9-txv5c\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") " pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:13.848466 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.848446    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18c12a74-ee04-4f20-8a73-96c90f4224cb-console-serving-cert\") pod \"console-f7d7d75b9-txv5c\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") " pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:13.855753 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.855732    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knmxn\" (UniqueName: \"kubernetes.io/projected/18c12a74-ee04-4f20-8a73-96c90f4224cb-kube-api-access-knmxn\") pod \"console-f7d7d75b9-txv5c\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") " pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:13.928201 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:13.928148    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:14.049122 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:14.049096    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f7d7d75b9-txv5c"]
May 21 01:52:14.051515 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:52:14.051487    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18c12a74_ee04_4f20_8a73_96c90f4224cb.slice/crio-bb566b929ff979af553e9d7cfe927b461487bda65f7334ad46f6dabec49779a1 WatchSource:0}: Error finding container bb566b929ff979af553e9d7cfe927b461487bda65f7334ad46f6dabec49779a1: Status 404 returned error can't find the container with id bb566b929ff979af553e9d7cfe927b461487bda65f7334ad46f6dabec49779a1
May 21 01:52:14.294978 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:14.294940    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f7d7d75b9-txv5c" event={"ID":"18c12a74-ee04-4f20-8a73-96c90f4224cb","Type":"ContainerStarted","Data":"577039a37994fd025e6036f4eeb17dd9dfd92b7b6cf7690abcad3aad16a1cc94"}
May 21 01:52:14.294978 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:14.294976    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f7d7d75b9-txv5c" event={"ID":"18c12a74-ee04-4f20-8a73-96c90f4224cb","Type":"ContainerStarted","Data":"bb566b929ff979af553e9d7cfe927b461487bda65f7334ad46f6dabec49779a1"}
May 21 01:52:14.311734 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:14.311697    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-f7d7d75b9-txv5c" podStartSLOduration=1.311685709 podStartE2EDuration="1.311685709s" podCreationTimestamp="2026-05-21 01:52:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 01:52:14.309910292 +0000 UTC m=+272.597157069" watchObservedRunningTime="2026-05-21 01:52:14.311685709 +0000 UTC m=+272.598932485"
May 21 01:52:23.928911 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:23.928873    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:23.928911 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:23.928922    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:23.933512 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:23.933491    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:24.329329 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:24.329286    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:52:24.369730 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:24.369702    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9d9bf5cbd-4vtvr"]
May 21 01:52:42.229173 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:42.229128    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cgx9r_3a1d53d4-c866-4375-a183-ecfaa11e9d0b/console-operator/2.log"
May 21 01:52:42.229750 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:42.229730    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cgx9r_3a1d53d4-c866-4375-a183-ecfaa11e9d0b/console-operator/2.log"
May 21 01:52:42.243316 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:42.243296    2552 kubelet.go:1628] "Image garbage collection succeeded"
May 21 01:52:49.391648 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:49.391585    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-9d9bf5cbd-4vtvr" podUID="874a6156-0d5c-4a51-a100-b9db216e4a54" containerName="console" containerID="cri-o://c327a9c456ab545cc1d7334622c51ad8dc493a0fbb3c2fe56923262b1d006363" gracePeriod=15
May 21 01:52:49.626102 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:49.626082    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9d9bf5cbd-4vtvr_874a6156-0d5c-4a51-a100-b9db216e4a54/console/0.log"
May 21 01:52:49.626210 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:49.626147    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:52:49.712709 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:49.712648    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/874a6156-0d5c-4a51-a100-b9db216e4a54-console-config\") pod \"874a6156-0d5c-4a51-a100-b9db216e4a54\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") "
May 21 01:52:49.712839 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:49.712711    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/874a6156-0d5c-4a51-a100-b9db216e4a54-oauth-serving-cert\") pod \"874a6156-0d5c-4a51-a100-b9db216e4a54\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") "
May 21 01:52:49.712902 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:49.712854    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/874a6156-0d5c-4a51-a100-b9db216e4a54-console-serving-cert\") pod \"874a6156-0d5c-4a51-a100-b9db216e4a54\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") "
May 21 01:52:49.712968 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:49.712950    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/874a6156-0d5c-4a51-a100-b9db216e4a54-service-ca\") pod \"874a6156-0d5c-4a51-a100-b9db216e4a54\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") "
May 21 01:52:49.713035 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:49.712993    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/874a6156-0d5c-4a51-a100-b9db216e4a54-console-oauth-config\") pod \"874a6156-0d5c-4a51-a100-b9db216e4a54\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") "
May 21 01:52:49.713035 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:49.713025    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/874a6156-0d5c-4a51-a100-b9db216e4a54-trusted-ca-bundle\") pod \"874a6156-0d5c-4a51-a100-b9db216e4a54\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") "
May 21 01:52:49.713182 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:49.713032    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/874a6156-0d5c-4a51-a100-b9db216e4a54-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "874a6156-0d5c-4a51-a100-b9db216e4a54" (UID: "874a6156-0d5c-4a51-a100-b9db216e4a54"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 01:52:49.713182 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:49.713039    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/874a6156-0d5c-4a51-a100-b9db216e4a54-console-config" (OuterVolumeSpecName: "console-config") pod "874a6156-0d5c-4a51-a100-b9db216e4a54" (UID: "874a6156-0d5c-4a51-a100-b9db216e4a54"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 01:52:49.713182 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:49.713069    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7rqf\" (UniqueName: \"kubernetes.io/projected/874a6156-0d5c-4a51-a100-b9db216e4a54-kube-api-access-p7rqf\") pod \"874a6156-0d5c-4a51-a100-b9db216e4a54\" (UID: \"874a6156-0d5c-4a51-a100-b9db216e4a54\") "
May 21 01:52:49.713325 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:49.713308    2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/874a6156-0d5c-4a51-a100-b9db216e4a54-oauth-serving-cert\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:52:49.713379 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:49.713326    2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/874a6156-0d5c-4a51-a100-b9db216e4a54-console-config\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:52:49.713379 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:49.713344    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/874a6156-0d5c-4a51-a100-b9db216e4a54-service-ca" (OuterVolumeSpecName: "service-ca") pod "874a6156-0d5c-4a51-a100-b9db216e4a54" (UID: "874a6156-0d5c-4a51-a100-b9db216e4a54"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 01:52:49.713491 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:49.713444    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/874a6156-0d5c-4a51-a100-b9db216e4a54-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "874a6156-0d5c-4a51-a100-b9db216e4a54" (UID: "874a6156-0d5c-4a51-a100-b9db216e4a54"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 01:52:49.714953 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:49.714918    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/874a6156-0d5c-4a51-a100-b9db216e4a54-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "874a6156-0d5c-4a51-a100-b9db216e4a54" (UID: "874a6156-0d5c-4a51-a100-b9db216e4a54"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:52:49.715095 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:49.715072    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/874a6156-0d5c-4a51-a100-b9db216e4a54-kube-api-access-p7rqf" (OuterVolumeSpecName: "kube-api-access-p7rqf") pod "874a6156-0d5c-4a51-a100-b9db216e4a54" (UID: "874a6156-0d5c-4a51-a100-b9db216e4a54"). InnerVolumeSpecName "kube-api-access-p7rqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:52:49.715142 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:49.715106    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/874a6156-0d5c-4a51-a100-b9db216e4a54-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "874a6156-0d5c-4a51-a100-b9db216e4a54" (UID: "874a6156-0d5c-4a51-a100-b9db216e4a54"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:52:49.813753 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:49.813732    2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/874a6156-0d5c-4a51-a100-b9db216e4a54-console-serving-cert\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:52:49.813753 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:49.813752    2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/874a6156-0d5c-4a51-a100-b9db216e4a54-service-ca\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:52:49.813882 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:49.813762    2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/874a6156-0d5c-4a51-a100-b9db216e4a54-console-oauth-config\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:52:49.813882 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:49.813771    2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/874a6156-0d5c-4a51-a100-b9db216e4a54-trusted-ca-bundle\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:52:49.813882 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:49.813781    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7rqf\" (UniqueName: \"kubernetes.io/projected/874a6156-0d5c-4a51-a100-b9db216e4a54-kube-api-access-p7rqf\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:52:50.398228 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:50.398204    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9d9bf5cbd-4vtvr_874a6156-0d5c-4a51-a100-b9db216e4a54/console/0.log"
May 21 01:52:50.398620 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:50.398242    2552 generic.go:358] "Generic (PLEG): container finished" podID="874a6156-0d5c-4a51-a100-b9db216e4a54" containerID="c327a9c456ab545cc1d7334622c51ad8dc493a0fbb3c2fe56923262b1d006363" exitCode=2
May 21 01:52:50.398620 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:50.398308    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9d9bf5cbd-4vtvr"
May 21 01:52:50.398620 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:50.398306    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9d9bf5cbd-4vtvr" event={"ID":"874a6156-0d5c-4a51-a100-b9db216e4a54","Type":"ContainerDied","Data":"c327a9c456ab545cc1d7334622c51ad8dc493a0fbb3c2fe56923262b1d006363"}
May 21 01:52:50.398620 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:50.398411    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9d9bf5cbd-4vtvr" event={"ID":"874a6156-0d5c-4a51-a100-b9db216e4a54","Type":"ContainerDied","Data":"ca640e9d9a7014b9335890f062b49457eba661b003bcb0226357bb255fa92f97"}
May 21 01:52:50.398620 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:50.398430    2552 scope.go:117] "RemoveContainer" containerID="c327a9c456ab545cc1d7334622c51ad8dc493a0fbb3c2fe56923262b1d006363"
May 21 01:52:50.406270 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:50.406248    2552 scope.go:117] "RemoveContainer" containerID="c327a9c456ab545cc1d7334622c51ad8dc493a0fbb3c2fe56923262b1d006363"
May 21 01:52:50.406687 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:52:50.406542    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c327a9c456ab545cc1d7334622c51ad8dc493a0fbb3c2fe56923262b1d006363\": container with ID starting with c327a9c456ab545cc1d7334622c51ad8dc493a0fbb3c2fe56923262b1d006363 not found: ID does not exist" containerID="c327a9c456ab545cc1d7334622c51ad8dc493a0fbb3c2fe56923262b1d006363"
May 21 01:52:50.406687 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:50.406607    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c327a9c456ab545cc1d7334622c51ad8dc493a0fbb3c2fe56923262b1d006363"} err="failed to get container status \"c327a9c456ab545cc1d7334622c51ad8dc493a0fbb3c2fe56923262b1d006363\": rpc error: code = NotFound desc = could not find container \"c327a9c456ab545cc1d7334622c51ad8dc493a0fbb3c2fe56923262b1d006363\": container with ID starting with c327a9c456ab545cc1d7334622c51ad8dc493a0fbb3c2fe56923262b1d006363 not found: ID does not exist"
May 21 01:52:50.416146 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:50.416120    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9d9bf5cbd-4vtvr"]
May 21 01:52:50.420894 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:50.420875    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9d9bf5cbd-4vtvr"]
May 21 01:52:52.325683 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:52.325651    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="874a6156-0d5c-4a51-a100-b9db216e4a54" path="/var/lib/kubelet/pods/874a6156-0d5c-4a51-a100-b9db216e4a54/volumes"
May 21 01:52:52.893984 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:52.893952    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-5qwhb"]
May 21 01:52:52.894275 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:52.894263    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="874a6156-0d5c-4a51-a100-b9db216e4a54" containerName="console"
May 21 01:52:52.894318 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:52.894276    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="874a6156-0d5c-4a51-a100-b9db216e4a54" containerName="console"
May 21 01:52:52.894356 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:52.894333    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="874a6156-0d5c-4a51-a100-b9db216e4a54" containerName="console"
May 21 01:52:52.898508 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:52.898492    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qwhb"
May 21 01:52:52.900982 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:52.900955    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 21 01:52:52.903765 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:52.903744    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5qwhb"]
May 21 01:52:52.936206 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:52.936183    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1cbee653-ebf7-4239-8337-0a77d3b870aa-original-pull-secret\") pod \"global-pull-secret-syncer-5qwhb\" (UID: \"1cbee653-ebf7-4239-8337-0a77d3b870aa\") " pod="kube-system/global-pull-secret-syncer-5qwhb"
May 21 01:52:52.936304 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:52.936232    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1cbee653-ebf7-4239-8337-0a77d3b870aa-kubelet-config\") pod \"global-pull-secret-syncer-5qwhb\" (UID: \"1cbee653-ebf7-4239-8337-0a77d3b870aa\") " pod="kube-system/global-pull-secret-syncer-5qwhb"
May 21 01:52:52.936344 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:52.936311    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1cbee653-ebf7-4239-8337-0a77d3b870aa-dbus\") pod \"global-pull-secret-syncer-5qwhb\" (UID: \"1cbee653-ebf7-4239-8337-0a77d3b870aa\") " pod="kube-system/global-pull-secret-syncer-5qwhb"
May 21 01:52:53.037213 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:53.037188    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1cbee653-ebf7-4239-8337-0a77d3b870aa-original-pull-secret\") pod \"global-pull-secret-syncer-5qwhb\" (UID: \"1cbee653-ebf7-4239-8337-0a77d3b870aa\") " pod="kube-system/global-pull-secret-syncer-5qwhb"
May 21 01:52:53.037306 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:53.037239    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1cbee653-ebf7-4239-8337-0a77d3b870aa-kubelet-config\") pod \"global-pull-secret-syncer-5qwhb\" (UID: \"1cbee653-ebf7-4239-8337-0a77d3b870aa\") " pod="kube-system/global-pull-secret-syncer-5qwhb"
May 21 01:52:53.037306 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:53.037278    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1cbee653-ebf7-4239-8337-0a77d3b870aa-dbus\") pod \"global-pull-secret-syncer-5qwhb\" (UID: \"1cbee653-ebf7-4239-8337-0a77d3b870aa\") " pod="kube-system/global-pull-secret-syncer-5qwhb"
May 21 01:52:53.037401 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:53.037382    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1cbee653-ebf7-4239-8337-0a77d3b870aa-kubelet-config\") pod \"global-pull-secret-syncer-5qwhb\" (UID: \"1cbee653-ebf7-4239-8337-0a77d3b870aa\") " pod="kube-system/global-pull-secret-syncer-5qwhb"
May 21 01:52:53.037436 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:53.037422    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1cbee653-ebf7-4239-8337-0a77d3b870aa-dbus\") pod \"global-pull-secret-syncer-5qwhb\" (UID: \"1cbee653-ebf7-4239-8337-0a77d3b870aa\") " pod="kube-system/global-pull-secret-syncer-5qwhb"
May 21 01:52:53.039302 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:53.039272    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1cbee653-ebf7-4239-8337-0a77d3b870aa-original-pull-secret\") pod \"global-pull-secret-syncer-5qwhb\" (UID: \"1cbee653-ebf7-4239-8337-0a77d3b870aa\") " pod="kube-system/global-pull-secret-syncer-5qwhb"
May 21 01:52:53.208790 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:53.208724    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qwhb"
May 21 01:52:53.327990 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:53.327955    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5qwhb"]
May 21 01:52:53.330733 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:52:53.330702    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cbee653_ebf7_4239_8337_0a77d3b870aa.slice/crio-1dbe2df21583c847e6c5bc17022a4d6eec664ba4a823150c062213c9d7d84a82 WatchSource:0}: Error finding container 1dbe2df21583c847e6c5bc17022a4d6eec664ba4a823150c062213c9d7d84a82: Status 404 returned error can't find the container with id 1dbe2df21583c847e6c5bc17022a4d6eec664ba4a823150c062213c9d7d84a82
May 21 01:52:53.332704 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:53.332688    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 01:52:53.408388 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:53.408362    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5qwhb" event={"ID":"1cbee653-ebf7-4239-8337-0a77d3b870aa","Type":"ContainerStarted","Data":"1dbe2df21583c847e6c5bc17022a4d6eec664ba4a823150c062213c9d7d84a82"}
May 21 01:52:57.421875 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:57.421843    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5qwhb" event={"ID":"1cbee653-ebf7-4239-8337-0a77d3b870aa","Type":"ContainerStarted","Data":"cb857cb3588b5eb629a32e7836e7344815e7cc4eb55981b01e3f059ec6a8aa7a"}
May 21 01:52:57.437071 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:52:57.437025    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5qwhb" podStartSLOduration=1.551731209 podStartE2EDuration="5.437007362s" podCreationTimestamp="2026-05-21 01:52:52 +0000 UTC" firstStartedPulling="2026-05-21 01:52:53.332814336 +0000 UTC m=+311.620061104" lastFinishedPulling="2026-05-21 01:52:57.218090488 +0000 UTC m=+315.505337257" observedRunningTime="2026-05-21 01:52:57.436000153 +0000 UTC m=+315.723246931" watchObservedRunningTime="2026-05-21 01:52:57.437007362 +0000 UTC m=+315.724254138"
May 21 01:53:06.200446 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:06.200413    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj"]
May 21 01:53:06.204014 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:06.203997    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj"
May 21 01:53:06.206714 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:06.206693    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 21 01:53:06.206835 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:06.206693    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6csb4\""
May 21 01:53:06.208167 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:06.208150    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 21 01:53:06.211779 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:06.211756    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj"]
May 21 01:53:06.339642 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:06.339612    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj\" (UID: \"71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj"
May 21 01:53:06.339776 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:06.339659    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj\" (UID: \"71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj"
May 21 01:53:06.339776 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:06.339684    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrd8m\" (UniqueName: \"kubernetes.io/projected/71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c-kube-api-access-jrd8m\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj\" (UID: \"71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj"
May 21 01:53:06.440562 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:06.440520    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj\" (UID: \"71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj"
May 21 01:53:06.440689 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:06.440613    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj\" (UID: \"71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj"
May 21 01:53:06.440689 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:06.440654    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jrd8m\" (UniqueName: \"kubernetes.io/projected/71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c-kube-api-access-jrd8m\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj\" (UID: \"71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj"
May 21 01:53:06.440875 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:06.440855    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj\" (UID: \"71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj"
May 21 01:53:06.440947 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:06.440881    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj\" (UID: \"71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj"
May 21 01:53:06.448967 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:06.448931    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrd8m\" (UniqueName: \"kubernetes.io/projected/71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c-kube-api-access-jrd8m\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj\" (UID: \"71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj"
May 21 01:53:06.513536 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:06.513516    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj"
May 21 01:53:06.638791 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:06.638758    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj"]
May 21 01:53:06.640892 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:53:06.640864    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71efdf42_49ff_4cc5_9ddc_7f1a1a919a8c.slice/crio-761d691ccb0244716d296a24275263c4d8a650052f412e4aa66c0eae86fb8133 WatchSource:0}: Error finding container 761d691ccb0244716d296a24275263c4d8a650052f412e4aa66c0eae86fb8133: Status 404 returned error can't find the container with id 761d691ccb0244716d296a24275263c4d8a650052f412e4aa66c0eae86fb8133
May 21 01:53:07.450827 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:07.450794    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj" event={"ID":"71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c","Type":"ContainerStarted","Data":"761d691ccb0244716d296a24275263c4d8a650052f412e4aa66c0eae86fb8133"}
May 21 01:53:11.464692 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:11.464658    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj" event={"ID":"71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c","Type":"ContainerStarted","Data":"85267b16fa9f63089ba478c98cc1f8d90ba18f4912ea9932038a2d0e32380c5f"}
May 21 01:53:12.468466 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:12.468431    2552 generic.go:358] "Generic (PLEG): container finished" podID="71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c" containerID="85267b16fa9f63089ba478c98cc1f8d90ba18f4912ea9932038a2d0e32380c5f" exitCode=0
May 21 01:53:12.468874 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:12.468519    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj" event={"ID":"71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c","Type":"ContainerDied","Data":"85267b16fa9f63089ba478c98cc1f8d90ba18f4912ea9932038a2d0e32380c5f"}
May 21 01:53:14.475960 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:14.475933    2552 generic.go:358] "Generic (PLEG): container finished" podID="71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c" containerID="47c5dae7bc6b394305003d5239c02c442c8a01cdabe600aaff6b21c22181b968" exitCode=0
May 21 01:53:14.476234 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:14.475970    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj" event={"ID":"71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c","Type":"ContainerDied","Data":"47c5dae7bc6b394305003d5239c02c442c8a01cdabe600aaff6b21c22181b968"}
May 21 01:53:20.496496 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:20.496466    2552 generic.go:358] "Generic (PLEG): container finished" podID="71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c" containerID="94b325646d73563fd28ea47d0c8d8178dddc3f4d9472c4df984cf3b15db2193b" exitCode=0
May 21 01:53:20.496813 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:20.496563    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj" event={"ID":"71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c","Type":"ContainerDied","Data":"94b325646d73563fd28ea47d0c8d8178dddc3f4d9472c4df984cf3b15db2193b"}
May 21 01:53:21.625114 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:21.625092    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj"
May 21 01:53:21.776560 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:21.776469    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c-util\") pod \"71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c\" (UID: \"71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c\") "
May 21 01:53:21.776560 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:21.776510    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c-bundle\") pod \"71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c\" (UID: \"71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c\") "
May 21 01:53:21.776755 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:21.776595    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrd8m\" (UniqueName: \"kubernetes.io/projected/71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c-kube-api-access-jrd8m\") pod \"71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c\" (UID: \"71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c\") "
May 21 01:53:21.777166 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:21.777141    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c-bundle" (OuterVolumeSpecName: "bundle") pod "71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c" (UID: "71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:53:21.778699 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:21.778676    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c-kube-api-access-jrd8m" (OuterVolumeSpecName: "kube-api-access-jrd8m") pod "71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c" (UID: "71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c"). InnerVolumeSpecName "kube-api-access-jrd8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:53:21.780841 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:21.780820    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c-util" (OuterVolumeSpecName: "util") pod "71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c" (UID: "71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:53:21.877077 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:21.877050    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c-util\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:53:21.877077 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:21.877078    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c-bundle\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:53:21.877199 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:21.877088    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrd8m\" (UniqueName: \"kubernetes.io/projected/71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c-kube-api-access-jrd8m\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:53:22.505039 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:22.505011    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj" event={"ID":"71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c","Type":"ContainerDied","Data":"761d691ccb0244716d296a24275263c4d8a650052f412e4aa66c0eae86fb8133"}
May 21 01:53:22.505039 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:22.505041    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="761d691ccb0244716d296a24275263c4d8a650052f412e4aa66c0eae86fb8133"
May 21 01:53:22.505211 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:22.505051    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df57sj"
May 21 01:53:28.915741 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:28.915709    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-77v44"]
May 21 01:53:28.916194 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:28.916161    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c" containerName="extract"
May 21 01:53:28.916194 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:28.916179    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c" containerName="extract"
May 21 01:53:28.916306 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:28.916200    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c" containerName="util"
May 21 01:53:28.916306 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:28.916211    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c" containerName="util"
May 21 01:53:28.916306 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:28.916231    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c" containerName="pull"
May 21 01:53:28.916306 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:28.916240    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c" containerName="pull"
May 21 01:53:28.916493 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:28.916331    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="71efdf42-49ff-4cc5-9ddc-7f1a1a919a8c" containerName="extract"
May 21 01:53:28.960085 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:28.960063    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-77v44"]
May 21 01:53:28.960225 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:28.960163    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-77v44"
May 21 01:53:28.968809 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:28.968788    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
May 21 01:53:28.968941 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:28.968788    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-hxxwl\""
May 21 01:53:28.975896 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:28.975877    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
May 21 01:53:29.128640 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:29.128612    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khjsf\" (UniqueName: \"kubernetes.io/projected/e396ae73-7ca0-4e61-aae1-0cf12fca72d1-kube-api-access-khjsf\") pod \"cert-manager-operator-controller-manager-54b9655956-77v44\" (UID: \"e396ae73-7ca0-4e61-aae1-0cf12fca72d1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-77v44"
May 21 01:53:29.128779 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:29.128662    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e396ae73-7ca0-4e61-aae1-0cf12fca72d1-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-77v44\" (UID: \"e396ae73-7ca0-4e61-aae1-0cf12fca72d1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-77v44"
May 21 01:53:29.229150 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:29.229089    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-khjsf\" (UniqueName: \"kubernetes.io/projected/e396ae73-7ca0-4e61-aae1-0cf12fca72d1-kube-api-access-khjsf\") pod \"cert-manager-operator-controller-manager-54b9655956-77v44\" (UID: \"e396ae73-7ca0-4e61-aae1-0cf12fca72d1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-77v44"
May 21 01:53:29.229250 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:29.229145    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e396ae73-7ca0-4e61-aae1-0cf12fca72d1-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-77v44\" (UID: \"e396ae73-7ca0-4e61-aae1-0cf12fca72d1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-77v44"
May 21 01:53:29.229483 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:29.229464    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e396ae73-7ca0-4e61-aae1-0cf12fca72d1-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-77v44\" (UID: \"e396ae73-7ca0-4e61-aae1-0cf12fca72d1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-77v44"
May 21 01:53:29.243026 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:29.243004    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khjsf\" (UniqueName: \"kubernetes.io/projected/e396ae73-7ca0-4e61-aae1-0cf12fca72d1-kube-api-access-khjsf\") pod \"cert-manager-operator-controller-manager-54b9655956-77v44\" (UID: \"e396ae73-7ca0-4e61-aae1-0cf12fca72d1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-77v44"
May 21 01:53:29.268630 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:29.268608    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-77v44"
May 21 01:53:29.398448 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:53:29.398418    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode396ae73_7ca0_4e61_aae1_0cf12fca72d1.slice/crio-a80a88039813b78152ae4859778bafd08f752b648aadf17ba0308d706f695e31 WatchSource:0}: Error finding container a80a88039813b78152ae4859778bafd08f752b648aadf17ba0308d706f695e31: Status 404 returned error can't find the container with id a80a88039813b78152ae4859778bafd08f752b648aadf17ba0308d706f695e31
May 21 01:53:29.400150 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:29.400127    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-77v44"]
May 21 01:53:29.528792 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:29.528768    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-77v44" event={"ID":"e396ae73-7ca0-4e61-aae1-0cf12fca72d1","Type":"ContainerStarted","Data":"a80a88039813b78152ae4859778bafd08f752b648aadf17ba0308d706f695e31"}
May 21 01:53:32.541254 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:32.541214    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-77v44" event={"ID":"e396ae73-7ca0-4e61-aae1-0cf12fca72d1","Type":"ContainerStarted","Data":"23f28780b97689cde851152289efd5d11648411e22a36ae3f70a1579dc93aebc"}
May 21 01:53:32.583328 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:32.583278    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-77v44" podStartSLOduration=2.120657631 podStartE2EDuration="4.583266433s" podCreationTimestamp="2026-05-21 01:53:28 +0000 UTC" firstStartedPulling="2026-05-21 01:53:29.401130926 +0000 UTC m=+347.688377681" lastFinishedPulling="2026-05-21 01:53:31.863739717 +0000 UTC m=+350.150986483" observedRunningTime="2026-05-21 01:53:32.576129495 +0000 UTC m=+350.863376271" watchObservedRunningTime="2026-05-21 01:53:32.583266433 +0000 UTC m=+350.870513236"
May 21 01:53:33.578078 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:33.578049    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5"]
May 21 01:53:33.594874 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:33.594845    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5"]
May 21 01:53:33.595010 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:33.594938    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5"
May 21 01:53:33.603411 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:33.603387    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 21 01:53:33.603541 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:33.603412    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 21 01:53:33.603541 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:33.603455    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6csb4\""
May 21 01:53:33.660458 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:33.660435    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e4f0682-8ca2-4769-ae30-54add3cb4f97-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5\" (UID: \"7e4f0682-8ca2-4769-ae30-54add3cb4f97\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5"
May 21 01:53:33.660577 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:33.660489    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e4f0682-8ca2-4769-ae30-54add3cb4f97-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5\" (UID: \"7e4f0682-8ca2-4769-ae30-54add3cb4f97\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5"
May 21 01:53:33.660577 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:33.660515    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97bz5\" (UniqueName: \"kubernetes.io/projected/7e4f0682-8ca2-4769-ae30-54add3cb4f97-kube-api-access-97bz5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5\" (UID: \"7e4f0682-8ca2-4769-ae30-54add3cb4f97\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5"
May 21 01:53:33.761260 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:33.761230    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e4f0682-8ca2-4769-ae30-54add3cb4f97-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5\" (UID: \"7e4f0682-8ca2-4769-ae30-54add3cb4f97\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5"
May 21 01:53:33.761370 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:33.761290    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e4f0682-8ca2-4769-ae30-54add3cb4f97-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5\" (UID: \"7e4f0682-8ca2-4769-ae30-54add3cb4f97\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5"
May 21 01:53:33.761434 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:33.761406    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-97bz5\" (UniqueName: \"kubernetes.io/projected/7e4f0682-8ca2-4769-ae30-54add3cb4f97-kube-api-access-97bz5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5\" (UID: \"7e4f0682-8ca2-4769-ae30-54add3cb4f97\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5"
May 21 01:53:33.761612 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:33.761592    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e4f0682-8ca2-4769-ae30-54add3cb4f97-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5\" (UID: \"7e4f0682-8ca2-4769-ae30-54add3cb4f97\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5"
May 21 01:53:33.761689 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:33.761636    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e4f0682-8ca2-4769-ae30-54add3cb4f97-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5\" (UID: \"7e4f0682-8ca2-4769-ae30-54add3cb4f97\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5"
May 21 01:53:33.780684 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:33.780658    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97bz5\" (UniqueName: \"kubernetes.io/projected/7e4f0682-8ca2-4769-ae30-54add3cb4f97-kube-api-access-97bz5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5\" (UID: \"7e4f0682-8ca2-4769-ae30-54add3cb4f97\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5"
May 21 01:53:33.904804 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:33.904751    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5"
May 21 01:53:34.025957 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:34.025915    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5"]
May 21 01:53:34.029481 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:53:34.029453    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e4f0682_8ca2_4769_ae30_54add3cb4f97.slice/crio-69af136964cf2988d332eb407562c9b0e6edcaab260a99ded8515dc98ffb26ca WatchSource:0}: Error finding container 69af136964cf2988d332eb407562c9b0e6edcaab260a99ded8515dc98ffb26ca: Status 404 returned error can't find the container with id 69af136964cf2988d332eb407562c9b0e6edcaab260a99ded8515dc98ffb26ca
May 21 01:53:34.283922 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:34.283896    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-zllhh"]
May 21 01:53:34.299132 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:34.299113    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-zllhh"]
May 21 01:53:34.299238 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:34.299200    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-zllhh"
May 21 01:53:34.307842 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:34.307823    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 21 01:53:34.307922 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:34.307871    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 21 01:53:34.307969 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:34.307933    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-lzsbd\""
May 21 01:53:34.366423 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:34.366397    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61d7ac3c-1c1d-4e27-9789-71e6dd15b5a3-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-zllhh\" (UID: \"61d7ac3c-1c1d-4e27-9789-71e6dd15b5a3\") " pod="cert-manager/cert-manager-webhook-587ccfb98-zllhh"
May 21 01:53:34.366574 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:34.366532    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2ldh\" (UniqueName: \"kubernetes.io/projected/61d7ac3c-1c1d-4e27-9789-71e6dd15b5a3-kube-api-access-c2ldh\") pod \"cert-manager-webhook-587ccfb98-zllhh\" (UID: \"61d7ac3c-1c1d-4e27-9789-71e6dd15b5a3\") " pod="cert-manager/cert-manager-webhook-587ccfb98-zllhh"
May 21 01:53:34.467441 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:34.467389    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61d7ac3c-1c1d-4e27-9789-71e6dd15b5a3-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-zllhh\" (UID: \"61d7ac3c-1c1d-4e27-9789-71e6dd15b5a3\") " pod="cert-manager/cert-manager-webhook-587ccfb98-zllhh"
May 21 01:53:34.467441 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:34.467431    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2ldh\" (UniqueName: \"kubernetes.io/projected/61d7ac3c-1c1d-4e27-9789-71e6dd15b5a3-kube-api-access-c2ldh\") pod \"cert-manager-webhook-587ccfb98-zllhh\" (UID: \"61d7ac3c-1c1d-4e27-9789-71e6dd15b5a3\") " pod="cert-manager/cert-manager-webhook-587ccfb98-zllhh"
May 21 01:53:34.481515 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:34.481494    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61d7ac3c-1c1d-4e27-9789-71e6dd15b5a3-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-zllhh\" (UID: \"61d7ac3c-1c1d-4e27-9789-71e6dd15b5a3\") " pod="cert-manager/cert-manager-webhook-587ccfb98-zllhh"
May 21 01:53:34.481624 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:34.481608    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2ldh\" (UniqueName: \"kubernetes.io/projected/61d7ac3c-1c1d-4e27-9789-71e6dd15b5a3-kube-api-access-c2ldh\") pod \"cert-manager-webhook-587ccfb98-zllhh\" (UID: \"61d7ac3c-1c1d-4e27-9789-71e6dd15b5a3\") " pod="cert-manager/cert-manager-webhook-587ccfb98-zllhh"
May 21 01:53:34.548645 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:34.548615    2552 generic.go:358] "Generic (PLEG): container finished" podID="7e4f0682-8ca2-4769-ae30-54add3cb4f97" containerID="26a5d28837924ad8cf758b5b520ad8db3a404cc371fa6a74ffbf9d21ebe8c084" exitCode=0
May 21 01:53:34.548726 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:34.548697    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5" event={"ID":"7e4f0682-8ca2-4769-ae30-54add3cb4f97","Type":"ContainerDied","Data":"26a5d28837924ad8cf758b5b520ad8db3a404cc371fa6a74ffbf9d21ebe8c084"}
May 21 01:53:34.548766 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:34.548728    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5" event={"ID":"7e4f0682-8ca2-4769-ae30-54add3cb4f97","Type":"ContainerStarted","Data":"69af136964cf2988d332eb407562c9b0e6edcaab260a99ded8515dc98ffb26ca"}
May 21 01:53:34.622413 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:34.622395    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-zllhh"
May 21 01:53:34.745036 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:34.745014    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-zllhh"]
May 21 01:53:34.746987 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:53:34.746965    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61d7ac3c_1c1d_4e27_9789_71e6dd15b5a3.slice/crio-8c920151f7bab757f41c9457fa62aa0b882ae56489993271591f17513a0853cf WatchSource:0}: Error finding container 8c920151f7bab757f41c9457fa62aa0b882ae56489993271591f17513a0853cf: Status 404 returned error can't find the container with id 8c920151f7bab757f41c9457fa62aa0b882ae56489993271591f17513a0853cf
May 21 01:53:35.553710 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:35.553675    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-zllhh" event={"ID":"61d7ac3c-1c1d-4e27-9789-71e6dd15b5a3","Type":"ContainerStarted","Data":"8c920151f7bab757f41c9457fa62aa0b882ae56489993271591f17513a0853cf"}
May 21 01:53:38.566168 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:38.566135    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-zllhh" event={"ID":"61d7ac3c-1c1d-4e27-9789-71e6dd15b5a3","Type":"ContainerStarted","Data":"391847f772da2678e56252ecc6b74d38d41d54d38f6ba053e0e0d56743e9e295"}
May 21 01:53:38.566624 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:38.566218    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-zllhh"
May 21 01:53:38.567659 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:38.567635    2552 generic.go:358] "Generic (PLEG): container finished" podID="7e4f0682-8ca2-4769-ae30-54add3cb4f97" containerID="a1f889d4b9cda89680ecf417c3bac5298069d6248ec8ae5c93b4e3d6a582f7a6" exitCode=0
May 21 01:53:38.567772 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:38.567717    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5" event={"ID":"7e4f0682-8ca2-4769-ae30-54add3cb4f97","Type":"ContainerDied","Data":"a1f889d4b9cda89680ecf417c3bac5298069d6248ec8ae5c93b4e3d6a582f7a6"}
May 21 01:53:38.596767 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:38.596729    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-zllhh" podStartSLOduration=1.474410592 podStartE2EDuration="4.5967176s" podCreationTimestamp="2026-05-21 01:53:34 +0000 UTC" firstStartedPulling="2026-05-21 01:53:34.748940222 +0000 UTC m=+353.036186977" lastFinishedPulling="2026-05-21 01:53:37.871247217 +0000 UTC m=+356.158493985" observedRunningTime="2026-05-21 01:53:38.596095407 +0000 UTC m=+356.883342183" watchObservedRunningTime="2026-05-21 01:53:38.5967176 +0000 UTC m=+356.883964377"
May 21 01:53:39.573765 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:39.573726    2552 generic.go:358] "Generic (PLEG): container finished" podID="7e4f0682-8ca2-4769-ae30-54add3cb4f97" containerID="3a988b2f8df5b3b0418f3ee5d4b8605aa3264447065dcf2be5060427fef204f1" exitCode=0
May 21 01:53:39.574121 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:39.573807    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5" event={"ID":"7e4f0682-8ca2-4769-ae30-54add3cb4f97","Type":"ContainerDied","Data":"3a988b2f8df5b3b0418f3ee5d4b8605aa3264447065dcf2be5060427fef204f1"}
May 21 01:53:40.687075 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:40.687047    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-l94s8"]
May 21 01:53:40.689437 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:40.689416    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-l94s8"
May 21 01:53:40.696763 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:40.696740    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-l94s8"]
May 21 01:53:40.701662 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:40.701497    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-j7j9z\""
May 21 01:53:40.701765 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:40.701696    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5"
May 21 01:53:40.721999 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:40.721977    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e4f0682-8ca2-4769-ae30-54add3cb4f97-util\") pod \"7e4f0682-8ca2-4769-ae30-54add3cb4f97\" (UID: \"7e4f0682-8ca2-4769-ae30-54add3cb4f97\") "
May 21 01:53:40.722084 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:40.722005    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97bz5\" (UniqueName: \"kubernetes.io/projected/7e4f0682-8ca2-4769-ae30-54add3cb4f97-kube-api-access-97bz5\") pod \"7e4f0682-8ca2-4769-ae30-54add3cb4f97\" (UID: \"7e4f0682-8ca2-4769-ae30-54add3cb4f97\") "
May 21 01:53:40.722084 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:40.722039    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e4f0682-8ca2-4769-ae30-54add3cb4f97-bundle\") pod \"7e4f0682-8ca2-4769-ae30-54add3cb4f97\" (UID: \"7e4f0682-8ca2-4769-ae30-54add3cb4f97\") "
May 21 01:53:40.722168 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:40.722105    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zgz5\" (UniqueName: \"kubernetes.io/projected/c53f30ba-6d14-4ccf-be6c-ab1aceaca045-kube-api-access-9zgz5\") pod \"cert-manager-cainjector-68b757865b-l94s8\" (UID: \"c53f30ba-6d14-4ccf-be6c-ab1aceaca045\") " pod="cert-manager/cert-manager-cainjector-68b757865b-l94s8"
May 21 01:53:40.722168 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:40.722145    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c53f30ba-6d14-4ccf-be6c-ab1aceaca045-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-l94s8\" (UID: \"c53f30ba-6d14-4ccf-be6c-ab1aceaca045\") " pod="cert-manager/cert-manager-cainjector-68b757865b-l94s8"
May 21 01:53:40.722442 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:40.722412    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e4f0682-8ca2-4769-ae30-54add3cb4f97-bundle" (OuterVolumeSpecName: "bundle") pod "7e4f0682-8ca2-4769-ae30-54add3cb4f97" (UID: "7e4f0682-8ca2-4769-ae30-54add3cb4f97"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:53:40.724040 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:40.724022    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e4f0682-8ca2-4769-ae30-54add3cb4f97-kube-api-access-97bz5" (OuterVolumeSpecName: "kube-api-access-97bz5") pod "7e4f0682-8ca2-4769-ae30-54add3cb4f97" (UID: "7e4f0682-8ca2-4769-ae30-54add3cb4f97"). InnerVolumeSpecName "kube-api-access-97bz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:53:40.726837 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:40.726814    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e4f0682-8ca2-4769-ae30-54add3cb4f97-util" (OuterVolumeSpecName: "util") pod "7e4f0682-8ca2-4769-ae30-54add3cb4f97" (UID: "7e4f0682-8ca2-4769-ae30-54add3cb4f97"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:53:40.822959 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:40.822934    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c53f30ba-6d14-4ccf-be6c-ab1aceaca045-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-l94s8\" (UID: \"c53f30ba-6d14-4ccf-be6c-ab1aceaca045\") " pod="cert-manager/cert-manager-cainjector-68b757865b-l94s8"
May 21 01:53:40.823051 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:40.822996    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9zgz5\" (UniqueName: \"kubernetes.io/projected/c53f30ba-6d14-4ccf-be6c-ab1aceaca045-kube-api-access-9zgz5\") pod \"cert-manager-cainjector-68b757865b-l94s8\" (UID: \"c53f30ba-6d14-4ccf-be6c-ab1aceaca045\") " pod="cert-manager/cert-manager-cainjector-68b757865b-l94s8"
May 21 01:53:40.823051 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:40.823032    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e4f0682-8ca2-4769-ae30-54add3cb4f97-util\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:53:40.823051 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:40.823042    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97bz5\" (UniqueName: \"kubernetes.io/projected/7e4f0682-8ca2-4769-ae30-54add3cb4f97-kube-api-access-97bz5\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:53:40.823150 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:40.823053    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e4f0682-8ca2-4769-ae30-54add3cb4f97-bundle\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:53:40.836847 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:40.836787    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c53f30ba-6d14-4ccf-be6c-ab1aceaca045-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-l94s8\" (UID: \"c53f30ba-6d14-4ccf-be6c-ab1aceaca045\") " pod="cert-manager/cert-manager-cainjector-68b757865b-l94s8"
May 21 01:53:40.836933 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:40.836882    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zgz5\" (UniqueName: \"kubernetes.io/projected/c53f30ba-6d14-4ccf-be6c-ab1aceaca045-kube-api-access-9zgz5\") pod \"cert-manager-cainjector-68b757865b-l94s8\" (UID: \"c53f30ba-6d14-4ccf-be6c-ab1aceaca045\") " pod="cert-manager/cert-manager-cainjector-68b757865b-l94s8"
May 21 01:53:41.008203 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:41.008173    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-l94s8"
May 21 01:53:41.129000 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:41.128976    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-l94s8"]
May 21 01:53:41.130581 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:53:41.130554    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc53f30ba_6d14_4ccf_be6c_ab1aceaca045.slice/crio-07b00457e4eaedbe8a218655f84837b0e2c723d8f124f540e578c7842e174a10 WatchSource:0}: Error finding container 07b00457e4eaedbe8a218655f84837b0e2c723d8f124f540e578c7842e174a10: Status 404 returned error can't find the container with id 07b00457e4eaedbe8a218655f84837b0e2c723d8f124f540e578c7842e174a10
May 21 01:53:41.582374 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:41.582348    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5"
May 21 01:53:41.582573 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:41.582347    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6d4l5" event={"ID":"7e4f0682-8ca2-4769-ae30-54add3cb4f97","Type":"ContainerDied","Data":"69af136964cf2988d332eb407562c9b0e6edcaab260a99ded8515dc98ffb26ca"}
May 21 01:53:41.582573 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:41.582446    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69af136964cf2988d332eb407562c9b0e6edcaab260a99ded8515dc98ffb26ca"
May 21 01:53:41.583677 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:41.583652    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-l94s8" event={"ID":"c53f30ba-6d14-4ccf-be6c-ab1aceaca045","Type":"ContainerStarted","Data":"16a89b51878832d333b707ddef38ccea294fd7901ef8bd3b6f044d4efb75db62"}
May 21 01:53:41.583677 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:41.583679    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-l94s8" event={"ID":"c53f30ba-6d14-4ccf-be6c-ab1aceaca045","Type":"ContainerStarted","Data":"07b00457e4eaedbe8a218655f84837b0e2c723d8f124f540e578c7842e174a10"}
May 21 01:53:41.610847 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:41.610810    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-l94s8" podStartSLOduration=1.610800755 podStartE2EDuration="1.610800755s" podCreationTimestamp="2026-05-21 01:53:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 01:53:41.608844968 +0000 UTC m=+359.896091776" watchObservedRunningTime="2026-05-21 01:53:41.610800755 +0000 UTC m=+359.898047531"
May 21 01:53:44.575931 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:44.575901    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-zllhh"
May 21 01:53:53.598084 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.598050    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz"]
May 21 01:53:53.598790 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.598386    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e4f0682-8ca2-4769-ae30-54add3cb4f97" containerName="util"
May 21 01:53:53.598790 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.598397    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e4f0682-8ca2-4769-ae30-54add3cb4f97" containerName="util"
May 21 01:53:53.598790 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.598412    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e4f0682-8ca2-4769-ae30-54add3cb4f97" containerName="extract"
May 21 01:53:53.598790 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.598418    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e4f0682-8ca2-4769-ae30-54add3cb4f97" containerName="extract"
May 21 01:53:53.598790 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.598427    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e4f0682-8ca2-4769-ae30-54add3cb4f97" containerName="pull"
May 21 01:53:53.598790 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.598432    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e4f0682-8ca2-4769-ae30-54add3cb4f97" containerName="pull"
May 21 01:53:53.598790 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.598489    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e4f0682-8ca2-4769-ae30-54add3cb4f97" containerName="extract"
May 21 01:53:53.601705 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.601686    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz"
May 21 01:53:53.604064 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.604041    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 21 01:53:53.604199 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.604095    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 21 01:53:53.605166 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.605150    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6csb4\""
May 21 01:53:53.607841 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.607824    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz"]
May 21 01:53:53.658046 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.658016    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-xrjbk"]
May 21 01:53:53.661195 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.661181    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-xrjbk"
May 21 01:53:53.663448 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.663428    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-qhvr5\""
May 21 01:53:53.668530 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.668512    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-xrjbk"]
May 21 01:53:53.708162 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.708129    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnfjr\" (UniqueName: \"kubernetes.io/projected/4d82ff81-3756-4cbc-8d39-a5b4865e4a52-kube-api-access-mnfjr\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz\" (UID: \"4d82ff81-3756-4cbc-8d39-a5b4865e4a52\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz"
May 21 01:53:53.708265 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.708184    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d82ff81-3756-4cbc-8d39-a5b4865e4a52-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz\" (UID: \"4d82ff81-3756-4cbc-8d39-a5b4865e4a52\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz"
May 21 01:53:53.708265 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.708217    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d82ff81-3756-4cbc-8d39-a5b4865e4a52-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz\" (UID: \"4d82ff81-3756-4cbc-8d39-a5b4865e4a52\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz"
May 21 01:53:53.708265 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.708240    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn8fv\" (UniqueName: \"kubernetes.io/projected/8efec893-1456-4d1b-97c9-4011bf21a112-kube-api-access-wn8fv\") pod \"cert-manager-79c8d999ff-xrjbk\" (UID: \"8efec893-1456-4d1b-97c9-4011bf21a112\") " pod="cert-manager/cert-manager-79c8d999ff-xrjbk"
May 21 01:53:53.708265 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.708263    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8efec893-1456-4d1b-97c9-4011bf21a112-bound-sa-token\") pod \"cert-manager-79c8d999ff-xrjbk\" (UID: \"8efec893-1456-4d1b-97c9-4011bf21a112\") " pod="cert-manager/cert-manager-79c8d999ff-xrjbk"
May 21 01:53:53.809217 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.809194    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8efec893-1456-4d1b-97c9-4011bf21a112-bound-sa-token\") pod \"cert-manager-79c8d999ff-xrjbk\" (UID: \"8efec893-1456-4d1b-97c9-4011bf21a112\") " pod="cert-manager/cert-manager-79c8d999ff-xrjbk"
May 21 01:53:53.809321 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.809263    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mnfjr\" (UniqueName: \"kubernetes.io/projected/4d82ff81-3756-4cbc-8d39-a5b4865e4a52-kube-api-access-mnfjr\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz\" (UID: \"4d82ff81-3756-4cbc-8d39-a5b4865e4a52\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz"
May 21 01:53:53.809321 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.809315    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d82ff81-3756-4cbc-8d39-a5b4865e4a52-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz\" (UID: \"4d82ff81-3756-4cbc-8d39-a5b4865e4a52\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz"
May 21 01:53:53.809430 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.809348    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d82ff81-3756-4cbc-8d39-a5b4865e4a52-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz\" (UID: \"4d82ff81-3756-4cbc-8d39-a5b4865e4a52\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz"
May 21 01:53:53.809430 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.809377    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wn8fv\" (UniqueName: \"kubernetes.io/projected/8efec893-1456-4d1b-97c9-4011bf21a112-kube-api-access-wn8fv\") pod \"cert-manager-79c8d999ff-xrjbk\" (UID: \"8efec893-1456-4d1b-97c9-4011bf21a112\") " pod="cert-manager/cert-manager-79c8d999ff-xrjbk"
May 21 01:53:53.809789 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.809767    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d82ff81-3756-4cbc-8d39-a5b4865e4a52-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz\" (UID: \"4d82ff81-3756-4cbc-8d39-a5b4865e4a52\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz"
May 21 01:53:53.809845 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.809769    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d82ff81-3756-4cbc-8d39-a5b4865e4a52-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz\" (UID: \"4d82ff81-3756-4cbc-8d39-a5b4865e4a52\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz"
May 21 01:53:53.820341 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.820316    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnfjr\" (UniqueName: \"kubernetes.io/projected/4d82ff81-3756-4cbc-8d39-a5b4865e4a52-kube-api-access-mnfjr\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz\" (UID: \"4d82ff81-3756-4cbc-8d39-a5b4865e4a52\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz"
May 21 01:53:53.820458 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.820434    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8efec893-1456-4d1b-97c9-4011bf21a112-bound-sa-token\") pod \"cert-manager-79c8d999ff-xrjbk\" (UID: \"8efec893-1456-4d1b-97c9-4011bf21a112\") " pod="cert-manager/cert-manager-79c8d999ff-xrjbk"
May 21 01:53:53.820601 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.820585    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn8fv\" (UniqueName: \"kubernetes.io/projected/8efec893-1456-4d1b-97c9-4011bf21a112-kube-api-access-wn8fv\") pod \"cert-manager-79c8d999ff-xrjbk\" (UID: \"8efec893-1456-4d1b-97c9-4011bf21a112\") " pod="cert-manager/cert-manager-79c8d999ff-xrjbk"
May 21 01:53:53.911833 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.911775    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz"
May 21 01:53:53.971376 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:53.970911    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-xrjbk"
May 21 01:53:54.042308 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:54.042279    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz"]
May 21 01:53:54.046040 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:53:54.046012    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d82ff81_3756_4cbc_8d39_a5b4865e4a52.slice/crio-2c24a1df1e347ea5e718488f52fdf4c91a9f2ccd34f7da480d9e7dab1c1ca4b4 WatchSource:0}: Error finding container 2c24a1df1e347ea5e718488f52fdf4c91a9f2ccd34f7da480d9e7dab1c1ca4b4: Status 404 returned error can't find the container with id 2c24a1df1e347ea5e718488f52fdf4c91a9f2ccd34f7da480d9e7dab1c1ca4b4
May 21 01:53:54.106102 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:54.106080    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-xrjbk"]
May 21 01:53:54.108686 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:53:54.108664    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8efec893_1456_4d1b_97c9_4011bf21a112.slice/crio-c5efe9e4ed7de64cbdf9971c1929c665ef292407f8860dcea12abde3f882d970 WatchSource:0}: Error finding container c5efe9e4ed7de64cbdf9971c1929c665ef292407f8860dcea12abde3f882d970: Status 404 returned error can't find the container with id c5efe9e4ed7de64cbdf9971c1929c665ef292407f8860dcea12abde3f882d970
May 21 01:53:54.626449 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:54.626413    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-xrjbk" event={"ID":"8efec893-1456-4d1b-97c9-4011bf21a112","Type":"ContainerStarted","Data":"4ba4f2417e0b70912d8c038360211d601e3d4617ae0e4dbcd1d93ced9c07f808"}
May 21 01:53:54.626449 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:54.626456    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-xrjbk" event={"ID":"8efec893-1456-4d1b-97c9-4011bf21a112","Type":"ContainerStarted","Data":"c5efe9e4ed7de64cbdf9971c1929c665ef292407f8860dcea12abde3f882d970"}
May 21 01:53:54.627722 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:54.627695    2552 generic.go:358] "Generic (PLEG): container finished" podID="4d82ff81-3756-4cbc-8d39-a5b4865e4a52" containerID="6803acbcb052fe5d15af99a629c009c14ad3f75955731a3881ea6a8e96dae9fb" exitCode=0
May 21 01:53:54.627836 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:54.627759    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz" event={"ID":"4d82ff81-3756-4cbc-8d39-a5b4865e4a52","Type":"ContainerDied","Data":"6803acbcb052fe5d15af99a629c009c14ad3f75955731a3881ea6a8e96dae9fb"}
May 21 01:53:54.627836 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:54.627782    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz" event={"ID":"4d82ff81-3756-4cbc-8d39-a5b4865e4a52","Type":"ContainerStarted","Data":"2c24a1df1e347ea5e718488f52fdf4c91a9f2ccd34f7da480d9e7dab1c1ca4b4"}
May 21 01:53:54.644998 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:54.644949    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-xrjbk" podStartSLOduration=1.644933622 podStartE2EDuration="1.644933622s" podCreationTimestamp="2026-05-21 01:53:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 01:53:54.64387847 +0000 UTC m=+372.931125246" watchObservedRunningTime="2026-05-21 01:53:54.644933622 +0000 UTC m=+372.932180401"
May 21 01:53:55.632984 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:55.632948    2552 generic.go:358] "Generic (PLEG): container finished" podID="4d82ff81-3756-4cbc-8d39-a5b4865e4a52" containerID="ed12b1c663e144e6ee7886af700708cede7063ce0df8c4e452c0ffe6c1b907ee" exitCode=0
May 21 01:53:55.633359 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:55.633035    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz" event={"ID":"4d82ff81-3756-4cbc-8d39-a5b4865e4a52","Type":"ContainerDied","Data":"ed12b1c663e144e6ee7886af700708cede7063ce0df8c4e452c0ffe6c1b907ee"}
May 21 01:53:56.638697 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:56.638660    2552 generic.go:358] "Generic (PLEG): container finished" podID="4d82ff81-3756-4cbc-8d39-a5b4865e4a52" containerID="b298d6dd518b5f4a544b1be98c5b2c191bda90a4e6d53b67f4079428cfd5976b" exitCode=0
May 21 01:53:56.639080 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:56.638730    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz" event={"ID":"4d82ff81-3756-4cbc-8d39-a5b4865e4a52","Type":"ContainerDied","Data":"b298d6dd518b5f4a544b1be98c5b2c191bda90a4e6d53b67f4079428cfd5976b"}
May 21 01:53:57.777966 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:57.777941    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz"
May 21 01:53:57.840538 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:57.840515    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d82ff81-3756-4cbc-8d39-a5b4865e4a52-bundle\") pod \"4d82ff81-3756-4cbc-8d39-a5b4865e4a52\" (UID: \"4d82ff81-3756-4cbc-8d39-a5b4865e4a52\") "
May 21 01:53:57.840653 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:57.840574    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnfjr\" (UniqueName: \"kubernetes.io/projected/4d82ff81-3756-4cbc-8d39-a5b4865e4a52-kube-api-access-mnfjr\") pod \"4d82ff81-3756-4cbc-8d39-a5b4865e4a52\" (UID: \"4d82ff81-3756-4cbc-8d39-a5b4865e4a52\") "
May 21 01:53:57.840653 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:57.840639    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d82ff81-3756-4cbc-8d39-a5b4865e4a52-util\") pod \"4d82ff81-3756-4cbc-8d39-a5b4865e4a52\" (UID: \"4d82ff81-3756-4cbc-8d39-a5b4865e4a52\") "
May 21 01:53:57.841273 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:57.841241    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d82ff81-3756-4cbc-8d39-a5b4865e4a52-bundle" (OuterVolumeSpecName: "bundle") pod "4d82ff81-3756-4cbc-8d39-a5b4865e4a52" (UID: "4d82ff81-3756-4cbc-8d39-a5b4865e4a52"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:53:57.842813 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:57.842788    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d82ff81-3756-4cbc-8d39-a5b4865e4a52-kube-api-access-mnfjr" (OuterVolumeSpecName: "kube-api-access-mnfjr") pod "4d82ff81-3756-4cbc-8d39-a5b4865e4a52" (UID: "4d82ff81-3756-4cbc-8d39-a5b4865e4a52"). InnerVolumeSpecName "kube-api-access-mnfjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:53:57.846521 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:57.846499    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d82ff81-3756-4cbc-8d39-a5b4865e4a52-util" (OuterVolumeSpecName: "util") pod "4d82ff81-3756-4cbc-8d39-a5b4865e4a52" (UID: "4d82ff81-3756-4cbc-8d39-a5b4865e4a52"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:53:57.941189 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:57.941131    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d82ff81-3756-4cbc-8d39-a5b4865e4a52-util\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:53:57.941189 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:57.941173    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d82ff81-3756-4cbc-8d39-a5b4865e4a52-bundle\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:53:57.941189 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:57.941184    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnfjr\" (UniqueName: \"kubernetes.io/projected/4d82ff81-3756-4cbc-8d39-a5b4865e4a52-kube-api-access-mnfjr\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:53:58.646439 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:58.646360    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz" event={"ID":"4d82ff81-3756-4cbc-8d39-a5b4865e4a52","Type":"ContainerDied","Data":"2c24a1df1e347ea5e718488f52fdf4c91a9f2ccd34f7da480d9e7dab1c1ca4b4"}
May 21 01:53:58.646439 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:58.646391    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c24a1df1e347ea5e718488f52fdf4c91a9f2ccd34f7da480d9e7dab1c1ca4b4"
May 21 01:53:58.646439 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:53:58.646422    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lbhrz"
May 21 01:54:10.415646 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:10.415611    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg"]
May 21 01:54:10.416014 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:10.415933    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d82ff81-3756-4cbc-8d39-a5b4865e4a52" containerName="util"
May 21 01:54:10.416014 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:10.415943    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d82ff81-3756-4cbc-8d39-a5b4865e4a52" containerName="util"
May 21 01:54:10.416014 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:10.415967    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d82ff81-3756-4cbc-8d39-a5b4865e4a52" containerName="extract"
May 21 01:54:10.416014 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:10.415973    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d82ff81-3756-4cbc-8d39-a5b4865e4a52" containerName="extract"
May 21 01:54:10.416014 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:10.415980    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d82ff81-3756-4cbc-8d39-a5b4865e4a52" containerName="pull"
May 21 01:54:10.416014 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:10.415985    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d82ff81-3756-4cbc-8d39-a5b4865e4a52" containerName="pull"
May 21 01:54:10.416189 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:10.416036    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="4d82ff81-3756-4cbc-8d39-a5b4865e4a52" containerName="extract"
May 21 01:54:10.420662 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:10.420644    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg"
May 21 01:54:10.423539 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:10.423518    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 21 01:54:10.423662 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:10.423518    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 21 01:54:10.423662 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:10.423620    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6csb4\""
May 21 01:54:10.429734 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:10.429704    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg"]
May 21 01:54:10.527916 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:10.527886    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/116f3de0-a157-4ced-bbd3-a04f75515171-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg\" (UID: \"116f3de0-a157-4ced-bbd3-a04f75515171\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg"
May 21 01:54:10.528067 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:10.527925    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62sc6\" (UniqueName: \"kubernetes.io/projected/116f3de0-a157-4ced-bbd3-a04f75515171-kube-api-access-62sc6\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg\" (UID: \"116f3de0-a157-4ced-bbd3-a04f75515171\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg"
May 21 01:54:10.528067 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:10.527994    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/116f3de0-a157-4ced-bbd3-a04f75515171-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg\" (UID: \"116f3de0-a157-4ced-bbd3-a04f75515171\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg"
May 21 01:54:10.628618 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:10.628588    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/116f3de0-a157-4ced-bbd3-a04f75515171-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg\" (UID: \"116f3de0-a157-4ced-bbd3-a04f75515171\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg"
May 21 01:54:10.628737 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:10.628650    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/116f3de0-a157-4ced-bbd3-a04f75515171-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg\" (UID: \"116f3de0-a157-4ced-bbd3-a04f75515171\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg"
May 21 01:54:10.628737 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:10.628675    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62sc6\" (UniqueName: \"kubernetes.io/projected/116f3de0-a157-4ced-bbd3-a04f75515171-kube-api-access-62sc6\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg\" (UID: \"116f3de0-a157-4ced-bbd3-a04f75515171\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg"
May 21 01:54:10.629034 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:10.629013    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/116f3de0-a157-4ced-bbd3-a04f75515171-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg\" (UID: \"116f3de0-a157-4ced-bbd3-a04f75515171\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg"
May 21 01:54:10.629072 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:10.629024    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/116f3de0-a157-4ced-bbd3-a04f75515171-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg\" (UID: \"116f3de0-a157-4ced-bbd3-a04f75515171\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg"
May 21 01:54:10.636311 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:10.636280    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62sc6\" (UniqueName: \"kubernetes.io/projected/116f3de0-a157-4ced-bbd3-a04f75515171-kube-api-access-62sc6\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg\" (UID: \"116f3de0-a157-4ced-bbd3-a04f75515171\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg"
May 21 01:54:10.730656 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:10.730592    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg"
May 21 01:54:10.859339 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:10.859316    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg"]
May 21 01:54:10.861750 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:54:10.861719    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod116f3de0_a157_4ced_bbd3_a04f75515171.slice/crio-343eeddbcd78cca98da239c1ab584d42237f121aabb4a3023241fb235d416807 WatchSource:0}: Error finding container 343eeddbcd78cca98da239c1ab584d42237f121aabb4a3023241fb235d416807: Status 404 returned error can't find the container with id 343eeddbcd78cca98da239c1ab584d42237f121aabb4a3023241fb235d416807
May 21 01:54:11.690753 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:11.690721    2552 generic.go:358] "Generic (PLEG): container finished" podID="116f3de0-a157-4ced-bbd3-a04f75515171" containerID="6a5608ac467da8fbc08719500dc138e996ab3f025cb16c22a406006cfdf35bf8" exitCode=0
May 21 01:54:11.691100 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:11.690777    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg" event={"ID":"116f3de0-a157-4ced-bbd3-a04f75515171","Type":"ContainerDied","Data":"6a5608ac467da8fbc08719500dc138e996ab3f025cb16c22a406006cfdf35bf8"}
May 21 01:54:11.691100 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:11.690810    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg" event={"ID":"116f3de0-a157-4ced-bbd3-a04f75515171","Type":"ContainerStarted","Data":"343eeddbcd78cca98da239c1ab584d42237f121aabb4a3023241fb235d416807"}
May 21 01:54:11.951423 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:11.951340    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64cdd6779c-2257z"]
May 21 01:54:11.953707 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:11.953685    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-2257z"
May 21 01:54:11.956475 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:11.956451    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 21 01:54:11.956598 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:11.956575    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 21 01:54:11.956745 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:11.956727    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 21 01:54:11.956829 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:11.956810    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fxg7r\""
May 21 01:54:11.956973 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:11.956945    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 21 01:54:11.965859 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:11.965839    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64cdd6779c-2257z"]
May 21 01:54:12.039651 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:12.039626    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6thb\" (UniqueName: \"kubernetes.io/projected/14857875-dfa0-4628-88e1-b3b11dbe6745-kube-api-access-h6thb\") pod \"opendatahub-operator-controller-manager-64cdd6779c-2257z\" (UID: \"14857875-dfa0-4628-88e1-b3b11dbe6745\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-2257z"
May 21 01:54:12.039775 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:12.039700    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/14857875-dfa0-4628-88e1-b3b11dbe6745-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64cdd6779c-2257z\" (UID: \"14857875-dfa0-4628-88e1-b3b11dbe6745\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-2257z"
May 21 01:54:12.039775 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:12.039732    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14857875-dfa0-4628-88e1-b3b11dbe6745-webhook-cert\") pod \"opendatahub-operator-controller-manager-64cdd6779c-2257z\" (UID: \"14857875-dfa0-4628-88e1-b3b11dbe6745\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-2257z"
May 21 01:54:12.141019 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:12.140993    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/14857875-dfa0-4628-88e1-b3b11dbe6745-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64cdd6779c-2257z\" (UID: \"14857875-dfa0-4628-88e1-b3b11dbe6745\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-2257z"
May 21 01:54:12.141142 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:12.141032    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14857875-dfa0-4628-88e1-b3b11dbe6745-webhook-cert\") pod \"opendatahub-operator-controller-manager-64cdd6779c-2257z\" (UID: \"14857875-dfa0-4628-88e1-b3b11dbe6745\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-2257z"
May 21 01:54:12.141142 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:12.141064    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h6thb\" (UniqueName: \"kubernetes.io/projected/14857875-dfa0-4628-88e1-b3b11dbe6745-kube-api-access-h6thb\") pod \"opendatahub-operator-controller-manager-64cdd6779c-2257z\" (UID: \"14857875-dfa0-4628-88e1-b3b11dbe6745\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-2257z"
May 21 01:54:12.143481 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:12.143457    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14857875-dfa0-4628-88e1-b3b11dbe6745-webhook-cert\") pod \"opendatahub-operator-controller-manager-64cdd6779c-2257z\" (UID: \"14857875-dfa0-4628-88e1-b3b11dbe6745\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-2257z"
May 21 01:54:12.143596 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:12.143463    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/14857875-dfa0-4628-88e1-b3b11dbe6745-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64cdd6779c-2257z\" (UID: \"14857875-dfa0-4628-88e1-b3b11dbe6745\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-2257z"
May 21 01:54:12.149636 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:12.149609    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6thb\" (UniqueName: \"kubernetes.io/projected/14857875-dfa0-4628-88e1-b3b11dbe6745-kube-api-access-h6thb\") pod \"opendatahub-operator-controller-manager-64cdd6779c-2257z\" (UID: \"14857875-dfa0-4628-88e1-b3b11dbe6745\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-2257z"
May 21 01:54:12.265312 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:12.265290    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-2257z"
May 21 01:54:12.400587 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:12.400559    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64cdd6779c-2257z"]
May 21 01:54:12.405636 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:54:12.405596    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14857875_dfa0_4628_88e1_b3b11dbe6745.slice/crio-168f2c8776b474ecba1309130e9cc2b364da1aebe8eb8a5b4f8fb0bcd7daea0f WatchSource:0}: Error finding container 168f2c8776b474ecba1309130e9cc2b364da1aebe8eb8a5b4f8fb0bcd7daea0f: Status 404 returned error can't find the container with id 168f2c8776b474ecba1309130e9cc2b364da1aebe8eb8a5b4f8fb0bcd7daea0f
May 21 01:54:12.695766 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:12.695727    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-2257z" event={"ID":"14857875-dfa0-4628-88e1-b3b11dbe6745","Type":"ContainerStarted","Data":"168f2c8776b474ecba1309130e9cc2b364da1aebe8eb8a5b4f8fb0bcd7daea0f"}
May 21 01:54:12.697236 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:12.697211    2552 generic.go:358] "Generic (PLEG): container finished" podID="116f3de0-a157-4ced-bbd3-a04f75515171" containerID="77d587991daf031882786a2253433854dcbc19502afad15840a4ccf15761577b" exitCode=0
May 21 01:54:12.697359 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:12.697290    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg" event={"ID":"116f3de0-a157-4ced-bbd3-a04f75515171","Type":"ContainerDied","Data":"77d587991daf031882786a2253433854dcbc19502afad15840a4ccf15761577b"}
May 21 01:54:13.704559 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:13.704444    2552 generic.go:358] "Generic (PLEG): container finished" podID="116f3de0-a157-4ced-bbd3-a04f75515171" containerID="6dd93c7d3402c529f3856d04bc2c9ec2559edd8f498285e349d9c6f7cc6e8209" exitCode=0
May 21 01:54:13.704559 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:13.704493    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg" event={"ID":"116f3de0-a157-4ced-bbd3-a04f75515171","Type":"ContainerDied","Data":"6dd93c7d3402c529f3856d04bc2c9ec2559edd8f498285e349d9c6f7cc6e8209"}
May 21 01:54:14.892480 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:14.892458    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg"
May 21 01:54:14.966918 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:14.966848    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/116f3de0-a157-4ced-bbd3-a04f75515171-bundle\") pod \"116f3de0-a157-4ced-bbd3-a04f75515171\" (UID: \"116f3de0-a157-4ced-bbd3-a04f75515171\") "
May 21 01:54:14.967055 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:14.966957    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/116f3de0-a157-4ced-bbd3-a04f75515171-util\") pod \"116f3de0-a157-4ced-bbd3-a04f75515171\" (UID: \"116f3de0-a157-4ced-bbd3-a04f75515171\") "
May 21 01:54:14.967055 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:14.966984    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62sc6\" (UniqueName: \"kubernetes.io/projected/116f3de0-a157-4ced-bbd3-a04f75515171-kube-api-access-62sc6\") pod \"116f3de0-a157-4ced-bbd3-a04f75515171\" (UID: \"116f3de0-a157-4ced-bbd3-a04f75515171\") "
May 21 01:54:14.968137 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:14.968101    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/116f3de0-a157-4ced-bbd3-a04f75515171-bundle" (OuterVolumeSpecName: "bundle") pod "116f3de0-a157-4ced-bbd3-a04f75515171" (UID: "116f3de0-a157-4ced-bbd3-a04f75515171"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:54:14.969167 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:14.969143    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/116f3de0-a157-4ced-bbd3-a04f75515171-kube-api-access-62sc6" (OuterVolumeSpecName: "kube-api-access-62sc6") pod "116f3de0-a157-4ced-bbd3-a04f75515171" (UID: "116f3de0-a157-4ced-bbd3-a04f75515171"). InnerVolumeSpecName "kube-api-access-62sc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:54:14.973408 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:14.973383    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/116f3de0-a157-4ced-bbd3-a04f75515171-util" (OuterVolumeSpecName: "util") pod "116f3de0-a157-4ced-bbd3-a04f75515171" (UID: "116f3de0-a157-4ced-bbd3-a04f75515171"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:54:15.068393 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:15.068354    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/116f3de0-a157-4ced-bbd3-a04f75515171-util\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:54:15.068573 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:15.068393    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62sc6\" (UniqueName: \"kubernetes.io/projected/116f3de0-a157-4ced-bbd3-a04f75515171-kube-api-access-62sc6\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:54:15.068573 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:15.068439    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/116f3de0-a157-4ced-bbd3-a04f75515171-bundle\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:54:15.714641 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:15.714586    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-2257z" event={"ID":"14857875-dfa0-4628-88e1-b3b11dbe6745","Type":"ContainerStarted","Data":"0ad6713bb832daae675e3c4999b6bdd1fe25fddd86f457d44ba3196248f78b14"}
May 21 01:54:15.714841 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:15.714752    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-2257z"
May 21 01:54:15.719737 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:15.719711    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg"
May 21 01:54:15.719881 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:15.719736    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbbkg" event={"ID":"116f3de0-a157-4ced-bbd3-a04f75515171","Type":"ContainerDied","Data":"343eeddbcd78cca98da239c1ab584d42237f121aabb4a3023241fb235d416807"}
May 21 01:54:15.719881 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:15.719766    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="343eeddbcd78cca98da239c1ab584d42237f121aabb4a3023241fb235d416807"
May 21 01:54:15.737099 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:15.737057    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-2257z" podStartSLOduration=2.332501114 podStartE2EDuration="4.73704437s" podCreationTimestamp="2026-05-21 01:54:11 +0000 UTC" firstStartedPulling="2026-05-21 01:54:12.407505377 +0000 UTC m=+390.694752138" lastFinishedPulling="2026-05-21 01:54:14.812048639 +0000 UTC m=+393.099295394" observedRunningTime="2026-05-21 01:54:15.734621222 +0000 UTC m=+394.021867999" watchObservedRunningTime="2026-05-21 01:54:15.73704437 +0000 UTC m=+394.024291147"
May 21 01:54:26.725323 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:26.725292    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-2257z"
May 21 01:54:33.194067 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:33.194031    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-k9rqh"]
May 21 01:54:33.194508 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:33.194353    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="116f3de0-a157-4ced-bbd3-a04f75515171" containerName="pull"
May 21 01:54:33.194508 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:33.194364    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="116f3de0-a157-4ced-bbd3-a04f75515171" containerName="pull"
May 21 01:54:33.194508 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:33.194375    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="116f3de0-a157-4ced-bbd3-a04f75515171" containerName="extract"
May 21 01:54:33.194508 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:33.194381    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="116f3de0-a157-4ced-bbd3-a04f75515171" containerName="extract"
May 21 01:54:33.194508 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:33.194398    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="116f3de0-a157-4ced-bbd3-a04f75515171" containerName="util"
May 21 01:54:33.194508 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:33.194403    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="116f3de0-a157-4ced-bbd3-a04f75515171" containerName="util"
May 21 01:54:33.194508 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:33.194469    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="116f3de0-a157-4ced-bbd3-a04f75515171" containerName="extract"
May 21 01:54:33.198643 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:33.198627    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-k9rqh"
May 21 01:54:33.201367 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:33.201341    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 21 01:54:33.201494 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:33.201350    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-hzlr8\""
May 21 01:54:33.206582 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:33.206541    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-k9rqh"]
May 21 01:54:33.301171 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:33.301149    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1460cc92-e201-416d-952c-6a40466f4289-cert\") pod \"odh-model-controller-858dbf95b8-k9rqh\" (UID: \"1460cc92-e201-416d-952c-6a40466f4289\") " pod="opendatahub/odh-model-controller-858dbf95b8-k9rqh"
May 21 01:54:33.301282 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:33.301197    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffjpm\" (UniqueName: \"kubernetes.io/projected/1460cc92-e201-416d-952c-6a40466f4289-kube-api-access-ffjpm\") pod \"odh-model-controller-858dbf95b8-k9rqh\" (UID: \"1460cc92-e201-416d-952c-6a40466f4289\") " pod="opendatahub/odh-model-controller-858dbf95b8-k9rqh"
May 21 01:54:33.401749 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:33.401715    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1460cc92-e201-416d-952c-6a40466f4289-cert\") pod \"odh-model-controller-858dbf95b8-k9rqh\" (UID: \"1460cc92-e201-416d-952c-6a40466f4289\") " pod="opendatahub/odh-model-controller-858dbf95b8-k9rqh"
May 21 01:54:33.401902 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:33.401775    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ffjpm\" (UniqueName: \"kubernetes.io/projected/1460cc92-e201-416d-952c-6a40466f4289-kube-api-access-ffjpm\") pod \"odh-model-controller-858dbf95b8-k9rqh\" (UID: \"1460cc92-e201-416d-952c-6a40466f4289\") " pod="opendatahub/odh-model-controller-858dbf95b8-k9rqh"
May 21 01:54:33.401902 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:54:33.401873    2552 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 21 01:54:33.401974 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:54:33.401960    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1460cc92-e201-416d-952c-6a40466f4289-cert podName:1460cc92-e201-416d-952c-6a40466f4289 nodeName:}" failed. No retries permitted until 2026-05-21 01:54:33.901939 +0000 UTC m=+412.189185770 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1460cc92-e201-416d-952c-6a40466f4289-cert") pod "odh-model-controller-858dbf95b8-k9rqh" (UID: "1460cc92-e201-416d-952c-6a40466f4289") : secret "odh-model-controller-webhook-cert" not found
May 21 01:54:33.409984 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:33.409960    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffjpm\" (UniqueName: \"kubernetes.io/projected/1460cc92-e201-416d-952c-6a40466f4289-kube-api-access-ffjpm\") pod \"odh-model-controller-858dbf95b8-k9rqh\" (UID: \"1460cc92-e201-416d-952c-6a40466f4289\") " pod="opendatahub/odh-model-controller-858dbf95b8-k9rqh"
May 21 01:54:33.905852 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:33.905817    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1460cc92-e201-416d-952c-6a40466f4289-cert\") pod \"odh-model-controller-858dbf95b8-k9rqh\" (UID: \"1460cc92-e201-416d-952c-6a40466f4289\") " pod="opendatahub/odh-model-controller-858dbf95b8-k9rqh"
May 21 01:54:33.908199 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:33.908169    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1460cc92-e201-416d-952c-6a40466f4289-cert\") pod \"odh-model-controller-858dbf95b8-k9rqh\" (UID: \"1460cc92-e201-416d-952c-6a40466f4289\") " pod="opendatahub/odh-model-controller-858dbf95b8-k9rqh"
May 21 01:54:34.109962 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:34.109926    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-k9rqh"
May 21 01:54:34.237183 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:34.237162    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-k9rqh"]
May 21 01:54:34.239369 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:54:34.239346    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1460cc92_e201_416d_952c_6a40466f4289.slice/crio-947b362768044be258b6d14ac2e4edfdbd9f98200de09e00cc21632a84b957ee WatchSource:0}: Error finding container 947b362768044be258b6d14ac2e4edfdbd9f98200de09e00cc21632a84b957ee: Status 404 returned error can't find the container with id 947b362768044be258b6d14ac2e4edfdbd9f98200de09e00cc21632a84b957ee
May 21 01:54:34.788379 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:34.788339    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-k9rqh" event={"ID":"1460cc92-e201-416d-952c-6a40466f4289","Type":"ContainerStarted","Data":"947b362768044be258b6d14ac2e4edfdbd9f98200de09e00cc21632a84b957ee"}
May 21 01:54:37.801965 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:37.801931    2552 generic.go:358] "Generic (PLEG): container finished" podID="1460cc92-e201-416d-952c-6a40466f4289" containerID="4822e61fa6c7a342c5d22d0270ca2642d2f32361dbcde941c131bab6490a791f" exitCode=1
May 21 01:54:37.802340 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:37.802005    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-k9rqh" event={"ID":"1460cc92-e201-416d-952c-6a40466f4289","Type":"ContainerDied","Data":"4822e61fa6c7a342c5d22d0270ca2642d2f32361dbcde941c131bab6490a791f"}
May 21 01:54:37.802340 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:37.802188    2552 scope.go:117] "RemoveContainer" containerID="4822e61fa6c7a342c5d22d0270ca2642d2f32361dbcde941c131bab6490a791f"
May 21 01:54:38.730128 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:38.730098    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-qcw9p"]
May 21 01:54:38.733619 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:38.733593    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-qcw9p"
May 21 01:54:38.736682 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:38.736463    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-6wbkb\""
May 21 01:54:38.736920 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:38.736903    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 21 01:54:38.745243 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:38.745222    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-qcw9p"]
May 21 01:54:38.807701 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:38.807674    2552 generic.go:358] "Generic (PLEG): container finished" podID="1460cc92-e201-416d-952c-6a40466f4289" containerID="c50cb3c00d16b3751df6d99eff518d5f231d6fe64ea719766ae2897bda52a4b5" exitCode=1
May 21 01:54:38.808088 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:38.807747    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-k9rqh" event={"ID":"1460cc92-e201-416d-952c-6a40466f4289","Type":"ContainerDied","Data":"c50cb3c00d16b3751df6d99eff518d5f231d6fe64ea719766ae2897bda52a4b5"}
May 21 01:54:38.808088 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:38.807775    2552 scope.go:117] "RemoveContainer" containerID="4822e61fa6c7a342c5d22d0270ca2642d2f32361dbcde941c131bab6490a791f"
May 21 01:54:38.808088 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:38.807951    2552 scope.go:117] "RemoveContainer" containerID="c50cb3c00d16b3751df6d99eff518d5f231d6fe64ea719766ae2897bda52a4b5"
May 21 01:54:38.808237 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:54:38.808176    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-k9rqh_opendatahub(1460cc92-e201-416d-952c-6a40466f4289)\"" pod="opendatahub/odh-model-controller-858dbf95b8-k9rqh" podUID="1460cc92-e201-416d-952c-6a40466f4289"
May 21 01:54:38.854326 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:38.854302    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh4xm\" (UniqueName: \"kubernetes.io/projected/e96cf395-ac55-402d-9f2d-a16cca875874-kube-api-access-dh4xm\") pod \"kserve-controller-manager-856948b99f-qcw9p\" (UID: \"e96cf395-ac55-402d-9f2d-a16cca875874\") " pod="opendatahub/kserve-controller-manager-856948b99f-qcw9p"
May 21 01:54:38.854445 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:38.854355    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e96cf395-ac55-402d-9f2d-a16cca875874-cert\") pod \"kserve-controller-manager-856948b99f-qcw9p\" (UID: \"e96cf395-ac55-402d-9f2d-a16cca875874\") " pod="opendatahub/kserve-controller-manager-856948b99f-qcw9p"
May 21 01:54:38.955706 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:38.955672    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dh4xm\" (UniqueName: \"kubernetes.io/projected/e96cf395-ac55-402d-9f2d-a16cca875874-kube-api-access-dh4xm\") pod \"kserve-controller-manager-856948b99f-qcw9p\" (UID: \"e96cf395-ac55-402d-9f2d-a16cca875874\") " pod="opendatahub/kserve-controller-manager-856948b99f-qcw9p"
May 21 01:54:38.955864 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:38.955842    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e96cf395-ac55-402d-9f2d-a16cca875874-cert\") pod \"kserve-controller-manager-856948b99f-qcw9p\" (UID: \"e96cf395-ac55-402d-9f2d-a16cca875874\") " pod="opendatahub/kserve-controller-manager-856948b99f-qcw9p"
May 21 01:54:38.955942 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:54:38.955929    2552 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 21 01:54:38.956000 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:54:38.955989    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e96cf395-ac55-402d-9f2d-a16cca875874-cert podName:e96cf395-ac55-402d-9f2d-a16cca875874 nodeName:}" failed. No retries permitted until 2026-05-21 01:54:39.455970641 +0000 UTC m=+417.743217409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e96cf395-ac55-402d-9f2d-a16cca875874-cert") pod "kserve-controller-manager-856948b99f-qcw9p" (UID: "e96cf395-ac55-402d-9f2d-a16cca875874") : secret "kserve-webhook-server-cert" not found
May 21 01:54:38.966809 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:38.966786    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh4xm\" (UniqueName: \"kubernetes.io/projected/e96cf395-ac55-402d-9f2d-a16cca875874-kube-api-access-dh4xm\") pod \"kserve-controller-manager-856948b99f-qcw9p\" (UID: \"e96cf395-ac55-402d-9f2d-a16cca875874\") " pod="opendatahub/kserve-controller-manager-856948b99f-qcw9p"
May 21 01:54:39.460719 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:39.460669    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e96cf395-ac55-402d-9f2d-a16cca875874-cert\") pod \"kserve-controller-manager-856948b99f-qcw9p\" (UID: \"e96cf395-ac55-402d-9f2d-a16cca875874\") " pod="opendatahub/kserve-controller-manager-856948b99f-qcw9p"
May 21 01:54:39.463020 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:39.462998    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e96cf395-ac55-402d-9f2d-a16cca875874-cert\") pod \"kserve-controller-manager-856948b99f-qcw9p\" (UID: \"e96cf395-ac55-402d-9f2d-a16cca875874\") " pod="opendatahub/kserve-controller-manager-856948b99f-qcw9p"
May 21 01:54:39.653642 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:39.653619    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-qcw9p"
May 21 01:54:39.778422 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:39.778393    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-qcw9p"]
May 21 01:54:39.780314 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:54:39.780286    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode96cf395_ac55_402d_9f2d_a16cca875874.slice/crio-b786efca9fb7998b967a6723d5872eff1326bd0b10be59305be0851ef4290031 WatchSource:0}: Error finding container b786efca9fb7998b967a6723d5872eff1326bd0b10be59305be0851ef4290031: Status 404 returned error can't find the container with id b786efca9fb7998b967a6723d5872eff1326bd0b10be59305be0851ef4290031
May 21 01:54:39.812729 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:39.812710    2552 scope.go:117] "RemoveContainer" containerID="c50cb3c00d16b3751df6d99eff518d5f231d6fe64ea719766ae2897bda52a4b5"
May 21 01:54:39.813090 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:54:39.812942    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-k9rqh_opendatahub(1460cc92-e201-416d-952c-6a40466f4289)\"" pod="opendatahub/odh-model-controller-858dbf95b8-k9rqh" podUID="1460cc92-e201-416d-952c-6a40466f4289"
May 21 01:54:39.813504 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:39.813481    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-qcw9p" event={"ID":"e96cf395-ac55-402d-9f2d-a16cca875874","Type":"ContainerStarted","Data":"b786efca9fb7998b967a6723d5872eff1326bd0b10be59305be0851ef4290031"}
May 21 01:54:40.023074 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.023044    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb"]
May 21 01:54:40.028186 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.028168    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb"
May 21 01:54:40.030597 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.030580    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 21 01:54:40.030687 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.030641    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6csb4\""
May 21 01:54:40.030687 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.030641    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 21 01:54:40.037815 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.037795    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb"]
May 21 01:54:40.133046 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.133015    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-f6cbd8488-xcjvc"]
May 21 01:54:40.136384 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.136360    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f6cbd8488-xcjvc"
May 21 01:54:40.138865 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.138842    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vxsmh\""
May 21 01:54:40.138983 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.138947    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 21 01:54:40.139044 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.138976    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 21 01:54:40.139256 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.139242    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 21 01:54:40.139437 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.139422    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 21 01:54:40.146259 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.146239    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f6cbd8488-xcjvc"]
May 21 01:54:40.167303 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.167276    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/640196bc-432a-4bbd-9971-e986ed9a83de-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb\" (UID: \"640196bc-432a-4bbd-9971-e986ed9a83de\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb"
May 21 01:54:40.167418 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.167329    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4nxf\" (UniqueName: \"kubernetes.io/projected/640196bc-432a-4bbd-9971-e986ed9a83de-kube-api-access-d4nxf\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb\" (UID: \"640196bc-432a-4bbd-9971-e986ed9a83de\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb"
May 21 01:54:40.167418 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.167396    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/640196bc-432a-4bbd-9971-e986ed9a83de-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb\" (UID: \"640196bc-432a-4bbd-9971-e986ed9a83de\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb"
May 21 01:54:40.268719 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.268691    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/640196bc-432a-4bbd-9971-e986ed9a83de-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb\" (UID: \"640196bc-432a-4bbd-9971-e986ed9a83de\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb"
May 21 01:54:40.268832 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.268740    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d4nxf\" (UniqueName: \"kubernetes.io/projected/640196bc-432a-4bbd-9971-e986ed9a83de-kube-api-access-d4nxf\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb\" (UID: \"640196bc-432a-4bbd-9971-e986ed9a83de\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb"
May 21 01:54:40.268832 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.268768    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/640196bc-432a-4bbd-9971-e986ed9a83de-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb\" (UID: \"640196bc-432a-4bbd-9971-e986ed9a83de\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb"
May 21 01:54:40.268941 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.268833    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55811ffa-4427-4e2d-8282-2faa23f57c5f-tmp\") pod \"kube-auth-proxy-f6cbd8488-xcjvc\" (UID: \"55811ffa-4427-4e2d-8282-2faa23f57c5f\") " pod="openshift-ingress/kube-auth-proxy-f6cbd8488-xcjvc"
May 21 01:54:40.268941 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.268865    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55811ffa-4427-4e2d-8282-2faa23f57c5f-tls-certs\") pod \"kube-auth-proxy-f6cbd8488-xcjvc\" (UID: \"55811ffa-4427-4e2d-8282-2faa23f57c5f\") " pod="openshift-ingress/kube-auth-proxy-f6cbd8488-xcjvc"
May 21 01:54:40.269045 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.268945    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksjhl\" (UniqueName: \"kubernetes.io/projected/55811ffa-4427-4e2d-8282-2faa23f57c5f-kube-api-access-ksjhl\") pod \"kube-auth-proxy-f6cbd8488-xcjvc\" (UID: \"55811ffa-4427-4e2d-8282-2faa23f57c5f\") " pod="openshift-ingress/kube-auth-proxy-f6cbd8488-xcjvc"
May 21 01:54:40.269121 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.269101    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/640196bc-432a-4bbd-9971-e986ed9a83de-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb\" (UID: \"640196bc-432a-4bbd-9971-e986ed9a83de\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb"
May 21 01:54:40.269192 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.269170    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/640196bc-432a-4bbd-9971-e986ed9a83de-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb\" (UID: \"640196bc-432a-4bbd-9971-e986ed9a83de\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb"
May 21 01:54:40.277041 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.276990    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4nxf\" (UniqueName: \"kubernetes.io/projected/640196bc-432a-4bbd-9971-e986ed9a83de-kube-api-access-d4nxf\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb\" (UID: \"640196bc-432a-4bbd-9971-e986ed9a83de\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb"
May 21 01:54:40.339005 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.338981    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb"
May 21 01:54:40.369891 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.369866    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55811ffa-4427-4e2d-8282-2faa23f57c5f-tmp\") pod \"kube-auth-proxy-f6cbd8488-xcjvc\" (UID: \"55811ffa-4427-4e2d-8282-2faa23f57c5f\") " pod="openshift-ingress/kube-auth-proxy-f6cbd8488-xcjvc"
May 21 01:54:40.370002 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.369901    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55811ffa-4427-4e2d-8282-2faa23f57c5f-tls-certs\") pod \"kube-auth-proxy-f6cbd8488-xcjvc\" (UID: \"55811ffa-4427-4e2d-8282-2faa23f57c5f\") " pod="openshift-ingress/kube-auth-proxy-f6cbd8488-xcjvc"
May 21 01:54:40.370002 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.369930    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ksjhl\" (UniqueName: \"kubernetes.io/projected/55811ffa-4427-4e2d-8282-2faa23f57c5f-kube-api-access-ksjhl\") pod \"kube-auth-proxy-f6cbd8488-xcjvc\" (UID: \"55811ffa-4427-4e2d-8282-2faa23f57c5f\") " pod="openshift-ingress/kube-auth-proxy-f6cbd8488-xcjvc"
May 21 01:54:40.372295 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.372273    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55811ffa-4427-4e2d-8282-2faa23f57c5f-tmp\") pod \"kube-auth-proxy-f6cbd8488-xcjvc\" (UID: \"55811ffa-4427-4e2d-8282-2faa23f57c5f\") " pod="openshift-ingress/kube-auth-proxy-f6cbd8488-xcjvc"
May 21 01:54:40.372440 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.372418    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55811ffa-4427-4e2d-8282-2faa23f57c5f-tls-certs\") pod \"kube-auth-proxy-f6cbd8488-xcjvc\" (UID: \"55811ffa-4427-4e2d-8282-2faa23f57c5f\") " pod="openshift-ingress/kube-auth-proxy-f6cbd8488-xcjvc"
May 21 01:54:40.377586 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.377564    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksjhl\" (UniqueName: \"kubernetes.io/projected/55811ffa-4427-4e2d-8282-2faa23f57c5f-kube-api-access-ksjhl\") pod \"kube-auth-proxy-f6cbd8488-xcjvc\" (UID: \"55811ffa-4427-4e2d-8282-2faa23f57c5f\") " pod="openshift-ingress/kube-auth-proxy-f6cbd8488-xcjvc"
May 21 01:54:40.447474 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.447438    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f6cbd8488-xcjvc"
May 21 01:54:40.482539 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.482510    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb"]
May 21 01:54:40.485886 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:54:40.485851    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod640196bc_432a_4bbd_9971_e986ed9a83de.slice/crio-3a5fb31628a3b11fba1047125424f5909bc57c93daa17167e74fa5b89fba9936 WatchSource:0}: Error finding container 3a5fb31628a3b11fba1047125424f5909bc57c93daa17167e74fa5b89fba9936: Status 404 returned error can't find the container with id 3a5fb31628a3b11fba1047125424f5909bc57c93daa17167e74fa5b89fba9936
May 21 01:54:40.602302 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.602274    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f6cbd8488-xcjvc"]
May 21 01:54:40.604302 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:54:40.604273    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55811ffa_4427_4e2d_8282_2faa23f57c5f.slice/crio-65f4df2e9c6b8839f99f7a9ad7b93f989377e6377135eb1b633444e3882fc5e3 WatchSource:0}: Error finding container 65f4df2e9c6b8839f99f7a9ad7b93f989377e6377135eb1b633444e3882fc5e3: Status 404 returned error can't find the container with id 65f4df2e9c6b8839f99f7a9ad7b93f989377e6377135eb1b633444e3882fc5e3
May 21 01:54:40.818580 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.818481    2552 generic.go:358] "Generic (PLEG): container finished" podID="640196bc-432a-4bbd-9971-e986ed9a83de" containerID="d5c65eae093a3f4d4ea0a74b7d5d227caf9687c78ad72e1a296ad8b0da30c596" exitCode=0
May 21 01:54:40.818580 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.818556    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb" event={"ID":"640196bc-432a-4bbd-9971-e986ed9a83de","Type":"ContainerDied","Data":"d5c65eae093a3f4d4ea0a74b7d5d227caf9687c78ad72e1a296ad8b0da30c596"}
May 21 01:54:40.819050 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.818596    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb" event={"ID":"640196bc-432a-4bbd-9971-e986ed9a83de","Type":"ContainerStarted","Data":"3a5fb31628a3b11fba1047125424f5909bc57c93daa17167e74fa5b89fba9936"}
May 21 01:54:40.819845 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:40.819822    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f6cbd8488-xcjvc" event={"ID":"55811ffa-4427-4e2d-8282-2faa23f57c5f","Type":"ContainerStarted","Data":"65f4df2e9c6b8839f99f7a9ad7b93f989377e6377135eb1b633444e3882fc5e3"}
May 21 01:54:41.825622 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:41.825585    2552 generic.go:358] "Generic (PLEG): container finished" podID="640196bc-432a-4bbd-9971-e986ed9a83de" containerID="94d3a26b1460c1477f3e75562c59736981400f9a0e17ead9d5d40673c0343d58" exitCode=0
May 21 01:54:41.826065 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:41.825679    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb" event={"ID":"640196bc-432a-4bbd-9971-e986ed9a83de","Type":"ContainerDied","Data":"94d3a26b1460c1477f3e75562c59736981400f9a0e17ead9d5d40673c0343d58"}
May 21 01:54:42.832112 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:42.832071    2552 generic.go:358] "Generic (PLEG): container finished" podID="640196bc-432a-4bbd-9971-e986ed9a83de" containerID="d73745e2f0d71886a21020b0ae37c8e462a87c8e832ca41f6dbebd75035d5e94" exitCode=0
May 21 01:54:42.832556 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:42.832142    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb" event={"ID":"640196bc-432a-4bbd-9971-e986ed9a83de","Type":"ContainerDied","Data":"d73745e2f0d71886a21020b0ae37c8e462a87c8e832ca41f6dbebd75035d5e94"}
May 21 01:54:43.929804 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:43.929779    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 21 01:54:43.997322 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:43.997301    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb"
May 21 01:54:44.108987 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:44.108914    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4nxf\" (UniqueName: \"kubernetes.io/projected/640196bc-432a-4bbd-9971-e986ed9a83de-kube-api-access-d4nxf\") pod \"640196bc-432a-4bbd-9971-e986ed9a83de\" (UID: \"640196bc-432a-4bbd-9971-e986ed9a83de\") "
May 21 01:54:44.109113 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:44.109037    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/640196bc-432a-4bbd-9971-e986ed9a83de-util\") pod \"640196bc-432a-4bbd-9971-e986ed9a83de\" (UID: \"640196bc-432a-4bbd-9971-e986ed9a83de\") "
May 21 01:54:44.109113 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:44.109057    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/640196bc-432a-4bbd-9971-e986ed9a83de-bundle\") pod \"640196bc-432a-4bbd-9971-e986ed9a83de\" (UID: \"640196bc-432a-4bbd-9971-e986ed9a83de\") "
May 21 01:54:44.109940 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:44.109916    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/640196bc-432a-4bbd-9971-e986ed9a83de-bundle" (OuterVolumeSpecName: "bundle") pod "640196bc-432a-4bbd-9971-e986ed9a83de" (UID: "640196bc-432a-4bbd-9971-e986ed9a83de"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:54:44.110033 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:44.110006    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-k9rqh"
May 21 01:54:44.110369 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:44.110355    2552 scope.go:117] "RemoveContainer" containerID="c50cb3c00d16b3751df6d99eff518d5f231d6fe64ea719766ae2897bda52a4b5"
May 21 01:54:44.110561 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:54:44.110530    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-k9rqh_opendatahub(1460cc92-e201-416d-952c-6a40466f4289)\"" pod="opendatahub/odh-model-controller-858dbf95b8-k9rqh" podUID="1460cc92-e201-416d-952c-6a40466f4289"
May 21 01:54:44.110934 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:44.110895    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/640196bc-432a-4bbd-9971-e986ed9a83de-kube-api-access-d4nxf" (OuterVolumeSpecName: "kube-api-access-d4nxf") pod "640196bc-432a-4bbd-9971-e986ed9a83de" (UID: "640196bc-432a-4bbd-9971-e986ed9a83de"). InnerVolumeSpecName "kube-api-access-d4nxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:54:44.114526 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:44.114497    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/640196bc-432a-4bbd-9971-e986ed9a83de-util" (OuterVolumeSpecName: "util") pod "640196bc-432a-4bbd-9971-e986ed9a83de" (UID: "640196bc-432a-4bbd-9971-e986ed9a83de"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:54:44.209601 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:44.209573    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/640196bc-432a-4bbd-9971-e986ed9a83de-util\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:54:44.209601 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:44.209601    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/640196bc-432a-4bbd-9971-e986ed9a83de-bundle\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:54:44.209752 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:44.209611    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4nxf\" (UniqueName: \"kubernetes.io/projected/640196bc-432a-4bbd-9971-e986ed9a83de-kube-api-access-d4nxf\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:54:44.840671 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:44.840636    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb" event={"ID":"640196bc-432a-4bbd-9971-e986ed9a83de","Type":"ContainerDied","Data":"3a5fb31628a3b11fba1047125424f5909bc57c93daa17167e74fa5b89fba9936"}
May 21 01:54:44.840671 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:44.840663    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nfsxb"
May 21 01:54:44.840884 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:44.840671    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a5fb31628a3b11fba1047125424f5909bc57c93daa17167e74fa5b89fba9936"
May 21 01:54:44.842136 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:44.842110    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-qcw9p" event={"ID":"e96cf395-ac55-402d-9f2d-a16cca875874","Type":"ContainerStarted","Data":"80711766405fa7397471f86b90a9663c3eb146068ef2fd368c8f787504c55b59"}
May 21 01:54:44.842270 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:44.842171    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-qcw9p"
May 21 01:54:44.843670 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:44.843647    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f6cbd8488-xcjvc" event={"ID":"55811ffa-4427-4e2d-8282-2faa23f57c5f","Type":"ContainerStarted","Data":"426a2e76a438eb68e4832e33718714236e735761d615bdae28c6932435d7e6e8"}
May 21 01:54:44.856994 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:44.856958    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-qcw9p" podStartSLOduration=2.778001371 podStartE2EDuration="6.856942773s" podCreationTimestamp="2026-05-21 01:54:38 +0000 UTC" firstStartedPulling="2026-05-21 01:54:39.781675382 +0000 UTC m=+418.068922137" lastFinishedPulling="2026-05-21 01:54:43.860616784 +0000 UTC m=+422.147863539" observedRunningTime="2026-05-21 01:54:44.855942707 +0000 UTC m=+423.143189485" watchObservedRunningTime="2026-05-21 01:54:44.856942773 +0000 UTC m=+423.144189549"
May 21 01:54:44.870384 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:44.870335    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-f6cbd8488-xcjvc" podStartSLOduration=1.5504139609999998 podStartE2EDuration="4.870321836s" podCreationTimestamp="2026-05-21 01:54:40 +0000 UTC" firstStartedPulling="2026-05-21 01:54:40.606824685 +0000 UTC m=+418.894071439" lastFinishedPulling="2026-05-21 01:54:43.926732518 +0000 UTC m=+422.213979314" observedRunningTime="2026-05-21 01:54:44.869619212 +0000 UTC m=+423.156865989" watchObservedRunningTime="2026-05-21 01:54:44.870321836 +0000 UTC m=+423.157568615"
May 21 01:54:54.110641 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.110612    2552 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-k9rqh"
May 21 01:54:54.111023 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.110984    2552 scope.go:117] "RemoveContainer" containerID="c50cb3c00d16b3751df6d99eff518d5f231d6fe64ea719766ae2897bda52a4b5"
May 21 01:54:54.271873 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.271836    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74"]
May 21 01:54:54.272265 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.272247    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="640196bc-432a-4bbd-9971-e986ed9a83de" containerName="util"
May 21 01:54:54.272357 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.272267    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="640196bc-432a-4bbd-9971-e986ed9a83de" containerName="util"
May 21 01:54:54.272357 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.272284    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="640196bc-432a-4bbd-9971-e986ed9a83de" containerName="pull"
May 21 01:54:54.272357 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.272291    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="640196bc-432a-4bbd-9971-e986ed9a83de" containerName="pull"
May 21 01:54:54.272357 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.272304    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="640196bc-432a-4bbd-9971-e986ed9a83de" containerName="extract"
May 21 01:54:54.272357 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.272311    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="640196bc-432a-4bbd-9971-e986ed9a83de" containerName="extract"
May 21 01:54:54.272621 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.272431    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="640196bc-432a-4bbd-9971-e986ed9a83de" containerName="extract"
May 21 01:54:54.275778 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.275759    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74"
May 21 01:54:54.278810 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.278787    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 21 01:54:54.279901 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.279883    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6csb4\""
May 21 01:54:54.280002 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.279890    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 21 01:54:54.285888 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.285865    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74"]
May 21 01:54:54.388522 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.388496    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62bbf8f6-4301-491f-a58f-de78a58529da-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74\" (UID: \"62bbf8f6-4301-491f-a58f-de78a58529da\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74"
May 21 01:54:54.388634 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.388538    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62bbf8f6-4301-491f-a58f-de78a58529da-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74\" (UID: \"62bbf8f6-4301-491f-a58f-de78a58529da\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74"
May 21 01:54:54.388712 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.388697    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cskp9\" (UniqueName: \"kubernetes.io/projected/62bbf8f6-4301-491f-a58f-de78a58529da-kube-api-access-cskp9\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74\" (UID: \"62bbf8f6-4301-491f-a58f-de78a58529da\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74"
May 21 01:54:54.489869 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.489829    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62bbf8f6-4301-491f-a58f-de78a58529da-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74\" (UID: \"62bbf8f6-4301-491f-a58f-de78a58529da\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74"
May 21 01:54:54.489869 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.489863    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62bbf8f6-4301-491f-a58f-de78a58529da-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74\" (UID: \"62bbf8f6-4301-491f-a58f-de78a58529da\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74"
May 21 01:54:54.490148 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.489925    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cskp9\" (UniqueName: \"kubernetes.io/projected/62bbf8f6-4301-491f-a58f-de78a58529da-kube-api-access-cskp9\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74\" (UID: \"62bbf8f6-4301-491f-a58f-de78a58529da\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74"
May 21 01:54:54.490228 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.490207    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62bbf8f6-4301-491f-a58f-de78a58529da-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74\" (UID: \"62bbf8f6-4301-491f-a58f-de78a58529da\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74"
May 21 01:54:54.490286 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.490239    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62bbf8f6-4301-491f-a58f-de78a58529da-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74\" (UID: \"62bbf8f6-4301-491f-a58f-de78a58529da\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74"
May 21 01:54:54.498738 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.498712    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cskp9\" (UniqueName: \"kubernetes.io/projected/62bbf8f6-4301-491f-a58f-de78a58529da-kube-api-access-cskp9\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74\" (UID: \"62bbf8f6-4301-491f-a58f-de78a58529da\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74"
May 21 01:54:54.586380 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.586357    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74"
May 21 01:54:54.735090 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.735069    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74"]
May 21 01:54:54.736904 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:54:54.736874    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62bbf8f6_4301_491f_a58f_de78a58529da.slice/crio-02a49b37154a3f573d529f2e09198bdc959e90c3d53a06ba22aa4071170dbe0d WatchSource:0}: Error finding container 02a49b37154a3f573d529f2e09198bdc959e90c3d53a06ba22aa4071170dbe0d: Status 404 returned error can't find the container with id 02a49b37154a3f573d529f2e09198bdc959e90c3d53a06ba22aa4071170dbe0d
May 21 01:54:54.883188 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.883156    2552 generic.go:358] "Generic (PLEG): container finished" podID="62bbf8f6-4301-491f-a58f-de78a58529da" containerID="5e512d7c424ebb3119d605f1fad83d4ad3746f1f1163300be0e8fa743ab073d2" exitCode=0
May 21 01:54:54.883310 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.883238    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74" event={"ID":"62bbf8f6-4301-491f-a58f-de78a58529da","Type":"ContainerDied","Data":"5e512d7c424ebb3119d605f1fad83d4ad3746f1f1163300be0e8fa743ab073d2"}
May 21 01:54:54.883310 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.883273    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74" event={"ID":"62bbf8f6-4301-491f-a58f-de78a58529da","Type":"ContainerStarted","Data":"02a49b37154a3f573d529f2e09198bdc959e90c3d53a06ba22aa4071170dbe0d"}
May 21 01:54:54.885077 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.885059    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-k9rqh" event={"ID":"1460cc92-e201-416d-952c-6a40466f4289","Type":"ContainerStarted","Data":"46efbb47ef9e86ff28b6fee7e16a21a863080d381026408752136e7290fa2bf3"}
May 21 01:54:54.885258 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.885240    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-k9rqh"
May 21 01:54:54.949920 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:54.949837    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-k9rqh" podStartSLOduration=1.8107529150000001 podStartE2EDuration="21.949821138s" podCreationTimestamp="2026-05-21 01:54:33 +0000 UTC" firstStartedPulling="2026-05-21 01:54:34.241010235 +0000 UTC m=+412.528256993" lastFinishedPulling="2026-05-21 01:54:54.380078458 +0000 UTC m=+432.667325216" observedRunningTime="2026-05-21 01:54:54.947130628 +0000 UTC m=+433.234377407" watchObservedRunningTime="2026-05-21 01:54:54.949821138 +0000 UTC m=+433.237067915"
May 21 01:54:55.456468 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:55.456436    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-d8tzt"]
May 21 01:54:55.460229 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:55.460206    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-d8tzt"
May 21 01:54:55.462960 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:55.462935    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-m899x\""
May 21 01:54:55.463049 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:55.462935    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 21 01:54:55.463049 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:55.463032    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 21 01:54:55.473880 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:55.473859    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-d8tzt"]
May 21 01:54:55.497968 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:55.497946    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/1ed1e9ae-51f0-4747-b5f1-1238fce60170-operator-config\") pod \"servicemesh-operator3-55f49c5f94-d8tzt\" (UID: \"1ed1e9ae-51f0-4747-b5f1-1238fce60170\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-d8tzt"
May 21 01:54:55.498076 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:55.497975    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44jkk\" (UniqueName: \"kubernetes.io/projected/1ed1e9ae-51f0-4747-b5f1-1238fce60170-kube-api-access-44jkk\") pod \"servicemesh-operator3-55f49c5f94-d8tzt\" (UID: \"1ed1e9ae-51f0-4747-b5f1-1238fce60170\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-d8tzt"
May 21 01:54:55.599513 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:55.599422    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/1ed1e9ae-51f0-4747-b5f1-1238fce60170-operator-config\") pod \"servicemesh-operator3-55f49c5f94-d8tzt\" (UID: \"1ed1e9ae-51f0-4747-b5f1-1238fce60170\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-d8tzt"
May 21 01:54:55.599687 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:55.599616    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-44jkk\" (UniqueName: \"kubernetes.io/projected/1ed1e9ae-51f0-4747-b5f1-1238fce60170-kube-api-access-44jkk\") pod \"servicemesh-operator3-55f49c5f94-d8tzt\" (UID: \"1ed1e9ae-51f0-4747-b5f1-1238fce60170\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-d8tzt"
May 21 01:54:55.602421 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:55.602392    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/1ed1e9ae-51f0-4747-b5f1-1238fce60170-operator-config\") pod \"servicemesh-operator3-55f49c5f94-d8tzt\" (UID: \"1ed1e9ae-51f0-4747-b5f1-1238fce60170\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-d8tzt"
May 21 01:54:55.611790 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:55.611765    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44jkk\" (UniqueName: \"kubernetes.io/projected/1ed1e9ae-51f0-4747-b5f1-1238fce60170-kube-api-access-44jkk\") pod \"servicemesh-operator3-55f49c5f94-d8tzt\" (UID: \"1ed1e9ae-51f0-4747-b5f1-1238fce60170\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-d8tzt"
May 21 01:54:55.770162 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:55.770136    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-d8tzt"
May 21 01:54:55.891163 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:55.891128    2552 generic.go:358] "Generic (PLEG): container finished" podID="62bbf8f6-4301-491f-a58f-de78a58529da" containerID="fb86eb3754ad1bcadf1c6fa5b84769a663746c003842556d880176c024730b79" exitCode=0
May 21 01:54:55.891301 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:55.891208    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74" event={"ID":"62bbf8f6-4301-491f-a58f-de78a58529da","Type":"ContainerDied","Data":"fb86eb3754ad1bcadf1c6fa5b84769a663746c003842556d880176c024730b79"}
May 21 01:54:55.911302 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:55.911280    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-d8tzt"]
May 21 01:54:55.922343 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:54:55.922319    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ed1e9ae_51f0_4747_b5f1_1238fce60170.slice/crio-19535f6d6a03b89e4477ecb0cc7716e23bb6e0007ec9a6d1851c9438f3b9eff6 WatchSource:0}: Error finding container 19535f6d6a03b89e4477ecb0cc7716e23bb6e0007ec9a6d1851c9438f3b9eff6: Status 404 returned error can't find the container with id 19535f6d6a03b89e4477ecb0cc7716e23bb6e0007ec9a6d1851c9438f3b9eff6
May 21 01:54:56.896740 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:56.896688    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-d8tzt" event={"ID":"1ed1e9ae-51f0-4747-b5f1-1238fce60170","Type":"ContainerStarted","Data":"19535f6d6a03b89e4477ecb0cc7716e23bb6e0007ec9a6d1851c9438f3b9eff6"}
May 21 01:54:56.898788 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:56.898766    2552 generic.go:358] "Generic (PLEG): container finished" podID="62bbf8f6-4301-491f-a58f-de78a58529da" containerID="890bb8d0b6e6d34cc8d9389589d7e63a028a7db3740e90af57e7c0a86950b2e7" exitCode=0
May 21 01:54:56.898913 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:56.898830    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74" event={"ID":"62bbf8f6-4301-491f-a58f-de78a58529da","Type":"ContainerDied","Data":"890bb8d0b6e6d34cc8d9389589d7e63a028a7db3740e90af57e7c0a86950b2e7"}
May 21 01:54:58.058183 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:58.058159    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74"
May 21 01:54:58.121400 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:58.121365    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62bbf8f6-4301-491f-a58f-de78a58529da-util\") pod \"62bbf8f6-4301-491f-a58f-de78a58529da\" (UID: \"62bbf8f6-4301-491f-a58f-de78a58529da\") "
May 21 01:54:58.121599 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:58.121449    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62bbf8f6-4301-491f-a58f-de78a58529da-bundle\") pod \"62bbf8f6-4301-491f-a58f-de78a58529da\" (UID: \"62bbf8f6-4301-491f-a58f-de78a58529da\") "
May 21 01:54:58.121599 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:58.121494    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cskp9\" (UniqueName: \"kubernetes.io/projected/62bbf8f6-4301-491f-a58f-de78a58529da-kube-api-access-cskp9\") pod \"62bbf8f6-4301-491f-a58f-de78a58529da\" (UID: \"62bbf8f6-4301-491f-a58f-de78a58529da\") "
May 21 01:54:58.122585 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:58.122534    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62bbf8f6-4301-491f-a58f-de78a58529da-bundle" (OuterVolumeSpecName: "bundle") pod "62bbf8f6-4301-491f-a58f-de78a58529da" (UID: "62bbf8f6-4301-491f-a58f-de78a58529da"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:54:58.124246 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:58.124210    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62bbf8f6-4301-491f-a58f-de78a58529da-kube-api-access-cskp9" (OuterVolumeSpecName: "kube-api-access-cskp9") pod "62bbf8f6-4301-491f-a58f-de78a58529da" (UID: "62bbf8f6-4301-491f-a58f-de78a58529da"). InnerVolumeSpecName "kube-api-access-cskp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:54:58.127758 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:58.127733    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62bbf8f6-4301-491f-a58f-de78a58529da-util" (OuterVolumeSpecName: "util") pod "62bbf8f6-4301-491f-a58f-de78a58529da" (UID: "62bbf8f6-4301-491f-a58f-de78a58529da"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:54:58.222742 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:58.222658    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62bbf8f6-4301-491f-a58f-de78a58529da-util\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:54:58.222742 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:58.222694    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62bbf8f6-4301-491f-a58f-de78a58529da-bundle\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:54:58.222742 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:58.222710    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cskp9\" (UniqueName: \"kubernetes.io/projected/62bbf8f6-4301-491f-a58f-de78a58529da-kube-api-access-cskp9\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:54:58.909902 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:58.909852    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74" event={"ID":"62bbf8f6-4301-491f-a58f-de78a58529da","Type":"ContainerDied","Data":"02a49b37154a3f573d529f2e09198bdc959e90c3d53a06ba22aa4071170dbe0d"}
May 21 01:54:58.909902 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:58.909892    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apfw74"
May 21 01:54:58.910127 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:58.909895    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02a49b37154a3f573d529f2e09198bdc959e90c3d53a06ba22aa4071170dbe0d"
May 21 01:54:59.918202 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:59.918166    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-d8tzt" event={"ID":"1ed1e9ae-51f0-4747-b5f1-1238fce60170","Type":"ContainerStarted","Data":"28259ddc07254d91ad72781c50d628907a1d80f0bc3610246e49ead99efdbe2a"}
May 21 01:54:59.918601 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:59.918252    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-d8tzt"
May 21 01:54:59.939677 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:54:59.939628    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-d8tzt" podStartSLOduration=1.822949154 podStartE2EDuration="4.939616524s" podCreationTimestamp="2026-05-21 01:54:55 +0000 UTC" firstStartedPulling="2026-05-21 01:54:55.928242702 +0000 UTC m=+434.215489472" lastFinishedPulling="2026-05-21 01:54:59.044910084 +0000 UTC m=+437.332156842" observedRunningTime="2026-05-21 01:54:59.937036524 +0000 UTC m=+438.224283314" watchObservedRunningTime="2026-05-21 01:54:59.939616524 +0000 UTC m=+438.226863300"
May 21 01:55:05.893791 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:05.893763    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-k9rqh"
May 21 01:55:10.925181 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:10.925150    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-d8tzt"
May 21 01:55:10.940675 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:10.940644    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"]
May 21 01:55:10.940993 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:10.940981    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62bbf8f6-4301-491f-a58f-de78a58529da" containerName="pull"
May 21 01:55:10.941033 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:10.940994    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="62bbf8f6-4301-491f-a58f-de78a58529da" containerName="pull"
May 21 01:55:10.941033 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:10.941010    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62bbf8f6-4301-491f-a58f-de78a58529da" containerName="extract"
May 21 01:55:10.941033 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:10.941016    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="62bbf8f6-4301-491f-a58f-de78a58529da" containerName="extract"
May 21 01:55:10.941033 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:10.941026    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62bbf8f6-4301-491f-a58f-de78a58529da" containerName="util"
May 21 01:55:10.941033 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:10.941031    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="62bbf8f6-4301-491f-a58f-de78a58529da" containerName="util"
May 21 01:55:10.941193 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:10.941090    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="62bbf8f6-4301-491f-a58f-de78a58529da" containerName="extract"
May 21 01:55:10.949019 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:10.948992    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"
May 21 01:55:10.951801 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:10.951609    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 21 01:55:10.951925 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:10.951815    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 21 01:55:10.952108 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:10.952088    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xgb4f\""
May 21 01:55:10.952253 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:10.952092    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 21 01:55:10.952368 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:10.952268    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 21 01:55:10.954286 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:10.954259    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"]
May 21 01:55:11.026941 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:11.026912    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1b1df4eb-c8e3-42c9-8f8b-bc68e1773158-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-2bzjc\" (UID: \"1b1df4eb-c8e3-42c9-8f8b-bc68e1773158\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"
May 21 01:55:11.027109 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:11.026946    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b1df4eb-c8e3-42c9-8f8b-bc68e1773158-istio-token\") pod \"istiod-openshift-gateway-798958bb55-2bzjc\" (UID: \"1b1df4eb-c8e3-42c9-8f8b-bc68e1773158\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"
May 21 01:55:11.027109 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:11.026968    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1b1df4eb-c8e3-42c9-8f8b-bc68e1773158-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-2bzjc\" (UID: \"1b1df4eb-c8e3-42c9-8f8b-bc68e1773158\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"
May 21 01:55:11.027109 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:11.026992    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26nxg\" (UniqueName: \"kubernetes.io/projected/1b1df4eb-c8e3-42c9-8f8b-bc68e1773158-kube-api-access-26nxg\") pod \"istiod-openshift-gateway-798958bb55-2bzjc\" (UID: \"1b1df4eb-c8e3-42c9-8f8b-bc68e1773158\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"
May 21 01:55:11.027109 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:11.027042    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b1df4eb-c8e3-42c9-8f8b-bc68e1773158-local-certs\") pod \"istiod-openshift-gateway-798958bb55-2bzjc\" (UID: \"1b1df4eb-c8e3-42c9-8f8b-bc68e1773158\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"
May 21 01:55:11.027291 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:11.027119    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1b1df4eb-c8e3-42c9-8f8b-bc68e1773158-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-2bzjc\" (UID: \"1b1df4eb-c8e3-42c9-8f8b-bc68e1773158\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"
May 21 01:55:11.027291 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:11.027217    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1b1df4eb-c8e3-42c9-8f8b-bc68e1773158-cacerts\") pod \"istiod-openshift-gateway-798958bb55-2bzjc\" (UID: \"1b1df4eb-c8e3-42c9-8f8b-bc68e1773158\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"
May 21 01:55:11.128293 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:11.128261    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b1df4eb-c8e3-42c9-8f8b-bc68e1773158-local-certs\") pod \"istiod-openshift-gateway-798958bb55-2bzjc\" (UID: \"1b1df4eb-c8e3-42c9-8f8b-bc68e1773158\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"
May 21 01:55:11.128450 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:11.128316    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1b1df4eb-c8e3-42c9-8f8b-bc68e1773158-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-2bzjc\" (UID: \"1b1df4eb-c8e3-42c9-8f8b-bc68e1773158\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"
May 21 01:55:11.128450 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:11.128353    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1b1df4eb-c8e3-42c9-8f8b-bc68e1773158-cacerts\") pod \"istiod-openshift-gateway-798958bb55-2bzjc\" (UID: \"1b1df4eb-c8e3-42c9-8f8b-bc68e1773158\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"
May 21 01:55:11.128450 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:11.128398    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1b1df4eb-c8e3-42c9-8f8b-bc68e1773158-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-2bzjc\" (UID: \"1b1df4eb-c8e3-42c9-8f8b-bc68e1773158\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"
May 21 01:55:11.128450 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:11.128425    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b1df4eb-c8e3-42c9-8f8b-bc68e1773158-istio-token\") pod \"istiod-openshift-gateway-798958bb55-2bzjc\" (UID: \"1b1df4eb-c8e3-42c9-8f8b-bc68e1773158\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"
May 21 01:55:11.128700 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:11.128451    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1b1df4eb-c8e3-42c9-8f8b-bc68e1773158-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-2bzjc\" (UID: \"1b1df4eb-c8e3-42c9-8f8b-bc68e1773158\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"
May 21 01:55:11.128700 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:11.128491    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-26nxg\" (UniqueName: \"kubernetes.io/projected/1b1df4eb-c8e3-42c9-8f8b-bc68e1773158-kube-api-access-26nxg\") pod \"istiod-openshift-gateway-798958bb55-2bzjc\" (UID: \"1b1df4eb-c8e3-42c9-8f8b-bc68e1773158\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"
May 21 01:55:11.129278 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:11.129248    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1b1df4eb-c8e3-42c9-8f8b-bc68e1773158-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-2bzjc\" (UID: \"1b1df4eb-c8e3-42c9-8f8b-bc68e1773158\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"
May 21 01:55:11.130583 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:11.130538    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b1df4eb-c8e3-42c9-8f8b-bc68e1773158-local-certs\") pod \"istiod-openshift-gateway-798958bb55-2bzjc\" (UID: \"1b1df4eb-c8e3-42c9-8f8b-bc68e1773158\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"
May 21 01:55:11.130884 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:11.130864    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1b1df4eb-c8e3-42c9-8f8b-bc68e1773158-cacerts\") pod \"istiod-openshift-gateway-798958bb55-2bzjc\" (UID: \"1b1df4eb-c8e3-42c9-8f8b-bc68e1773158\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"
May 21 01:55:11.131057 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:11.131042    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1b1df4eb-c8e3-42c9-8f8b-bc68e1773158-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-2bzjc\" (UID: \"1b1df4eb-c8e3-42c9-8f8b-bc68e1773158\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"
May 21 01:55:11.131164 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:11.131144    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1b1df4eb-c8e3-42c9-8f8b-bc68e1773158-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-2bzjc\" (UID: \"1b1df4eb-c8e3-42c9-8f8b-bc68e1773158\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"
May 21 01:55:11.137379 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:11.137353    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26nxg\" (UniqueName: \"kubernetes.io/projected/1b1df4eb-c8e3-42c9-8f8b-bc68e1773158-kube-api-access-26nxg\") pod \"istiod-openshift-gateway-798958bb55-2bzjc\" (UID: \"1b1df4eb-c8e3-42c9-8f8b-bc68e1773158\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"
May 21 01:55:11.137535 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:11.137513    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b1df4eb-c8e3-42c9-8f8b-bc68e1773158-istio-token\") pod \"istiod-openshift-gateway-798958bb55-2bzjc\" (UID: \"1b1df4eb-c8e3-42c9-8f8b-bc68e1773158\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"
May 21 01:55:11.264762 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:11.264733    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"
May 21 01:55:11.434924 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:11.434902    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"]
May 21 01:55:11.437309 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:55:11.437281    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b1df4eb_c8e3_42c9_8f8b_bc68e1773158.slice/crio-093d0609a22c7855a7110c3c7c858c2b56f9cb929599b066e3be8d1a4f225880 WatchSource:0}: Error finding container 093d0609a22c7855a7110c3c7c858c2b56f9cb929599b066e3be8d1a4f225880: Status 404 returned error can't find the container with id 093d0609a22c7855a7110c3c7c858c2b56f9cb929599b066e3be8d1a4f225880
May 21 01:55:11.967247 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:11.967206    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc" event={"ID":"1b1df4eb-c8e3-42c9-8f8b-bc68e1773158","Type":"ContainerStarted","Data":"093d0609a22c7855a7110c3c7c858c2b56f9cb929599b066e3be8d1a4f225880"}
May 21 01:55:15.329652 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:15.329610    2552 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
May 21 01:55:15.329926 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:15.329681    2552 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
May 21 01:55:15.853764 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:15.853738    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-qcw9p"
May 21 01:55:15.986987 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:15.986949    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc" event={"ID":"1b1df4eb-c8e3-42c9-8f8b-bc68e1773158","Type":"ContainerStarted","Data":"11c18eccd2931cf4766ef1522157bf1529ad5d8cd9ed60da8e040c350be21c6a"}
May 21 01:55:15.987151 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:15.987003    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"
May 21 01:55:16.005691 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:16.005635    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc" podStartSLOduration=2.116233952 podStartE2EDuration="6.005617059s" podCreationTimestamp="2026-05-21 01:55:10 +0000 UTC" firstStartedPulling="2026-05-21 01:55:11.439980065 +0000 UTC m=+449.727226821" lastFinishedPulling="2026-05-21 01:55:15.329363173 +0000 UTC m=+453.616609928" observedRunningTime="2026-05-21 01:55:16.00276576 +0000 UTC m=+454.290012527" watchObservedRunningTime="2026-05-21 01:55:16.005617059 +0000 UTC m=+454.292863837"
May 21 01:55:16.992704 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:16.992671    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2bzjc"
May 21 01:55:45.245331 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:45.245293    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf"]
May 21 01:55:45.257653 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:45.257627    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf"]
May 21 01:55:45.257800 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:45.257735    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf"
May 21 01:55:45.260360 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:45.260331    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 01:55:45.260496 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:45.260399    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 01:55:45.261623 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:45.261603    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5cvtl\""
May 21 01:55:45.303435 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:45.303410    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd68ef76-4a7e-43a1-86cd-4d4b159f520d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf\" (UID: \"cd68ef76-4a7e-43a1-86cd-4d4b159f520d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf"
May 21 01:55:45.303571 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:45.303449    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv6pv\" (UniqueName: \"kubernetes.io/projected/cd68ef76-4a7e-43a1-86cd-4d4b159f520d-kube-api-access-gv6pv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf\" (UID: \"cd68ef76-4a7e-43a1-86cd-4d4b159f520d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf"
May 21 01:55:45.303571 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:45.303470    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd68ef76-4a7e-43a1-86cd-4d4b159f520d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf\" (UID: \"cd68ef76-4a7e-43a1-86cd-4d4b159f520d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf"
May 21 01:55:45.403885 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:45.403860    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd68ef76-4a7e-43a1-86cd-4d4b159f520d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf\" (UID: \"cd68ef76-4a7e-43a1-86cd-4d4b159f520d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf"
May 21 01:55:45.403992 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:45.403901    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gv6pv\" (UniqueName: \"kubernetes.io/projected/cd68ef76-4a7e-43a1-86cd-4d4b159f520d-kube-api-access-gv6pv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf\" (UID: \"cd68ef76-4a7e-43a1-86cd-4d4b159f520d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf"
May 21 01:55:45.403992 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:45.403929    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd68ef76-4a7e-43a1-86cd-4d4b159f520d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf\" (UID: \"cd68ef76-4a7e-43a1-86cd-4d4b159f520d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf"
May 21 01:55:45.404229 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:45.404212    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd68ef76-4a7e-43a1-86cd-4d4b159f520d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf\" (UID: \"cd68ef76-4a7e-43a1-86cd-4d4b159f520d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf"
May 21 01:55:45.404273 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:45.404245    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd68ef76-4a7e-43a1-86cd-4d4b159f520d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf\" (UID: \"cd68ef76-4a7e-43a1-86cd-4d4b159f520d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf"
May 21 01:55:45.410994 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:45.410969    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv6pv\" (UniqueName: \"kubernetes.io/projected/cd68ef76-4a7e-43a1-86cd-4d4b159f520d-kube-api-access-gv6pv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf\" (UID: \"cd68ef76-4a7e-43a1-86cd-4d4b159f520d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf"
May 21 01:55:45.567400 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:45.567342    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf"
May 21 01:55:45.698473 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:45.698449    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf"]
May 21 01:55:45.699934 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:55:45.699906    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd68ef76_4a7e_43a1_86cd_4d4b159f520d.slice/crio-385d45386d8d4a2df562f43b432481a4a6ad1ff56cfed2d3ea288905433f0ffd WatchSource:0}: Error finding container 385d45386d8d4a2df562f43b432481a4a6ad1ff56cfed2d3ea288905433f0ffd: Status 404 returned error can't find the container with id 385d45386d8d4a2df562f43b432481a4a6ad1ff56cfed2d3ea288905433f0ffd
May 21 01:55:45.845824 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:45.845769    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46"]
May 21 01:55:45.849628 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:45.849607    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46"
May 21 01:55:45.855582 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:45.855539    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46"]
May 21 01:55:45.908564 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:45.908522    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/033a590b-7c99-4331-9389-da559b7e21e8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46\" (UID: \"033a590b-7c99-4331-9389-da559b7e21e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46"
May 21 01:55:45.908677 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:45.908595    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/033a590b-7c99-4331-9389-da559b7e21e8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46\" (UID: \"033a590b-7c99-4331-9389-da559b7e21e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46"
May 21 01:55:45.908677 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:45.908636    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpgls\" (UniqueName: \"kubernetes.io/projected/033a590b-7c99-4331-9389-da559b7e21e8-kube-api-access-fpgls\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46\" (UID: \"033a590b-7c99-4331-9389-da559b7e21e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46"
May 21 01:55:46.009516 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:46.009491    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/033a590b-7c99-4331-9389-da559b7e21e8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46\" (UID: \"033a590b-7c99-4331-9389-da559b7e21e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46"
May 21 01:55:46.009658 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:46.009562    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/033a590b-7c99-4331-9389-da559b7e21e8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46\" (UID: \"033a590b-7c99-4331-9389-da559b7e21e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46"
May 21 01:55:46.009658 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:46.009630    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fpgls\" (UniqueName: \"kubernetes.io/projected/033a590b-7c99-4331-9389-da559b7e21e8-kube-api-access-fpgls\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46\" (UID: \"033a590b-7c99-4331-9389-da559b7e21e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46"
May 21 01:55:46.009864 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:46.009845    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/033a590b-7c99-4331-9389-da559b7e21e8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46\" (UID: \"033a590b-7c99-4331-9389-da559b7e21e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46"
May 21 01:55:46.009941 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:46.009903    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/033a590b-7c99-4331-9389-da559b7e21e8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46\" (UID: \"033a590b-7c99-4331-9389-da559b7e21e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46"
May 21 01:55:46.017226 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:46.017204    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpgls\" (UniqueName: \"kubernetes.io/projected/033a590b-7c99-4331-9389-da559b7e21e8-kube-api-access-fpgls\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46\" (UID: \"033a590b-7c99-4331-9389-da559b7e21e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46"
May 21 01:55:46.108427 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:46.108352    2552 generic.go:358] "Generic (PLEG): container finished" podID="cd68ef76-4a7e-43a1-86cd-4d4b159f520d" containerID="d7ee7d3493bd4aad39a2f20fbd0dc4bb19d92b48768ce9e9da96076af4b6f432" exitCode=0
May 21 01:55:46.108427 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:46.108387    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf" event={"ID":"cd68ef76-4a7e-43a1-86cd-4d4b159f520d","Type":"ContainerDied","Data":"d7ee7d3493bd4aad39a2f20fbd0dc4bb19d92b48768ce9e9da96076af4b6f432"}
May 21 01:55:46.108427 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:46.108421    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf" event={"ID":"cd68ef76-4a7e-43a1-86cd-4d4b159f520d","Type":"ContainerStarted","Data":"385d45386d8d4a2df562f43b432481a4a6ad1ff56cfed2d3ea288905433f0ffd"}
May 21 01:55:46.177158 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:46.177137    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46"
May 21 01:55:46.305893 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:46.305868    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46"]
May 21 01:55:46.306847 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:55:46.306819    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod033a590b_7c99_4331_9389_da559b7e21e8.slice/crio-2f6c7ab662a89e047f2016dcf9388494c184faca214c0bbda43d86da35348821 WatchSource:0}: Error finding container 2f6c7ab662a89e047f2016dcf9388494c184faca214c0bbda43d86da35348821: Status 404 returned error can't find the container with id 2f6c7ab662a89e047f2016dcf9388494c184faca214c0bbda43d86da35348821
May 21 01:55:46.449104 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:46.449074    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc"]
May 21 01:55:46.462080 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:46.462014    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc"]
May 21 01:55:46.462194 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:46.462114    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc"
May 21 01:55:46.515226 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:46.515197    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc23f2c2-13f7-4c4a-a055-ead09b9252eb-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc\" (UID: \"fc23f2c2-13f7-4c4a-a055-ead09b9252eb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc"
May 21 01:55:46.515345 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:46.515280    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc23f2c2-13f7-4c4a-a055-ead09b9252eb-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc\" (UID: \"fc23f2c2-13f7-4c4a-a055-ead09b9252eb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc"
May 21 01:55:46.515405 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:46.515341    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhx7k\" (UniqueName: \"kubernetes.io/projected/fc23f2c2-13f7-4c4a-a055-ead09b9252eb-kube-api-access-hhx7k\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc\" (UID: \"fc23f2c2-13f7-4c4a-a055-ead09b9252eb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc"
May 21 01:55:46.616219 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:46.616159    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc23f2c2-13f7-4c4a-a055-ead09b9252eb-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc\" (UID: \"fc23f2c2-13f7-4c4a-a055-ead09b9252eb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc"
May 21 01:55:46.616219 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:46.616217    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hhx7k\" (UniqueName: \"kubernetes.io/projected/fc23f2c2-13f7-4c4a-a055-ead09b9252eb-kube-api-access-hhx7k\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc\" (UID: \"fc23f2c2-13f7-4c4a-a055-ead09b9252eb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc"
May 21 01:55:46.616435 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:46.616268    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc23f2c2-13f7-4c4a-a055-ead09b9252eb-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc\" (UID: \"fc23f2c2-13f7-4c4a-a055-ead09b9252eb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc"
May 21 01:55:46.616639 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:46.616608    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc23f2c2-13f7-4c4a-a055-ead09b9252eb-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc\" (UID: \"fc23f2c2-13f7-4c4a-a055-ead09b9252eb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc"
May 21 01:55:46.616639 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:46.616609    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc23f2c2-13f7-4c4a-a055-ead09b9252eb-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc\" (UID: \"fc23f2c2-13f7-4c4a-a055-ead09b9252eb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc"
May 21 01:55:46.623774 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:46.623750    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhx7k\" (UniqueName: \"kubernetes.io/projected/fc23f2c2-13f7-4c4a-a055-ead09b9252eb-kube-api-access-hhx7k\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc\" (UID: \"fc23f2c2-13f7-4c4a-a055-ead09b9252eb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc"
May 21 01:55:46.773237 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:46.773206    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc"
May 21 01:55:46.920048 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:46.920026    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc"]
May 21 01:55:46.943315 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:55:46.943287    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc23f2c2_13f7_4c4a_a055_ead09b9252eb.slice/crio-23c77f688872ff4c60c70e05e62c36a4c6028a8ad44ad535169b62351a099569 WatchSource:0}: Error finding container 23c77f688872ff4c60c70e05e62c36a4c6028a8ad44ad535169b62351a099569: Status 404 returned error can't find the container with id 23c77f688872ff4c60c70e05e62c36a4c6028a8ad44ad535169b62351a099569
May 21 01:55:47.057078 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:47.057052    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp"]
May 21 01:55:47.060706 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:47.060687    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp"
May 21 01:55:47.067078 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:47.067056    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp"]
May 21 01:55:47.119687 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:47.119627    2552 generic.go:358] "Generic (PLEG): container finished" podID="fc23f2c2-13f7-4c4a-a055-ead09b9252eb" containerID="4c9a56c1d5dd5b748a3f81cf7c24ad3d01fb78ce4bf238ef07974e25ea5a2c72" exitCode=0
May 21 01:55:47.119811 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:47.119706    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc" event={"ID":"fc23f2c2-13f7-4c4a-a055-ead09b9252eb","Type":"ContainerDied","Data":"4c9a56c1d5dd5b748a3f81cf7c24ad3d01fb78ce4bf238ef07974e25ea5a2c72"}
May 21 01:55:47.119811 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:47.119738    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc" event={"ID":"fc23f2c2-13f7-4c4a-a055-ead09b9252eb","Type":"ContainerStarted","Data":"23c77f688872ff4c60c70e05e62c36a4c6028a8ad44ad535169b62351a099569"}
May 21 01:55:47.120630 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:47.120491    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk5p7\" (UniqueName: \"kubernetes.io/projected/8dee67b1-02f2-441d-9c78-2c6eec920608-kube-api-access-mk5p7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp\" (UID: \"8dee67b1-02f2-441d-9c78-2c6eec920608\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp"
May 21 01:55:47.120630 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:47.120528    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8dee67b1-02f2-441d-9c78-2c6eec920608-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp\" (UID: \"8dee67b1-02f2-441d-9c78-2c6eec920608\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp"
May 21 01:55:47.120630 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:47.120576    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8dee67b1-02f2-441d-9c78-2c6eec920608-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp\" (UID: \"8dee67b1-02f2-441d-9c78-2c6eec920608\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp"
May 21 01:55:47.121528 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:47.121508    2552 generic.go:358] "Generic (PLEG): container finished" podID="cd68ef76-4a7e-43a1-86cd-4d4b159f520d" containerID="f7d1acc6969086c6cb00f172d82ccd6663343d757a0205de43119e6d533da96f" exitCode=0
May 21 01:55:47.121624 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:47.121576    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf" event={"ID":"cd68ef76-4a7e-43a1-86cd-4d4b159f520d","Type":"ContainerDied","Data":"f7d1acc6969086c6cb00f172d82ccd6663343d757a0205de43119e6d533da96f"}
May 21 01:55:47.123624 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:47.123603    2552 generic.go:358] "Generic (PLEG): container finished" podID="033a590b-7c99-4331-9389-da559b7e21e8" containerID="d35679075c08190c1205f0f7c2ccba8831caf5a6cb91e8e900864f6d6bde5bca" exitCode=0
May 21 01:55:47.123741 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:47.123722    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46" event={"ID":"033a590b-7c99-4331-9389-da559b7e21e8","Type":"ContainerDied","Data":"d35679075c08190c1205f0f7c2ccba8831caf5a6cb91e8e900864f6d6bde5bca"}
May 21 01:55:47.123855 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:47.123760    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46" event={"ID":"033a590b-7c99-4331-9389-da559b7e21e8","Type":"ContainerStarted","Data":"2f6c7ab662a89e047f2016dcf9388494c184faca214c0bbda43d86da35348821"}
May 21 01:55:47.221992 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:47.221963    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mk5p7\" (UniqueName: \"kubernetes.io/projected/8dee67b1-02f2-441d-9c78-2c6eec920608-kube-api-access-mk5p7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp\" (UID: \"8dee67b1-02f2-441d-9c78-2c6eec920608\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp"
May 21 01:55:47.222126 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:47.222026    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8dee67b1-02f2-441d-9c78-2c6eec920608-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp\" (UID: \"8dee67b1-02f2-441d-9c78-2c6eec920608\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp"
May 21 01:55:47.222126 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:47.222047    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8dee67b1-02f2-441d-9c78-2c6eec920608-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp\" (UID: \"8dee67b1-02f2-441d-9c78-2c6eec920608\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp"
May 21 01:55:47.222437 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:47.222414    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8dee67b1-02f2-441d-9c78-2c6eec920608-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp\" (UID: \"8dee67b1-02f2-441d-9c78-2c6eec920608\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp"
May 21 01:55:47.222487 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:47.222443    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8dee67b1-02f2-441d-9c78-2c6eec920608-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp\" (UID: \"8dee67b1-02f2-441d-9c78-2c6eec920608\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp"
May 21 01:55:47.232018 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:47.231990    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk5p7\" (UniqueName: \"kubernetes.io/projected/8dee67b1-02f2-441d-9c78-2c6eec920608-kube-api-access-mk5p7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp\" (UID: \"8dee67b1-02f2-441d-9c78-2c6eec920608\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp"
May 21 01:55:47.408068 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:47.407990    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp"
May 21 01:55:47.544560 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:47.544521    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp"]
May 21 01:55:47.546315 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:55:47.546285    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dee67b1_02f2_441d_9c78_2c6eec920608.slice/crio-9511ddc6f791bc0f5a0b51896d6c2d9aed8929834ee7e67b3fd76c0c6ebc1282 WatchSource:0}: Error finding container 9511ddc6f791bc0f5a0b51896d6c2d9aed8929834ee7e67b3fd76c0c6ebc1282: Status 404 returned error can't find the container with id 9511ddc6f791bc0f5a0b51896d6c2d9aed8929834ee7e67b3fd76c0c6ebc1282
May 21 01:55:48.129509 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:48.129485    2552 generic.go:358] "Generic (PLEG): container finished" podID="fc23f2c2-13f7-4c4a-a055-ead09b9252eb" containerID="e330c9f346b01b2e8de043273f35bcdb63a8b7b0ce9ff1ea130377d2f233e1ae" exitCode=0
May 21 01:55:48.129615 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:48.129591    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc" event={"ID":"fc23f2c2-13f7-4c4a-a055-ead09b9252eb","Type":"ContainerDied","Data":"e330c9f346b01b2e8de043273f35bcdb63a8b7b0ce9ff1ea130377d2f233e1ae"}
May 21 01:55:48.131424 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:48.131402    2552 generic.go:358] "Generic (PLEG): container finished" podID="cd68ef76-4a7e-43a1-86cd-4d4b159f520d" containerID="95f288ca1a9e61348ec32c016ccc86b91ba16cd30f9077835316b15daa637018" exitCode=0
May 21 01:55:48.131514 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:48.131460    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf" event={"ID":"cd68ef76-4a7e-43a1-86cd-4d4b159f520d","Type":"ContainerDied","Data":"95f288ca1a9e61348ec32c016ccc86b91ba16cd30f9077835316b15daa637018"}
May 21 01:55:48.132675 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:48.132656    2552 generic.go:358] "Generic (PLEG): container finished" podID="8dee67b1-02f2-441d-9c78-2c6eec920608" containerID="f25b0bfe3a132606fe2b2596b07907ca2f4fdb9915c3b71e3ead58291530c0d9" exitCode=0
May 21 01:55:48.132768 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:48.132729    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp" event={"ID":"8dee67b1-02f2-441d-9c78-2c6eec920608","Type":"ContainerDied","Data":"f25b0bfe3a132606fe2b2596b07907ca2f4fdb9915c3b71e3ead58291530c0d9"}
May 21 01:55:48.132768 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:48.132752    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp" event={"ID":"8dee67b1-02f2-441d-9c78-2c6eec920608","Type":"ContainerStarted","Data":"9511ddc6f791bc0f5a0b51896d6c2d9aed8929834ee7e67b3fd76c0c6ebc1282"}
May 21 01:55:48.134407 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:48.134386    2552 generic.go:358] "Generic (PLEG): container finished" podID="033a590b-7c99-4331-9389-da559b7e21e8" containerID="5f30dd9acec7c2e369cf2c5e8691ce500de58aadafcb923d4e393d4526a29bec" exitCode=0
May 21 01:55:48.134494 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:48.134412    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46" event={"ID":"033a590b-7c99-4331-9389-da559b7e21e8","Type":"ContainerDied","Data":"5f30dd9acec7c2e369cf2c5e8691ce500de58aadafcb923d4e393d4526a29bec"}
May 21 01:55:49.140538 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:49.140511    2552 generic.go:358] "Generic (PLEG): container finished" podID="fc23f2c2-13f7-4c4a-a055-ead09b9252eb" containerID="4826060badc60ee7ecd71908647caf94a4a8d9db005bcf5c539a79ea18aa9c02" exitCode=0
May 21 01:55:49.140872 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:49.140598    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc" event={"ID":"fc23f2c2-13f7-4c4a-a055-ead09b9252eb","Type":"ContainerDied","Data":"4826060badc60ee7ecd71908647caf94a4a8d9db005bcf5c539a79ea18aa9c02"}
May 21 01:55:49.142336 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:49.142315    2552 generic.go:358] "Generic (PLEG): container finished" podID="8dee67b1-02f2-441d-9c78-2c6eec920608" containerID="f8749333c8d7eb2ae50eb8afeb3906630995f9b6b26a089032e715effe7fce0c" exitCode=0
May 21 01:55:49.142437 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:49.142394    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp" event={"ID":"8dee67b1-02f2-441d-9c78-2c6eec920608","Type":"ContainerDied","Data":"f8749333c8d7eb2ae50eb8afeb3906630995f9b6b26a089032e715effe7fce0c"}
May 21 01:55:49.144248 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:49.144225    2552 generic.go:358] "Generic (PLEG): container finished" podID="033a590b-7c99-4331-9389-da559b7e21e8" containerID="a4eb3226542a4638861445b1ca6fbda59fe35e8799129d304325b21bd927df72" exitCode=0
May 21 01:55:49.144354 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:49.144252    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46" event={"ID":"033a590b-7c99-4331-9389-da559b7e21e8","Type":"ContainerDied","Data":"a4eb3226542a4638861445b1ca6fbda59fe35e8799129d304325b21bd927df72"}
May 21 01:55:49.270332 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:49.270311    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf"
May 21 01:55:49.343370 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:49.343344    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd68ef76-4a7e-43a1-86cd-4d4b159f520d-bundle\") pod \"cd68ef76-4a7e-43a1-86cd-4d4b159f520d\" (UID: \"cd68ef76-4a7e-43a1-86cd-4d4b159f520d\") "
May 21 01:55:49.343507 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:49.343395    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd68ef76-4a7e-43a1-86cd-4d4b159f520d-util\") pod \"cd68ef76-4a7e-43a1-86cd-4d4b159f520d\" (UID: \"cd68ef76-4a7e-43a1-86cd-4d4b159f520d\") "
May 21 01:55:49.343507 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:49.343423    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gv6pv\" (UniqueName: \"kubernetes.io/projected/cd68ef76-4a7e-43a1-86cd-4d4b159f520d-kube-api-access-gv6pv\") pod \"cd68ef76-4a7e-43a1-86cd-4d4b159f520d\" (UID: \"cd68ef76-4a7e-43a1-86cd-4d4b159f520d\") "
May 21 01:55:49.343933 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:49.343906    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd68ef76-4a7e-43a1-86cd-4d4b159f520d-bundle" (OuterVolumeSpecName: "bundle") pod "cd68ef76-4a7e-43a1-86cd-4d4b159f520d" (UID: "cd68ef76-4a7e-43a1-86cd-4d4b159f520d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:55:49.345472 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:49.345451    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd68ef76-4a7e-43a1-86cd-4d4b159f520d-kube-api-access-gv6pv" (OuterVolumeSpecName: "kube-api-access-gv6pv") pod "cd68ef76-4a7e-43a1-86cd-4d4b159f520d" (UID: "cd68ef76-4a7e-43a1-86cd-4d4b159f520d"). InnerVolumeSpecName "kube-api-access-gv6pv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:55:49.348726 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:49.348706    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd68ef76-4a7e-43a1-86cd-4d4b159f520d-util" (OuterVolumeSpecName: "util") pod "cd68ef76-4a7e-43a1-86cd-4d4b159f520d" (UID: "cd68ef76-4a7e-43a1-86cd-4d4b159f520d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:55:49.444151 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:49.444101    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd68ef76-4a7e-43a1-86cd-4d4b159f520d-bundle\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:55:49.444151 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:49.444122    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd68ef76-4a7e-43a1-86cd-4d4b159f520d-util\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:55:49.444151 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:49.444131    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gv6pv\" (UniqueName: \"kubernetes.io/projected/cd68ef76-4a7e-43a1-86cd-4d4b159f520d-kube-api-access-gv6pv\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:55:50.150600 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:50.150561    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf" event={"ID":"cd68ef76-4a7e-43a1-86cd-4d4b159f520d","Type":"ContainerDied","Data":"385d45386d8d4a2df562f43b432481a4a6ad1ff56cfed2d3ea288905433f0ffd"}
May 21 01:55:50.150600 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:50.150603    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="385d45386d8d4a2df562f43b432481a4a6ad1ff56cfed2d3ea288905433f0ffd"
May 21 01:55:50.151082 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:50.150628    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf"
May 21 01:55:50.152376 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:50.152350    2552 generic.go:358] "Generic (PLEG): container finished" podID="8dee67b1-02f2-441d-9c78-2c6eec920608" containerID="76f8faa06a30290f7809f1fc7c16d5d41ba8fc82f8b47310651d255a8e61b01b" exitCode=0
May 21 01:55:50.152492 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:50.152374    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp" event={"ID":"8dee67b1-02f2-441d-9c78-2c6eec920608","Type":"ContainerDied","Data":"76f8faa06a30290f7809f1fc7c16d5d41ba8fc82f8b47310651d255a8e61b01b"}
May 21 01:55:50.280599 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:50.280572    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46"
May 21 01:55:50.309848 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:50.309827    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc"
May 21 01:55:50.351679 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:50.351652    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc23f2c2-13f7-4c4a-a055-ead09b9252eb-util\") pod \"fc23f2c2-13f7-4c4a-a055-ead09b9252eb\" (UID: \"fc23f2c2-13f7-4c4a-a055-ead09b9252eb\") "
May 21 01:55:50.351782 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:50.351705    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpgls\" (UniqueName: \"kubernetes.io/projected/033a590b-7c99-4331-9389-da559b7e21e8-kube-api-access-fpgls\") pod \"033a590b-7c99-4331-9389-da559b7e21e8\" (UID: \"033a590b-7c99-4331-9389-da559b7e21e8\") "
May 21 01:55:50.351782 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:50.351731    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhx7k\" (UniqueName: \"kubernetes.io/projected/fc23f2c2-13f7-4c4a-a055-ead09b9252eb-kube-api-access-hhx7k\") pod \"fc23f2c2-13f7-4c4a-a055-ead09b9252eb\" (UID: \"fc23f2c2-13f7-4c4a-a055-ead09b9252eb\") "
May 21 01:55:50.351782 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:50.351766    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc23f2c2-13f7-4c4a-a055-ead09b9252eb-bundle\") pod \"fc23f2c2-13f7-4c4a-a055-ead09b9252eb\" (UID: \"fc23f2c2-13f7-4c4a-a055-ead09b9252eb\") "
May 21 01:55:50.351949 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:50.351790    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/033a590b-7c99-4331-9389-da559b7e21e8-util\") pod \"033a590b-7c99-4331-9389-da559b7e21e8\" (UID: \"033a590b-7c99-4331-9389-da559b7e21e8\") "
May 21 01:55:50.351949 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:50.351839    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/033a590b-7c99-4331-9389-da559b7e21e8-bundle\") pod \"033a590b-7c99-4331-9389-da559b7e21e8\" (UID: \"033a590b-7c99-4331-9389-da559b7e21e8\") "
May 21 01:55:50.352353 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:50.352323    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc23f2c2-13f7-4c4a-a055-ead09b9252eb-bundle" (OuterVolumeSpecName: "bundle") pod "fc23f2c2-13f7-4c4a-a055-ead09b9252eb" (UID: "fc23f2c2-13f7-4c4a-a055-ead09b9252eb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:55:50.352613 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:50.352590    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/033a590b-7c99-4331-9389-da559b7e21e8-bundle" (OuterVolumeSpecName: "bundle") pod "033a590b-7c99-4331-9389-da559b7e21e8" (UID: "033a590b-7c99-4331-9389-da559b7e21e8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:55:50.354214 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:50.354194    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/033a590b-7c99-4331-9389-da559b7e21e8-kube-api-access-fpgls" (OuterVolumeSpecName: "kube-api-access-fpgls") pod "033a590b-7c99-4331-9389-da559b7e21e8" (UID: "033a590b-7c99-4331-9389-da559b7e21e8"). InnerVolumeSpecName "kube-api-access-fpgls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:55:50.354296 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:50.354267    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc23f2c2-13f7-4c4a-a055-ead09b9252eb-kube-api-access-hhx7k" (OuterVolumeSpecName: "kube-api-access-hhx7k") pod "fc23f2c2-13f7-4c4a-a055-ead09b9252eb" (UID: "fc23f2c2-13f7-4c4a-a055-ead09b9252eb"). InnerVolumeSpecName "kube-api-access-hhx7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:55:50.358285 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:50.358265    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc23f2c2-13f7-4c4a-a055-ead09b9252eb-util" (OuterVolumeSpecName: "util") pod "fc23f2c2-13f7-4c4a-a055-ead09b9252eb" (UID: "fc23f2c2-13f7-4c4a-a055-ead09b9252eb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:55:50.358526 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:50.358507    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/033a590b-7c99-4331-9389-da559b7e21e8-util" (OuterVolumeSpecName: "util") pod "033a590b-7c99-4331-9389-da559b7e21e8" (UID: "033a590b-7c99-4331-9389-da559b7e21e8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:55:50.453078 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:50.453016    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc23f2c2-13f7-4c4a-a055-ead09b9252eb-util\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:55:50.453078 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:50.453037    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpgls\" (UniqueName: \"kubernetes.io/projected/033a590b-7c99-4331-9389-da559b7e21e8-kube-api-access-fpgls\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:55:50.453078 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:50.453048    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhx7k\" (UniqueName: \"kubernetes.io/projected/fc23f2c2-13f7-4c4a-a055-ead09b9252eb-kube-api-access-hhx7k\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:55:50.453078 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:50.453056    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc23f2c2-13f7-4c4a-a055-ead09b9252eb-bundle\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:55:50.453078 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:50.453065    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/033a590b-7c99-4331-9389-da559b7e21e8-util\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:55:50.453078 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:50.453073    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/033a590b-7c99-4331-9389-da559b7e21e8-bundle\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:55:51.157498 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:51.157460    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46" event={"ID":"033a590b-7c99-4331-9389-da559b7e21e8","Type":"ContainerDied","Data":"2f6c7ab662a89e047f2016dcf9388494c184faca214c0bbda43d86da35348821"}
May 21 01:55:51.157996 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:51.157502    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f6c7ab662a89e047f2016dcf9388494c184faca214c0bbda43d86da35348821"
May 21 01:55:51.157996 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:51.157521    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46"
May 21 01:55:51.159358 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:51.159334    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc" event={"ID":"fc23f2c2-13f7-4c4a-a055-ead09b9252eb","Type":"ContainerDied","Data":"23c77f688872ff4c60c70e05e62c36a4c6028a8ad44ad535169b62351a099569"}
May 21 01:55:51.159478 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:51.159360    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="23c77f688872ff4c60c70e05e62c36a4c6028a8ad44ad535169b62351a099569"
May 21 01:55:51.159478 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:51.159370    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc"
May 21 01:55:51.288177 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:51.288155    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp"
May 21 01:55:51.359691 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:51.359663    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8dee67b1-02f2-441d-9c78-2c6eec920608-util\") pod \"8dee67b1-02f2-441d-9c78-2c6eec920608\" (UID: \"8dee67b1-02f2-441d-9c78-2c6eec920608\") "
May 21 01:55:51.359820 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:51.359718    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mk5p7\" (UniqueName: \"kubernetes.io/projected/8dee67b1-02f2-441d-9c78-2c6eec920608-kube-api-access-mk5p7\") pod \"8dee67b1-02f2-441d-9c78-2c6eec920608\" (UID: \"8dee67b1-02f2-441d-9c78-2c6eec920608\") "
May 21 01:55:51.359820 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:51.359754    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8dee67b1-02f2-441d-9c78-2c6eec920608-bundle\") pod \"8dee67b1-02f2-441d-9c78-2c6eec920608\" (UID: \"8dee67b1-02f2-441d-9c78-2c6eec920608\") "
May 21 01:55:51.360317 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:51.360277    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dee67b1-02f2-441d-9c78-2c6eec920608-bundle" (OuterVolumeSpecName: "bundle") pod "8dee67b1-02f2-441d-9c78-2c6eec920608" (UID: "8dee67b1-02f2-441d-9c78-2c6eec920608"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:55:51.361838 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:51.361817    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dee67b1-02f2-441d-9c78-2c6eec920608-kube-api-access-mk5p7" (OuterVolumeSpecName: "kube-api-access-mk5p7") pod "8dee67b1-02f2-441d-9c78-2c6eec920608" (UID: "8dee67b1-02f2-441d-9c78-2c6eec920608"). InnerVolumeSpecName "kube-api-access-mk5p7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:55:51.365221 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:51.365193    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dee67b1-02f2-441d-9c78-2c6eec920608-util" (OuterVolumeSpecName: "util") pod "8dee67b1-02f2-441d-9c78-2c6eec920608" (UID: "8dee67b1-02f2-441d-9c78-2c6eec920608"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:55:51.461397 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:51.461338    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8dee67b1-02f2-441d-9c78-2c6eec920608-util\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:55:51.461397 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:51.461362    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mk5p7\" (UniqueName: \"kubernetes.io/projected/8dee67b1-02f2-441d-9c78-2c6eec920608-kube-api-access-mk5p7\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:55:51.461397 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:51.461373    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8dee67b1-02f2-441d-9c78-2c6eec920608-bundle\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:55:52.165744 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:52.165717    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp"
May 21 01:55:52.165744 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:52.165722    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp" event={"ID":"8dee67b1-02f2-441d-9c78-2c6eec920608","Type":"ContainerDied","Data":"9511ddc6f791bc0f5a0b51896d6c2d9aed8929834ee7e67b3fd76c0c6ebc1282"}
May 21 01:55:52.165744 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:55:52.165749    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9511ddc6f791bc0f5a0b51896d6c2d9aed8929834ee7e67b3fd76c0c6ebc1282"
May 21 01:56:03.463236 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.463195    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6567b8bc58-2whkw"]
May 21 01:56:03.463849 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.463821    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd68ef76-4a7e-43a1-86cd-4d4b159f520d" containerName="pull"
May 21 01:56:03.463990 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.463898    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd68ef76-4a7e-43a1-86cd-4d4b159f520d" containerName="pull"
May 21 01:56:03.463990 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.463931    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd68ef76-4a7e-43a1-86cd-4d4b159f520d" containerName="util"
May 21 01:56:03.463990 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.463940    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd68ef76-4a7e-43a1-86cd-4d4b159f520d" containerName="util"
May 21 01:56:03.463990 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.463960    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="033a590b-7c99-4331-9389-da559b7e21e8" containerName="pull"
May 21 01:56:03.463990 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.463969    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="033a590b-7c99-4331-9389-da559b7e21e8" containerName="pull"
May 21 01:56:03.463990 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.463980    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc23f2c2-13f7-4c4a-a055-ead09b9252eb" containerName="util"
May 21 01:56:03.463990 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.463988    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc23f2c2-13f7-4c4a-a055-ead09b9252eb" containerName="util"
May 21 01:56:03.464338 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.464013    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="033a590b-7c99-4331-9389-da559b7e21e8" containerName="util"
May 21 01:56:03.464338 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.464021    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="033a590b-7c99-4331-9389-da559b7e21e8" containerName="util"
May 21 01:56:03.464338 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.464031    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd68ef76-4a7e-43a1-86cd-4d4b159f520d" containerName="extract"
May 21 01:56:03.464338 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.464039    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd68ef76-4a7e-43a1-86cd-4d4b159f520d" containerName="extract"
May 21 01:56:03.464338 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.464051    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dee67b1-02f2-441d-9c78-2c6eec920608" containerName="extract"
May 21 01:56:03.464338 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.464060    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dee67b1-02f2-441d-9c78-2c6eec920608" containerName="extract"
May 21 01:56:03.464338 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.464074    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="033a590b-7c99-4331-9389-da559b7e21e8" containerName="extract"
May 21 01:56:03.464338 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.464083    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="033a590b-7c99-4331-9389-da559b7e21e8" containerName="extract"
May 21 01:56:03.464338 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.464092    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dee67b1-02f2-441d-9c78-2c6eec920608" containerName="pull"
May 21 01:56:03.464338 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.464101    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dee67b1-02f2-441d-9c78-2c6eec920608" containerName="pull"
May 21 01:56:03.464338 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.464112    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dee67b1-02f2-441d-9c78-2c6eec920608" containerName="util"
May 21 01:56:03.464338 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.464120    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dee67b1-02f2-441d-9c78-2c6eec920608" containerName="util"
May 21 01:56:03.464338 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.464135    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc23f2c2-13f7-4c4a-a055-ead09b9252eb" containerName="extract"
May 21 01:56:03.464338 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.464143    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc23f2c2-13f7-4c4a-a055-ead09b9252eb" containerName="extract"
May 21 01:56:03.464338 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.464155    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc23f2c2-13f7-4c4a-a055-ead09b9252eb" containerName="pull"
May 21 01:56:03.464338 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.464163    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc23f2c2-13f7-4c4a-a055-ead09b9252eb" containerName="pull"
May 21 01:56:03.464338 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.464282    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="8dee67b1-02f2-441d-9c78-2c6eec920608" containerName="extract"
May 21 01:56:03.464338 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.464297    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="cd68ef76-4a7e-43a1-86cd-4d4b159f520d" containerName="extract"
May 21 01:56:03.464338 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.464311    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="033a590b-7c99-4331-9389-da559b7e21e8" containerName="extract"
May 21 01:56:03.464338 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.464329    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="fc23f2c2-13f7-4c4a-a055-ead09b9252eb" containerName="extract"
May 21 01:56:03.468249 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.468223    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:03.476924 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.476902    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6567b8bc58-2whkw"]
May 21 01:56:03.554531 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.554499    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a729947f-93c5-4816-ac92-f95eb137db06-console-serving-cert\") pod \"console-6567b8bc58-2whkw\" (UID: \"a729947f-93c5-4816-ac92-f95eb137db06\") " pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:03.554680 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.554541    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a729947f-93c5-4816-ac92-f95eb137db06-oauth-serving-cert\") pod \"console-6567b8bc58-2whkw\" (UID: \"a729947f-93c5-4816-ac92-f95eb137db06\") " pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:03.554680 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.554598    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a729947f-93c5-4816-ac92-f95eb137db06-trusted-ca-bundle\") pod \"console-6567b8bc58-2whkw\" (UID: \"a729947f-93c5-4816-ac92-f95eb137db06\") " pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:03.554680 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.554630    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a729947f-93c5-4816-ac92-f95eb137db06-console-config\") pod \"console-6567b8bc58-2whkw\" (UID: \"a729947f-93c5-4816-ac92-f95eb137db06\") " pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:03.554796 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.554697    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a729947f-93c5-4816-ac92-f95eb137db06-service-ca\") pod \"console-6567b8bc58-2whkw\" (UID: \"a729947f-93c5-4816-ac92-f95eb137db06\") " pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:03.554842 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.554825    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a729947f-93c5-4816-ac92-f95eb137db06-console-oauth-config\") pod \"console-6567b8bc58-2whkw\" (UID: \"a729947f-93c5-4816-ac92-f95eb137db06\") " pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:03.554877 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.554855    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvg5v\" (UniqueName: \"kubernetes.io/projected/a729947f-93c5-4816-ac92-f95eb137db06-kube-api-access-lvg5v\") pod \"console-6567b8bc58-2whkw\" (UID: \"a729947f-93c5-4816-ac92-f95eb137db06\") " pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:03.655876 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.655845    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a729947f-93c5-4816-ac92-f95eb137db06-console-oauth-config\") pod \"console-6567b8bc58-2whkw\" (UID: \"a729947f-93c5-4816-ac92-f95eb137db06\") " pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:03.656014 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.655881    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lvg5v\" (UniqueName: \"kubernetes.io/projected/a729947f-93c5-4816-ac92-f95eb137db06-kube-api-access-lvg5v\") pod \"console-6567b8bc58-2whkw\" (UID: \"a729947f-93c5-4816-ac92-f95eb137db06\") " pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:03.656014 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.655934    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a729947f-93c5-4816-ac92-f95eb137db06-console-serving-cert\") pod \"console-6567b8bc58-2whkw\" (UID: \"a729947f-93c5-4816-ac92-f95eb137db06\") " pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:03.656014 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.655956    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a729947f-93c5-4816-ac92-f95eb137db06-oauth-serving-cert\") pod \"console-6567b8bc58-2whkw\" (UID: \"a729947f-93c5-4816-ac92-f95eb137db06\") " pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:03.656014 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.655982    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a729947f-93c5-4816-ac92-f95eb137db06-trusted-ca-bundle\") pod \"console-6567b8bc58-2whkw\" (UID: \"a729947f-93c5-4816-ac92-f95eb137db06\") " pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:03.656222 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.656009    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a729947f-93c5-4816-ac92-f95eb137db06-console-config\") pod \"console-6567b8bc58-2whkw\" (UID: \"a729947f-93c5-4816-ac92-f95eb137db06\") " pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:03.656222 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.656060    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a729947f-93c5-4816-ac92-f95eb137db06-service-ca\") pod \"console-6567b8bc58-2whkw\" (UID: \"a729947f-93c5-4816-ac92-f95eb137db06\") " pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:03.656721 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.656693    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a729947f-93c5-4816-ac92-f95eb137db06-oauth-serving-cert\") pod \"console-6567b8bc58-2whkw\" (UID: \"a729947f-93c5-4816-ac92-f95eb137db06\") " pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:03.656834 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.656763    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a729947f-93c5-4816-ac92-f95eb137db06-trusted-ca-bundle\") pod \"console-6567b8bc58-2whkw\" (UID: \"a729947f-93c5-4816-ac92-f95eb137db06\") " pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:03.656914 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.656867    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a729947f-93c5-4816-ac92-f95eb137db06-service-ca\") pod \"console-6567b8bc58-2whkw\" (UID: \"a729947f-93c5-4816-ac92-f95eb137db06\") " pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:03.656914 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.656874    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a729947f-93c5-4816-ac92-f95eb137db06-console-config\") pod \"console-6567b8bc58-2whkw\" (UID: \"a729947f-93c5-4816-ac92-f95eb137db06\") " pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:03.658297 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.658278    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a729947f-93c5-4816-ac92-f95eb137db06-console-oauth-config\") pod \"console-6567b8bc58-2whkw\" (UID: \"a729947f-93c5-4816-ac92-f95eb137db06\") " pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:03.658712 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.658697    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a729947f-93c5-4816-ac92-f95eb137db06-console-serving-cert\") pod \"console-6567b8bc58-2whkw\" (UID: \"a729947f-93c5-4816-ac92-f95eb137db06\") " pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:03.667151 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.667128    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvg5v\" (UniqueName: \"kubernetes.io/projected/a729947f-93c5-4816-ac92-f95eb137db06-kube-api-access-lvg5v\") pod \"console-6567b8bc58-2whkw\" (UID: \"a729947f-93c5-4816-ac92-f95eb137db06\") " pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:03.779046 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.779025    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:03.918139 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:03.918115    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6567b8bc58-2whkw"]
May 21 01:56:03.919092 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:56:03.919065    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda729947f_93c5_4816_ac92_f95eb137db06.slice/crio-bd63c5f777dce267b0d9c0406ccebd1bb73fa3dc16ec0e3b3964de5eab2a483c WatchSource:0}: Error finding container bd63c5f777dce267b0d9c0406ccebd1bb73fa3dc16ec0e3b3964de5eab2a483c: Status 404 returned error can't find the container with id bd63c5f777dce267b0d9c0406ccebd1bb73fa3dc16ec0e3b3964de5eab2a483c
May 21 01:56:04.212464 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:04.212381    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6567b8bc58-2whkw" event={"ID":"a729947f-93c5-4816-ac92-f95eb137db06","Type":"ContainerStarted","Data":"ab59ed88545511d78604a2b1ecd7ca6ed43c5eb0e6f7a6d88a8952218a94e069"}
May 21 01:56:04.212464 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:04.212413    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6567b8bc58-2whkw" event={"ID":"a729947f-93c5-4816-ac92-f95eb137db06","Type":"ContainerStarted","Data":"bd63c5f777dce267b0d9c0406ccebd1bb73fa3dc16ec0e3b3964de5eab2a483c"}
May 21 01:56:04.233027 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:04.232980    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6567b8bc58-2whkw" podStartSLOduration=1.232967221 podStartE2EDuration="1.232967221s" podCreationTimestamp="2026-05-21 01:56:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 01:56:04.231022004 +0000 UTC m=+502.518268782" watchObservedRunningTime="2026-05-21 01:56:04.232967221 +0000 UTC m=+502.520214000"
May 21 01:56:06.623106 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:06.623063    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n"]
May 21 01:56:06.631287 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:06.631260    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n"
May 21 01:56:06.634476 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:06.634449    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 01:56:06.634659 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:06.634476    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-w4hrb\""
May 21 01:56:06.634659 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:06.634458    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 01:56:06.640635 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:06.640611    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n"]
May 21 01:56:06.682070 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:06.682047    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a134d9a-dc67-492f-b48b-41f322216c98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-h958n\" (UID: \"9a134d9a-dc67-492f-b48b-41f322216c98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n"
May 21 01:56:06.682300 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:06.682164    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npv24\" (UniqueName: \"kubernetes.io/projected/9a134d9a-dc67-492f-b48b-41f322216c98-kube-api-access-npv24\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-h958n\" (UID: \"9a134d9a-dc67-492f-b48b-41f322216c98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n"
May 21 01:56:06.783025 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:06.783001    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-npv24\" (UniqueName: \"kubernetes.io/projected/9a134d9a-dc67-492f-b48b-41f322216c98-kube-api-access-npv24\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-h958n\" (UID: \"9a134d9a-dc67-492f-b48b-41f322216c98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n"
May 21 01:56:06.783137 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:06.783068    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a134d9a-dc67-492f-b48b-41f322216c98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-h958n\" (UID: \"9a134d9a-dc67-492f-b48b-41f322216c98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n"
May 21 01:56:06.783447 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:06.783424    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a134d9a-dc67-492f-b48b-41f322216c98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-h958n\" (UID: \"9a134d9a-dc67-492f-b48b-41f322216c98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n"
May 21 01:56:06.796499 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:06.796475    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npv24\" (UniqueName: \"kubernetes.io/projected/9a134d9a-dc67-492f-b48b-41f322216c98-kube-api-access-npv24\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-h958n\" (UID: \"9a134d9a-dc67-492f-b48b-41f322216c98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n"
May 21 01:56:06.942702 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:06.942640    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n"
May 21 01:56:07.103475 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:07.103449    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n"]
May 21 01:56:07.104756 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:56:07.104727    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a134d9a_dc67_492f_b48b_41f322216c98.slice/crio-a8d96bb8ee1da144d41113b3cd8780714fd2e8cebcf18b8b2101b99ad09ad29f WatchSource:0}: Error finding container a8d96bb8ee1da144d41113b3cd8780714fd2e8cebcf18b8b2101b99ad09ad29f: Status 404 returned error can't find the container with id a8d96bb8ee1da144d41113b3cd8780714fd2e8cebcf18b8b2101b99ad09ad29f
May 21 01:56:07.224866 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:07.224799    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n" event={"ID":"9a134d9a-dc67-492f-b48b-41f322216c98","Type":"ContainerStarted","Data":"a8d96bb8ee1da144d41113b3cd8780714fd2e8cebcf18b8b2101b99ad09ad29f"}
May 21 01:56:13.261406 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:13.261364    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n" event={"ID":"9a134d9a-dc67-492f-b48b-41f322216c98","Type":"ContainerStarted","Data":"4bdeef609dcfa6c9f4ac88caa43df1c492df3b67233a28313005a5db870ba642"}
May 21 01:56:13.261815 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:13.261513    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n"
May 21 01:56:13.282939 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:13.282894    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n" podStartSLOduration=2.198560704 podStartE2EDuration="7.282881477s" podCreationTimestamp="2026-05-21 01:56:06 +0000 UTC" firstStartedPulling="2026-05-21 01:56:07.10709523 +0000 UTC m=+505.394341984" lastFinishedPulling="2026-05-21 01:56:12.191415999 +0000 UTC m=+510.478662757" observedRunningTime="2026-05-21 01:56:13.279476175 +0000 UTC m=+511.566722967" watchObservedRunningTime="2026-05-21 01:56:13.282881477 +0000 UTC m=+511.570128254"
May 21 01:56:13.779787 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:13.779758    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:13.779959 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:13.779834    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:13.784730 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:13.784707    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:14.271444 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:14.271414    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6567b8bc58-2whkw"
May 21 01:56:14.324018 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:14.323984    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f7d7d75b9-txv5c"]
May 21 01:56:24.269216 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:24.269141    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n"
May 21 01:56:25.361244 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:25.361213    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9n98m"]
May 21 01:56:25.366010 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:25.365993    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9n98m"
May 21 01:56:25.384472 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:25.384446    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9n98m"]
May 21 01:56:25.539823 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:25.539780    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zfml\" (UniqueName: \"kubernetes.io/projected/01b88598-ee94-4e19-84ba-3412d25e7e11-kube-api-access-8zfml\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-9n98m\" (UID: \"01b88598-ee94-4e19-84ba-3412d25e7e11\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9n98m"
May 21 01:56:25.539978 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:25.539848    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01b88598-ee94-4e19-84ba-3412d25e7e11-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-9n98m\" (UID: \"01b88598-ee94-4e19-84ba-3412d25e7e11\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9n98m"
May 21 01:56:25.641125 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:25.641055    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01b88598-ee94-4e19-84ba-3412d25e7e11-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-9n98m\" (UID: \"01b88598-ee94-4e19-84ba-3412d25e7e11\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9n98m"
May 21 01:56:25.641247 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:25.641152    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8zfml\" (UniqueName: \"kubernetes.io/projected/01b88598-ee94-4e19-84ba-3412d25e7e11-kube-api-access-8zfml\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-9n98m\" (UID: \"01b88598-ee94-4e19-84ba-3412d25e7e11\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9n98m"
May 21 01:56:25.641479 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:25.641460    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01b88598-ee94-4e19-84ba-3412d25e7e11-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-9n98m\" (UID: \"01b88598-ee94-4e19-84ba-3412d25e7e11\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9n98m"
May 21 01:56:25.651970 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:25.651946    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zfml\" (UniqueName: \"kubernetes.io/projected/01b88598-ee94-4e19-84ba-3412d25e7e11-kube-api-access-8zfml\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-9n98m\" (UID: \"01b88598-ee94-4e19-84ba-3412d25e7e11\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9n98m"
May 21 01:56:25.676740 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:25.676715    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9n98m"
May 21 01:56:25.809381 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:25.809352    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9n98m"]
May 21 01:56:25.812402 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:56:25.812371    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01b88598_ee94_4e19_84ba_3412d25e7e11.slice/crio-78803bc36040a183be08af917f4318114a486f9ceda2250b97e6761033df47b9 WatchSource:0}: Error finding container 78803bc36040a183be08af917f4318114a486f9ceda2250b97e6761033df47b9: Status 404 returned error can't find the container with id 78803bc36040a183be08af917f4318114a486f9ceda2250b97e6761033df47b9
May 21 01:56:26.011239 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.011210    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n"]
May 21 01:56:26.011433 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.011409    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n" podUID="9a134d9a-dc67-492f-b48b-41f322216c98" containerName="manager" containerID="cri-o://4bdeef609dcfa6c9f4ac88caa43df1c492df3b67233a28313005a5db870ba642" gracePeriod=2
May 21 01:56:26.013924 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.013898    2552 status_manager.go:895] "Failed to get status for pod" podUID="9a134d9a-dc67-492f-b48b-41f322216c98" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-h958n\" is forbidden: User \"system:node:ip-10-0-141-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-162.ec2.internal' and this object"
May 21 01:56:26.016437 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.016409    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n"]
May 21 01:56:26.032151 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.032126    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9n98m"]
May 21 01:56:26.035466 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.034912    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tctpt"]
May 21 01:56:26.035631 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.035524    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a134d9a-dc67-492f-b48b-41f322216c98" containerName="manager"
May 21 01:56:26.035631 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.035569    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a134d9a-dc67-492f-b48b-41f322216c98" containerName="manager"
May 21 01:56:26.035826 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.035666    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a134d9a-dc67-492f-b48b-41f322216c98" containerName="manager"
May 21 01:56:26.039580 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.039558    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9n98m"]
May 21 01:56:26.039703 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.039660    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tctpt"
May 21 01:56:26.049469 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.049447    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tctpt"]
May 21 01:56:26.059655 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.059634    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zplzl"]
May 21 01:56:26.060224 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.060206    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01b88598-ee94-4e19-84ba-3412d25e7e11" containerName="manager"
May 21 01:56:26.060278 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.060229    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="01b88598-ee94-4e19-84ba-3412d25e7e11" containerName="manager"
May 21 01:56:26.060378 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.060366    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="01b88598-ee94-4e19-84ba-3412d25e7e11" containerName="manager"
May 21 01:56:26.063813 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.063791    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zplzl"
May 21 01:56:26.070781 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.070594    2552 status_manager.go:895] "Failed to get status for pod" podUID="9a134d9a-dc67-492f-b48b-41f322216c98" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-h958n\" is forbidden: User \"system:node:ip-10-0-141-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-162.ec2.internal' and this object"
May 21 01:56:26.072967 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.072930    2552 status_manager.go:895] "Failed to get status for pod" podUID="9a134d9a-dc67-492f-b48b-41f322216c98" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-h958n\" is forbidden: User \"system:node:ip-10-0-141-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-162.ec2.internal' and this object"
May 21 01:56:26.078073 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.077891    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zplzl"]
May 21 01:56:26.145307 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.145279    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a0db907-a181-4377-8ee6-5283bc2f8367-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-zplzl\" (UID: \"4a0db907-a181-4377-8ee6-5283bc2f8367\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zplzl"
May 21 01:56:26.145429 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.145362    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1aac931-78e8-477d-b1cf-7faed2dbee71-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tctpt\" (UID: \"f1aac931-78e8-477d-b1cf-7faed2dbee71\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tctpt"
May 21 01:56:26.145483 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.145442    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbvd4\" (UniqueName: \"kubernetes.io/projected/4a0db907-a181-4377-8ee6-5283bc2f8367-kube-api-access-nbvd4\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-zplzl\" (UID: \"4a0db907-a181-4377-8ee6-5283bc2f8367\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zplzl"
May 21 01:56:26.145520 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.145500    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzsxd\" (UniqueName: \"kubernetes.io/projected/f1aac931-78e8-477d-b1cf-7faed2dbee71-kube-api-access-rzsxd\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tctpt\" (UID: \"f1aac931-78e8-477d-b1cf-7faed2dbee71\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tctpt"
May 21 01:56:26.233064 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.233043    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n"
May 21 01:56:26.235268 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.235242    2552 status_manager.go:895] "Failed to get status for pod" podUID="9a134d9a-dc67-492f-b48b-41f322216c98" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-h958n\" is forbidden: User \"system:node:ip-10-0-141-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-162.ec2.internal' and this object"
May 21 01:56:26.246682 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.246659    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbvd4\" (UniqueName: \"kubernetes.io/projected/4a0db907-a181-4377-8ee6-5283bc2f8367-kube-api-access-nbvd4\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-zplzl\" (UID: \"4a0db907-a181-4377-8ee6-5283bc2f8367\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zplzl"
May 21 01:56:26.246772 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.246711    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rzsxd\" (UniqueName: \"kubernetes.io/projected/f1aac931-78e8-477d-b1cf-7faed2dbee71-kube-api-access-rzsxd\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tctpt\" (UID: \"f1aac931-78e8-477d-b1cf-7faed2dbee71\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tctpt"
May 21 01:56:26.246772 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.246765    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a0db907-a181-4377-8ee6-5283bc2f8367-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-zplzl\" (UID: \"4a0db907-a181-4377-8ee6-5283bc2f8367\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zplzl"
May 21 01:56:26.246884 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.246802    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1aac931-78e8-477d-b1cf-7faed2dbee71-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tctpt\" (UID: \"f1aac931-78e8-477d-b1cf-7faed2dbee71\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tctpt"
May 21 01:56:26.247133 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.247116    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1aac931-78e8-477d-b1cf-7faed2dbee71-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tctpt\" (UID: \"f1aac931-78e8-477d-b1cf-7faed2dbee71\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tctpt"
May 21 01:56:26.247186 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.247156    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a0db907-a181-4377-8ee6-5283bc2f8367-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-zplzl\" (UID: \"4a0db907-a181-4377-8ee6-5283bc2f8367\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zplzl"
May 21 01:56:26.254562 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.254521    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbvd4\" (UniqueName: \"kubernetes.io/projected/4a0db907-a181-4377-8ee6-5283bc2f8367-kube-api-access-nbvd4\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-zplzl\" (UID: \"4a0db907-a181-4377-8ee6-5283bc2f8367\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zplzl"
May 21 01:56:26.254664 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.254649    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzsxd\" (UniqueName: \"kubernetes.io/projected/f1aac931-78e8-477d-b1cf-7faed2dbee71-kube-api-access-rzsxd\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tctpt\" (UID: \"f1aac931-78e8-477d-b1cf-7faed2dbee71\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tctpt"
May 21 01:56:26.312487 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:56:26.312428    2552 kuberuntime_manager.go:623] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9n98m" container="manager"
May 21 01:56:26.313471 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.313447    2552 generic.go:358] "Generic (PLEG): container finished" podID="9a134d9a-dc67-492f-b48b-41f322216c98" containerID="4bdeef609dcfa6c9f4ac88caa43df1c492df3b67233a28313005a5db870ba642" exitCode=0
May 21 01:56:26.313591 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.313482    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n"
May 21 01:56:26.313591 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.313572    2552 scope.go:117] "RemoveContainer" containerID="4bdeef609dcfa6c9f4ac88caa43df1c492df3b67233a28313005a5db870ba642"
May 21 01:56:26.314928 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.314904    2552 status_manager.go:895] "Failed to get status for pod" podUID="01b88598-ee94-4e19-84ba-3412d25e7e11" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9n98m" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-9n98m\" is forbidden: User \"system:node:ip-10-0-141-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-162.ec2.internal' and this object"
May 21 01:56:26.316956 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.316926    2552 status_manager.go:895] "Failed to get status for pod" podUID="9a134d9a-dc67-492f-b48b-41f322216c98" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-h958n\" is forbidden: User \"system:node:ip-10-0-141-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-162.ec2.internal' and this object"
May 21 01:56:26.318957 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.318936    2552 status_manager.go:895] "Failed to get status for pod" podUID="01b88598-ee94-4e19-84ba-3412d25e7e11" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9n98m" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-9n98m\" is forbidden: User \"system:node:ip-10-0-141-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-162.ec2.internal' and this object"
May 21 01:56:26.320939 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.320914    2552 status_manager.go:895] "Failed to get status for pod" podUID="9a134d9a-dc67-492f-b48b-41f322216c98" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-h958n" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-h958n\" is forbidden: User \"system:node:ip-10-0-141-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-162.ec2.internal' and this object"
May 21 01:56:26.324344 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.324325    2552 scope.go:117] "RemoveContainer" containerID="4bdeef609dcfa6c9f4ac88caa43df1c492df3b67233a28313005a5db870ba642"
May 21 01:56:26.324620 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:56:26.324596    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bdeef609dcfa6c9f4ac88caa43df1c492df3b67233a28313005a5db870ba642\": container with ID starting with 4bdeef609dcfa6c9f4ac88caa43df1c492df3b67233a28313005a5db870ba642 not found: ID does not exist" containerID="4bdeef609dcfa6c9f4ac88caa43df1c492df3b67233a28313005a5db870ba642"
May 21 01:56:26.324687 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.324634    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bdeef609dcfa6c9f4ac88caa43df1c492df3b67233a28313005a5db870ba642"} err="failed to get container status \"4bdeef609dcfa6c9f4ac88caa43df1c492df3b67233a28313005a5db870ba642\": rpc error: code = NotFound desc = could not find container \"4bdeef609dcfa6c9f4ac88caa43df1c492df3b67233a28313005a5db870ba642\": container with ID starting with 4bdeef609dcfa6c9f4ac88caa43df1c492df3b67233a28313005a5db870ba642 not found: ID does not exist"
May 21 01:56:26.347508 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.347489    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a134d9a-dc67-492f-b48b-41f322216c98-extensions-socket-volume\") pod \"9a134d9a-dc67-492f-b48b-41f322216c98\" (UID: \"9a134d9a-dc67-492f-b48b-41f322216c98\") "
May 21 01:56:26.347636 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.347591    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npv24\" (UniqueName: \"kubernetes.io/projected/9a134d9a-dc67-492f-b48b-41f322216c98-kube-api-access-npv24\") pod \"9a134d9a-dc67-492f-b48b-41f322216c98\" (UID: \"9a134d9a-dc67-492f-b48b-41f322216c98\") "
May 21 01:56:26.347892 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.347869    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a134d9a-dc67-492f-b48b-41f322216c98-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9a134d9a-dc67-492f-b48b-41f322216c98" (UID: "9a134d9a-dc67-492f-b48b-41f322216c98"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:56:26.349301 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.349282    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a134d9a-dc67-492f-b48b-41f322216c98-kube-api-access-npv24" (OuterVolumeSpecName: "kube-api-access-npv24") pod "9a134d9a-dc67-492f-b48b-41f322216c98" (UID: "9a134d9a-dc67-492f-b48b-41f322216c98"). InnerVolumeSpecName "kube-api-access-npv24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:56:26.383611 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.383588    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tctpt"
May 21 01:56:26.392259 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.392243    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zplzl"
May 21 01:56:26.451751 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.449540    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npv24\" (UniqueName: \"kubernetes.io/projected/9a134d9a-dc67-492f-b48b-41f322216c98-kube-api-access-npv24\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:56:26.451751 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.449613    2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a134d9a-dc67-492f-b48b-41f322216c98-extensions-socket-volume\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:56:26.527972 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.527940    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tctpt"]
May 21 01:56:26.529653 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:56:26.529623    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1aac931_78e8_477d_b1cf_7faed2dbee71.slice/crio-0e9d7abb33d3e59fb4818435749af0ac0c464a94b102299853a76df13028709f WatchSource:0}: Error finding container 0e9d7abb33d3e59fb4818435749af0ac0c464a94b102299853a76df13028709f: Status 404 returned error can't find the container with id 0e9d7abb33d3e59fb4818435749af0ac0c464a94b102299853a76df13028709f
May 21 01:56:26.549362 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:26.549339    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zplzl"]
May 21 01:56:26.550706 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:56:26.550682    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a0db907_a181_4377_8ee6_5283bc2f8367.slice/crio-ca02f5d7bf23a19ad57a72182517d6081a3d624ce2e04b54f8bb35053735272f WatchSource:0}: Error finding container ca02f5d7bf23a19ad57a72182517d6081a3d624ce2e04b54f8bb35053735272f: Status 404 returned error can't find the container with id ca02f5d7bf23a19ad57a72182517d6081a3d624ce2e04b54f8bb35053735272f
May 21 01:56:27.323198 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:27.323158    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zplzl" event={"ID":"4a0db907-a181-4377-8ee6-5283bc2f8367","Type":"ContainerStarted","Data":"64564bb43cc753542fa69331723ebee65bb0e086f8590f71cd647773d7844dac"}
May 21 01:56:27.323198 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:27.323196    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zplzl" event={"ID":"4a0db907-a181-4377-8ee6-5283bc2f8367","Type":"ContainerStarted","Data":"ca02f5d7bf23a19ad57a72182517d6081a3d624ce2e04b54f8bb35053735272f"}
May 21 01:56:27.323462 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:27.323288    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zplzl"
May 21 01:56:27.324675 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:27.324648    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tctpt" event={"ID":"f1aac931-78e8-477d-b1cf-7faed2dbee71","Type":"ContainerStarted","Data":"91d38a0cc4cc0d540f5bff0432d34006b7c111cbcf152a4fa7fc2b27e91726a6"}
May 21 01:56:27.324778 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:27.324679    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tctpt" event={"ID":"f1aac931-78e8-477d-b1cf-7faed2dbee71","Type":"ContainerStarted","Data":"0e9d7abb33d3e59fb4818435749af0ac0c464a94b102299853a76df13028709f"}
May 21 01:56:27.324778 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:27.324697    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tctpt"
May 21 01:56:27.326899 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:27.326873    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9n98m" podUID="01b88598-ee94-4e19-84ba-3412d25e7e11" containerName="manager" containerID="cri-o://dca93113f5a72094c2e032fb026ed64951bd33a03c3d21db20f8774ee90e953e" gracePeriod=2
May 21 01:56:27.342510 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:27.342471    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zplzl" podStartSLOduration=1.342457795 podStartE2EDuration="1.342457795s" podCreationTimestamp="2026-05-21 01:56:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 01:56:27.340499679 +0000 UTC m=+525.627746455" watchObservedRunningTime="2026-05-21 01:56:27.342457795 +0000 UTC m=+525.629704565"
May 21 01:56:27.367318 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:27.367275    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tctpt" podStartSLOduration=1.367263707 podStartE2EDuration="1.367263707s" podCreationTimestamp="2026-05-21 01:56:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 01:56:27.364649651 +0000 UTC m=+525.651896428" watchObservedRunningTime="2026-05-21 01:56:27.367263707 +0000 UTC m=+525.654510484"
May 21 01:56:27.572761 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:27.572738    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9n98m"
May 21 01:56:27.575062 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:27.575008    2552 status_manager.go:895] "Failed to get status for pod" podUID="01b88598-ee94-4e19-84ba-3412d25e7e11" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9n98m" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-9n98m\" is forbidden: User \"system:node:ip-10-0-141-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-162.ec2.internal' and this object"
May 21 01:56:27.660369 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:27.660344    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01b88598-ee94-4e19-84ba-3412d25e7e11-extensions-socket-volume\") pod \"01b88598-ee94-4e19-84ba-3412d25e7e11\" (UID: \"01b88598-ee94-4e19-84ba-3412d25e7e11\") "
May 21 01:56:27.660469 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:27.660381    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zfml\" (UniqueName: \"kubernetes.io/projected/01b88598-ee94-4e19-84ba-3412d25e7e11-kube-api-access-8zfml\") pod \"01b88598-ee94-4e19-84ba-3412d25e7e11\" (UID: \"01b88598-ee94-4e19-84ba-3412d25e7e11\") "
May 21 01:56:27.660595 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:27.660542    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01b88598-ee94-4e19-84ba-3412d25e7e11-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "01b88598-ee94-4e19-84ba-3412d25e7e11" (UID: "01b88598-ee94-4e19-84ba-3412d25e7e11"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:56:27.662340 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:27.662310    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01b88598-ee94-4e19-84ba-3412d25e7e11-kube-api-access-8zfml" (OuterVolumeSpecName: "kube-api-access-8zfml") pod "01b88598-ee94-4e19-84ba-3412d25e7e11" (UID: "01b88598-ee94-4e19-84ba-3412d25e7e11"). InnerVolumeSpecName "kube-api-access-8zfml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:56:27.761522 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:27.761502    2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01b88598-ee94-4e19-84ba-3412d25e7e11-extensions-socket-volume\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:56:27.761522 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:27.761522    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zfml\" (UniqueName: \"kubernetes.io/projected/01b88598-ee94-4e19-84ba-3412d25e7e11-kube-api-access-8zfml\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:56:28.321964 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:28.321929    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01b88598-ee94-4e19-84ba-3412d25e7e11" path="/var/lib/kubelet/pods/01b88598-ee94-4e19-84ba-3412d25e7e11/volumes"
May 21 01:56:28.322277 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:28.322264    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a134d9a-dc67-492f-b48b-41f322216c98" path="/var/lib/kubelet/pods/9a134d9a-dc67-492f-b48b-41f322216c98/volumes"
May 21 01:56:28.332198 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:28.332174    2552 generic.go:358] "Generic (PLEG): container finished" podID="01b88598-ee94-4e19-84ba-3412d25e7e11" containerID="dca93113f5a72094c2e032fb026ed64951bd33a03c3d21db20f8774ee90e953e" exitCode=2
May 21 01:56:28.332303 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:28.332220    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9n98m"
May 21 01:56:28.332303 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:28.332272    2552 scope.go:117] "RemoveContainer" containerID="dca93113f5a72094c2e032fb026ed64951bd33a03c3d21db20f8774ee90e953e"
May 21 01:56:28.336773 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:28.336747    2552 status_manager.go:895] "Failed to get status for pod" podUID="01b88598-ee94-4e19-84ba-3412d25e7e11" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-9n98m" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-9n98m\" is forbidden: User \"system:node:ip-10-0-141-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-162.ec2.internal' and this object"
May 21 01:56:28.341136 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:28.341121    2552 scope.go:117] "RemoveContainer" containerID="dca93113f5a72094c2e032fb026ed64951bd33a03c3d21db20f8774ee90e953e"
May 21 01:56:28.341363 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:56:28.341344    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dca93113f5a72094c2e032fb026ed64951bd33a03c3d21db20f8774ee90e953e\": container with ID starting with dca93113f5a72094c2e032fb026ed64951bd33a03c3d21db20f8774ee90e953e not found: ID does not exist" containerID="dca93113f5a72094c2e032fb026ed64951bd33a03c3d21db20f8774ee90e953e"
May 21 01:56:28.341406 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:28.341371    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dca93113f5a72094c2e032fb026ed64951bd33a03c3d21db20f8774ee90e953e"} err="failed to get container status \"dca93113f5a72094c2e032fb026ed64951bd33a03c3d21db20f8774ee90e953e\": rpc error: code = NotFound desc = could not find container \"dca93113f5a72094c2e032fb026ed64951bd33a03c3d21db20f8774ee90e953e\": container with ID starting with dca93113f5a72094c2e032fb026ed64951bd33a03c3d21db20f8774ee90e953e not found: ID does not exist"
May 21 01:56:38.334785 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:38.334747    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zplzl"
May 21 01:56:38.335181 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:38.335050    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tctpt"
May 21 01:56:38.402186 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:38.402134    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tctpt"]
May 21 01:56:38.402428 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:38.402379    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tctpt" podUID="f1aac931-78e8-477d-b1cf-7faed2dbee71" containerName="manager" containerID="cri-o://91d38a0cc4cc0d540f5bff0432d34006b7c111cbcf152a4fa7fc2b27e91726a6" gracePeriod=10
May 21 01:56:38.635141 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:38.635114    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fb62m"]
May 21 01:56:38.638716 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:38.638698    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fb62m"
May 21 01:56:38.646529 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:38.646508    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tctpt"
May 21 01:56:38.648313 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:38.648290    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fb62m"]
May 21 01:56:38.649156 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:38.649132    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzsxd\" (UniqueName: \"kubernetes.io/projected/f1aac931-78e8-477d-b1cf-7faed2dbee71-kube-api-access-rzsxd\") pod \"f1aac931-78e8-477d-b1cf-7faed2dbee71\" (UID: \"f1aac931-78e8-477d-b1cf-7faed2dbee71\") "
May 21 01:56:38.649283 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:38.649266    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1aac931-78e8-477d-b1cf-7faed2dbee71-extensions-socket-volume\") pod \"f1aac931-78e8-477d-b1cf-7faed2dbee71\" (UID: \"f1aac931-78e8-477d-b1cf-7faed2dbee71\") "
May 21 01:56:38.649457 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:38.649433    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdmgx\" (UniqueName: \"kubernetes.io/projected/8cfae2f7-a1bd-484c-914d-b04b2945ce97-kube-api-access-sdmgx\") pod \"kuadrant-operator-controller-manager-55c7f4c975-fb62m\" (UID: \"8cfae2f7-a1bd-484c-914d-b04b2945ce97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fb62m"
May 21 01:56:38.649578 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:38.649474    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8cfae2f7-a1bd-484c-914d-b04b2945ce97-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-fb62m\" (UID: \"8cfae2f7-a1bd-484c-914d-b04b2945ce97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fb62m"
May 21 01:56:38.649812 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:38.649788    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1aac931-78e8-477d-b1cf-7faed2dbee71-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f1aac931-78e8-477d-b1cf-7faed2dbee71" (UID: "f1aac931-78e8-477d-b1cf-7faed2dbee71"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:56:38.651454 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:38.651433    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1aac931-78e8-477d-b1cf-7faed2dbee71-kube-api-access-rzsxd" (OuterVolumeSpecName: "kube-api-access-rzsxd") pod "f1aac931-78e8-477d-b1cf-7faed2dbee71" (UID: "f1aac931-78e8-477d-b1cf-7faed2dbee71"). InnerVolumeSpecName "kube-api-access-rzsxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:56:38.750222 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:38.750194    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sdmgx\" (UniqueName: \"kubernetes.io/projected/8cfae2f7-a1bd-484c-914d-b04b2945ce97-kube-api-access-sdmgx\") pod \"kuadrant-operator-controller-manager-55c7f4c975-fb62m\" (UID: \"8cfae2f7-a1bd-484c-914d-b04b2945ce97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fb62m"
May 21 01:56:38.750360 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:38.750229    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8cfae2f7-a1bd-484c-914d-b04b2945ce97-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-fb62m\" (UID: \"8cfae2f7-a1bd-484c-914d-b04b2945ce97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fb62m"
May 21 01:56:38.750360 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:38.750311    2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1aac931-78e8-477d-b1cf-7faed2dbee71-extensions-socket-volume\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:56:38.750360 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:38.750328    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzsxd\" (UniqueName: \"kubernetes.io/projected/f1aac931-78e8-477d-b1cf-7faed2dbee71-kube-api-access-rzsxd\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:56:38.750535 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:38.750520    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8cfae2f7-a1bd-484c-914d-b04b2945ce97-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-fb62m\" (UID: \"8cfae2f7-a1bd-484c-914d-b04b2945ce97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fb62m"
May 21 01:56:38.762180 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:38.762158    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdmgx\" (UniqueName: \"kubernetes.io/projected/8cfae2f7-a1bd-484c-914d-b04b2945ce97-kube-api-access-sdmgx\") pod \"kuadrant-operator-controller-manager-55c7f4c975-fb62m\" (UID: \"8cfae2f7-a1bd-484c-914d-b04b2945ce97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fb62m"
May 21 01:56:38.963933 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:38.963862    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fb62m"
May 21 01:56:39.095677 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.095654    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fb62m"]
May 21 01:56:39.097462 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:56:39.097434    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cfae2f7_a1bd_484c_914d_b04b2945ce97.slice/crio-39d6626bf69be2e954937768837b9f429db3c00595748f54ad3410846b2a033b WatchSource:0}: Error finding container 39d6626bf69be2e954937768837b9f429db3c00595748f54ad3410846b2a033b: Status 404 returned error can't find the container with id 39d6626bf69be2e954937768837b9f429db3c00595748f54ad3410846b2a033b
May 21 01:56:39.344068 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.344018    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-f7d7d75b9-txv5c" podUID="18c12a74-ee04-4f20-8a73-96c90f4224cb" containerName="console" containerID="cri-o://577039a37994fd025e6036f4eeb17dd9dfd92b7b6cf7690abcad3aad16a1cc94" gracePeriod=15
May 21 01:56:39.378120 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.378089    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fb62m" event={"ID":"8cfae2f7-a1bd-484c-914d-b04b2945ce97","Type":"ContainerStarted","Data":"f93a9488cae44a65708804b9c68956151f03fbf85303d381707e96a2440053c8"}
May 21 01:56:39.378276 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.378139    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fb62m"
May 21 01:56:39.378276 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.378153    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fb62m" event={"ID":"8cfae2f7-a1bd-484c-914d-b04b2945ce97","Type":"ContainerStarted","Data":"39d6626bf69be2e954937768837b9f429db3c00595748f54ad3410846b2a033b"}
May 21 01:56:39.379298 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.379274    2552 generic.go:358] "Generic (PLEG): container finished" podID="f1aac931-78e8-477d-b1cf-7faed2dbee71" containerID="91d38a0cc4cc0d540f5bff0432d34006b7c111cbcf152a4fa7fc2b27e91726a6" exitCode=0
May 21 01:56:39.379406 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.379319    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tctpt"
May 21 01:56:39.379406 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.379344    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tctpt" event={"ID":"f1aac931-78e8-477d-b1cf-7faed2dbee71","Type":"ContainerDied","Data":"91d38a0cc4cc0d540f5bff0432d34006b7c111cbcf152a4fa7fc2b27e91726a6"}
May 21 01:56:39.379406 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.379375    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tctpt" event={"ID":"f1aac931-78e8-477d-b1cf-7faed2dbee71","Type":"ContainerDied","Data":"0e9d7abb33d3e59fb4818435749af0ac0c464a94b102299853a76df13028709f"}
May 21 01:56:39.379406 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.379389    2552 scope.go:117] "RemoveContainer" containerID="91d38a0cc4cc0d540f5bff0432d34006b7c111cbcf152a4fa7fc2b27e91726a6"
May 21 01:56:39.399235 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.399197    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fb62m" podStartSLOduration=1.399186877 podStartE2EDuration="1.399186877s" podCreationTimestamp="2026-05-21 01:56:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 01:56:39.398284503 +0000 UTC m=+537.685531282" watchObservedRunningTime="2026-05-21 01:56:39.399186877 +0000 UTC m=+537.686433654"
May 21 01:56:39.411446 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.411426    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tctpt"]
May 21 01:56:39.415493 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.415471    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tctpt"]
May 21 01:56:39.456523 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.456418    2552 scope.go:117] "RemoveContainer" containerID="91d38a0cc4cc0d540f5bff0432d34006b7c111cbcf152a4fa7fc2b27e91726a6"
May 21 01:56:39.456771 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:56:39.456743    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91d38a0cc4cc0d540f5bff0432d34006b7c111cbcf152a4fa7fc2b27e91726a6\": container with ID starting with 91d38a0cc4cc0d540f5bff0432d34006b7c111cbcf152a4fa7fc2b27e91726a6 not found: ID does not exist" containerID="91d38a0cc4cc0d540f5bff0432d34006b7c111cbcf152a4fa7fc2b27e91726a6"
May 21 01:56:39.456861 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.456783    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91d38a0cc4cc0d540f5bff0432d34006b7c111cbcf152a4fa7fc2b27e91726a6"} err="failed to get container status \"91d38a0cc4cc0d540f5bff0432d34006b7c111cbcf152a4fa7fc2b27e91726a6\": rpc error: code = NotFound desc = could not find container \"91d38a0cc4cc0d540f5bff0432d34006b7c111cbcf152a4fa7fc2b27e91726a6\": container with ID starting with 91d38a0cc4cc0d540f5bff0432d34006b7c111cbcf152a4fa7fc2b27e91726a6 not found: ID does not exist"
May 21 01:56:39.597220 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.597170    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f7d7d75b9-txv5c_18c12a74-ee04-4f20-8a73-96c90f4224cb/console/0.log"
May 21 01:56:39.597315 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.597231    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:56:39.657772 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.657748    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18c12a74-ee04-4f20-8a73-96c90f4224cb-console-serving-cert\") pod \"18c12a74-ee04-4f20-8a73-96c90f4224cb\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") "
May 21 01:56:39.657913 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.657780    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18c12a74-ee04-4f20-8a73-96c90f4224cb-trusted-ca-bundle\") pod \"18c12a74-ee04-4f20-8a73-96c90f4224cb\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") "
May 21 01:56:39.657913 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.657801    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18c12a74-ee04-4f20-8a73-96c90f4224cb-oauth-serving-cert\") pod \"18c12a74-ee04-4f20-8a73-96c90f4224cb\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") "
May 21 01:56:39.657913 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.657847    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18c12a74-ee04-4f20-8a73-96c90f4224cb-console-config\") pod \"18c12a74-ee04-4f20-8a73-96c90f4224cb\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") "
May 21 01:56:39.657913 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.657869    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18c12a74-ee04-4f20-8a73-96c90f4224cb-service-ca\") pod \"18c12a74-ee04-4f20-8a73-96c90f4224cb\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") "
May 21 01:56:39.657913 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.657899    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18c12a74-ee04-4f20-8a73-96c90f4224cb-console-oauth-config\") pod \"18c12a74-ee04-4f20-8a73-96c90f4224cb\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") "
May 21 01:56:39.658186 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.657949    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knmxn\" (UniqueName: \"kubernetes.io/projected/18c12a74-ee04-4f20-8a73-96c90f4224cb-kube-api-access-knmxn\") pod \"18c12a74-ee04-4f20-8a73-96c90f4224cb\" (UID: \"18c12a74-ee04-4f20-8a73-96c90f4224cb\") "
May 21 01:56:39.658242 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.658215    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18c12a74-ee04-4f20-8a73-96c90f4224cb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "18c12a74-ee04-4f20-8a73-96c90f4224cb" (UID: "18c12a74-ee04-4f20-8a73-96c90f4224cb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 01:56:39.658301 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.658231    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18c12a74-ee04-4f20-8a73-96c90f4224cb-console-config" (OuterVolumeSpecName: "console-config") pod "18c12a74-ee04-4f20-8a73-96c90f4224cb" (UID: "18c12a74-ee04-4f20-8a73-96c90f4224cb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 01:56:39.658301 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.658265    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18c12a74-ee04-4f20-8a73-96c90f4224cb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "18c12a74-ee04-4f20-8a73-96c90f4224cb" (UID: "18c12a74-ee04-4f20-8a73-96c90f4224cb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 01:56:39.658398 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.658336    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18c12a74-ee04-4f20-8a73-96c90f4224cb-service-ca" (OuterVolumeSpecName: "service-ca") pod "18c12a74-ee04-4f20-8a73-96c90f4224cb" (UID: "18c12a74-ee04-4f20-8a73-96c90f4224cb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 01:56:39.660355 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.660331    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18c12a74-ee04-4f20-8a73-96c90f4224cb-kube-api-access-knmxn" (OuterVolumeSpecName: "kube-api-access-knmxn") pod "18c12a74-ee04-4f20-8a73-96c90f4224cb" (UID: "18c12a74-ee04-4f20-8a73-96c90f4224cb"). InnerVolumeSpecName "kube-api-access-knmxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:56:39.660575 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.660532    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18c12a74-ee04-4f20-8a73-96c90f4224cb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "18c12a74-ee04-4f20-8a73-96c90f4224cb" (UID: "18c12a74-ee04-4f20-8a73-96c90f4224cb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:56:39.660660 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.660636    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18c12a74-ee04-4f20-8a73-96c90f4224cb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "18c12a74-ee04-4f20-8a73-96c90f4224cb" (UID: "18c12a74-ee04-4f20-8a73-96c90f4224cb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:56:39.758630 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.758602    2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18c12a74-ee04-4f20-8a73-96c90f4224cb-console-serving-cert\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:56:39.758730 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.758631    2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18c12a74-ee04-4f20-8a73-96c90f4224cb-trusted-ca-bundle\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:56:39.758730 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.758646    2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18c12a74-ee04-4f20-8a73-96c90f4224cb-oauth-serving-cert\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:56:39.758730 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.758660    2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18c12a74-ee04-4f20-8a73-96c90f4224cb-console-config\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:56:39.758730 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.758673    2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18c12a74-ee04-4f20-8a73-96c90f4224cb-service-ca\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:56:39.758730 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.758685    2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18c12a74-ee04-4f20-8a73-96c90f4224cb-console-oauth-config\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:56:39.758730 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:39.758698    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knmxn\" (UniqueName: \"kubernetes.io/projected/18c12a74-ee04-4f20-8a73-96c90f4224cb-kube-api-access-knmxn\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:56:40.321693 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:40.321666    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1aac931-78e8-477d-b1cf-7faed2dbee71" path="/var/lib/kubelet/pods/f1aac931-78e8-477d-b1cf-7faed2dbee71/volumes"
May 21 01:56:40.384710 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:40.384683    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f7d7d75b9-txv5c_18c12a74-ee04-4f20-8a73-96c90f4224cb/console/0.log"
May 21 01:56:40.385080 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:40.384722    2552 generic.go:358] "Generic (PLEG): container finished" podID="18c12a74-ee04-4f20-8a73-96c90f4224cb" containerID="577039a37994fd025e6036f4eeb17dd9dfd92b7b6cf7690abcad3aad16a1cc94" exitCode=2
May 21 01:56:40.385080 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:40.384776    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f7d7d75b9-txv5c"
May 21 01:56:40.385080 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:40.384805    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f7d7d75b9-txv5c" event={"ID":"18c12a74-ee04-4f20-8a73-96c90f4224cb","Type":"ContainerDied","Data":"577039a37994fd025e6036f4eeb17dd9dfd92b7b6cf7690abcad3aad16a1cc94"}
May 21 01:56:40.385080 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:40.384832    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f7d7d75b9-txv5c" event={"ID":"18c12a74-ee04-4f20-8a73-96c90f4224cb","Type":"ContainerDied","Data":"bb566b929ff979af553e9d7cfe927b461487bda65f7334ad46f6dabec49779a1"}
May 21 01:56:40.385080 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:40.384846    2552 scope.go:117] "RemoveContainer" containerID="577039a37994fd025e6036f4eeb17dd9dfd92b7b6cf7690abcad3aad16a1cc94"
May 21 01:56:40.393581 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:40.393559    2552 scope.go:117] "RemoveContainer" containerID="577039a37994fd025e6036f4eeb17dd9dfd92b7b6cf7690abcad3aad16a1cc94"
May 21 01:56:40.393844 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:56:40.393826    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"577039a37994fd025e6036f4eeb17dd9dfd92b7b6cf7690abcad3aad16a1cc94\": container with ID starting with 577039a37994fd025e6036f4eeb17dd9dfd92b7b6cf7690abcad3aad16a1cc94 not found: ID does not exist" containerID="577039a37994fd025e6036f4eeb17dd9dfd92b7b6cf7690abcad3aad16a1cc94"
May 21 01:56:40.393915 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:40.393859    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"577039a37994fd025e6036f4eeb17dd9dfd92b7b6cf7690abcad3aad16a1cc94"} err="failed to get container status \"577039a37994fd025e6036f4eeb17dd9dfd92b7b6cf7690abcad3aad16a1cc94\": rpc error: code = NotFound desc = could not find container \"577039a37994fd025e6036f4eeb17dd9dfd92b7b6cf7690abcad3aad16a1cc94\": container with ID starting with 577039a37994fd025e6036f4eeb17dd9dfd92b7b6cf7690abcad3aad16a1cc94 not found: ID does not exist"
May 21 01:56:40.415499 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:40.415469    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f7d7d75b9-txv5c"]
May 21 01:56:40.423427 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:40.423404    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f7d7d75b9-txv5c"]
May 21 01:56:42.329716 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:42.329686    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18c12a74-ee04-4f20-8a73-96c90f4224cb" path="/var/lib/kubelet/pods/18c12a74-ee04-4f20-8a73-96c90f4224cb/volumes"
May 21 01:56:50.387469 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:50.387435    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fb62m"
May 21 01:56:50.437331 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:50.437299    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zplzl"]
May 21 01:56:50.437581 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:50.437517    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zplzl" podUID="4a0db907-a181-4377-8ee6-5283bc2f8367" containerName="manager" containerID="cri-o://64564bb43cc753542fa69331723ebee65bb0e086f8590f71cd647773d7844dac" gracePeriod=10
May 21 01:56:50.685277 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:50.685249    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zplzl"
May 21 01:56:50.744213 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:50.744186    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a0db907-a181-4377-8ee6-5283bc2f8367-extensions-socket-volume\") pod \"4a0db907-a181-4377-8ee6-5283bc2f8367\" (UID: \"4a0db907-a181-4377-8ee6-5283bc2f8367\") "
May 21 01:56:50.744355 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:50.744286    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbvd4\" (UniqueName: \"kubernetes.io/projected/4a0db907-a181-4377-8ee6-5283bc2f8367-kube-api-access-nbvd4\") pod \"4a0db907-a181-4377-8ee6-5283bc2f8367\" (UID: \"4a0db907-a181-4377-8ee6-5283bc2f8367\") "
May 21 01:56:50.744587 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:50.744537    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a0db907-a181-4377-8ee6-5283bc2f8367-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4a0db907-a181-4377-8ee6-5283bc2f8367" (UID: "4a0db907-a181-4377-8ee6-5283bc2f8367"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:56:50.746174 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:50.746154    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a0db907-a181-4377-8ee6-5283bc2f8367-kube-api-access-nbvd4" (OuterVolumeSpecName: "kube-api-access-nbvd4") pod "4a0db907-a181-4377-8ee6-5283bc2f8367" (UID: "4a0db907-a181-4377-8ee6-5283bc2f8367"). InnerVolumeSpecName "kube-api-access-nbvd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:56:50.844990 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:50.844968    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbvd4\" (UniqueName: \"kubernetes.io/projected/4a0db907-a181-4377-8ee6-5283bc2f8367-kube-api-access-nbvd4\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:56:50.844990 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:50.844989    2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a0db907-a181-4377-8ee6-5283bc2f8367-extensions-socket-volume\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:56:51.430745 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:51.430712    2552 generic.go:358] "Generic (PLEG): container finished" podID="4a0db907-a181-4377-8ee6-5283bc2f8367" containerID="64564bb43cc753542fa69331723ebee65bb0e086f8590f71cd647773d7844dac" exitCode=0
May 21 01:56:51.431165 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:51.430745    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zplzl" event={"ID":"4a0db907-a181-4377-8ee6-5283bc2f8367","Type":"ContainerDied","Data":"64564bb43cc753542fa69331723ebee65bb0e086f8590f71cd647773d7844dac"}
May 21 01:56:51.431165 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:51.430786    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zplzl"
May 21 01:56:51.431165 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:51.430794    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zplzl" event={"ID":"4a0db907-a181-4377-8ee6-5283bc2f8367","Type":"ContainerDied","Data":"ca02f5d7bf23a19ad57a72182517d6081a3d624ce2e04b54f8bb35053735272f"}
May 21 01:56:51.431165 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:51.430814    2552 scope.go:117] "RemoveContainer" containerID="64564bb43cc753542fa69331723ebee65bb0e086f8590f71cd647773d7844dac"
May 21 01:56:51.440897 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:51.440728    2552 scope.go:117] "RemoveContainer" containerID="64564bb43cc753542fa69331723ebee65bb0e086f8590f71cd647773d7844dac"
May 21 01:56:51.441005 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:56:51.440987    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64564bb43cc753542fa69331723ebee65bb0e086f8590f71cd647773d7844dac\": container with ID starting with 64564bb43cc753542fa69331723ebee65bb0e086f8590f71cd647773d7844dac not found: ID does not exist" containerID="64564bb43cc753542fa69331723ebee65bb0e086f8590f71cd647773d7844dac"
May 21 01:56:51.441042 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:51.441015    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64564bb43cc753542fa69331723ebee65bb0e086f8590f71cd647773d7844dac"} err="failed to get container status \"64564bb43cc753542fa69331723ebee65bb0e086f8590f71cd647773d7844dac\": rpc error: code = NotFound desc = could not find container \"64564bb43cc753542fa69331723ebee65bb0e086f8590f71cd647773d7844dac\": container with ID starting with 64564bb43cc753542fa69331723ebee65bb0e086f8590f71cd647773d7844dac not found: ID does not exist"
May 21 01:56:51.466604 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:51.466579    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zplzl"]
May 21 01:56:51.469811 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:51.469786    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-zplzl"]
May 21 01:56:52.322329 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:56:52.322297    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a0db907-a181-4377-8ee6-5283bc2f8367" path="/var/lib/kubelet/pods/4a0db907-a181-4377-8ee6-5283bc2f8367/volumes"
May 21 01:57:09.307475 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:09.307443    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-xgnlj"]
May 21 01:57:09.307902 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:09.307825    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1aac931-78e8-477d-b1cf-7faed2dbee71" containerName="manager"
May 21 01:57:09.307902 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:09.307837    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1aac931-78e8-477d-b1cf-7faed2dbee71" containerName="manager"
May 21 01:57:09.307902 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:09.307846    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a0db907-a181-4377-8ee6-5283bc2f8367" containerName="manager"
May 21 01:57:09.307902 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:09.307852    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a0db907-a181-4377-8ee6-5283bc2f8367" containerName="manager"
May 21 01:57:09.307902 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:09.307866    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18c12a74-ee04-4f20-8a73-96c90f4224cb" containerName="console"
May 21 01:57:09.307902 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:09.307872    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="18c12a74-ee04-4f20-8a73-96c90f4224cb" containerName="console"
May 21 01:57:09.308094 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:09.307928    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="f1aac931-78e8-477d-b1cf-7faed2dbee71" containerName="manager"
May 21 01:57:09.308094 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:09.307936    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="18c12a74-ee04-4f20-8a73-96c90f4224cb" containerName="console"
May 21 01:57:09.308094 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:09.307943    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="4a0db907-a181-4377-8ee6-5283bc2f8367" containerName="manager"
May 21 01:57:09.311166 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:09.311150    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-xgnlj"
May 21 01:57:09.313646 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:09.313618    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5cvtl\""
May 21 01:57:09.313646 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:09.313621    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 21 01:57:09.318069 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:09.318044    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-xgnlj"]
May 21 01:57:09.398670 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:09.398636    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttf9v\" (UniqueName: \"kubernetes.io/projected/4bff3103-88b4-4266-8e7b-14015ecf722a-kube-api-access-ttf9v\") pod \"limitador-limitador-7d549b5b-xgnlj\" (UID: \"4bff3103-88b4-4266-8e7b-14015ecf722a\") " pod="kuadrant-system/limitador-limitador-7d549b5b-xgnlj"
May 21 01:57:09.398863 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:09.398701    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4bff3103-88b4-4266-8e7b-14015ecf722a-config-file\") pod \"limitador-limitador-7d549b5b-xgnlj\" (UID: \"4bff3103-88b4-4266-8e7b-14015ecf722a\") " pod="kuadrant-system/limitador-limitador-7d549b5b-xgnlj"
May 21 01:57:09.405662 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:09.405636    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-xgnlj"]
May 21 01:57:09.499210 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:09.499186    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4bff3103-88b4-4266-8e7b-14015ecf722a-config-file\") pod \"limitador-limitador-7d549b5b-xgnlj\" (UID: \"4bff3103-88b4-4266-8e7b-14015ecf722a\") " pod="kuadrant-system/limitador-limitador-7d549b5b-xgnlj"
May 21 01:57:09.499352 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:09.499264    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ttf9v\" (UniqueName: \"kubernetes.io/projected/4bff3103-88b4-4266-8e7b-14015ecf722a-kube-api-access-ttf9v\") pod \"limitador-limitador-7d549b5b-xgnlj\" (UID: \"4bff3103-88b4-4266-8e7b-14015ecf722a\") " pod="kuadrant-system/limitador-limitador-7d549b5b-xgnlj"
May 21 01:57:09.499788 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:09.499770    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4bff3103-88b4-4266-8e7b-14015ecf722a-config-file\") pod \"limitador-limitador-7d549b5b-xgnlj\" (UID: \"4bff3103-88b4-4266-8e7b-14015ecf722a\") " pod="kuadrant-system/limitador-limitador-7d549b5b-xgnlj"
May 21 01:57:09.506698 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:09.506676    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttf9v\" (UniqueName: \"kubernetes.io/projected/4bff3103-88b4-4266-8e7b-14015ecf722a-kube-api-access-ttf9v\") pod \"limitador-limitador-7d549b5b-xgnlj\" (UID: \"4bff3103-88b4-4266-8e7b-14015ecf722a\") " pod="kuadrant-system/limitador-limitador-7d549b5b-xgnlj"
May 21 01:57:09.623111 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:09.623037    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-xgnlj"
May 21 01:57:09.757909 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:09.757883    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-xgnlj"]
May 21 01:57:09.759528 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:57:09.759504    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bff3103_88b4_4266_8e7b_14015ecf722a.slice/crio-8752a2b91fedb59bcc37ccc3a756b891938dbf8a0e9eb8435a676ed4947e4a57 WatchSource:0}: Error finding container 8752a2b91fedb59bcc37ccc3a756b891938dbf8a0e9eb8435a676ed4947e4a57: Status 404 returned error can't find the container with id 8752a2b91fedb59bcc37ccc3a756b891938dbf8a0e9eb8435a676ed4947e4a57
May 21 01:57:10.507489 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:10.507449    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-xgnlj" event={"ID":"4bff3103-88b4-4266-8e7b-14015ecf722a","Type":"ContainerStarted","Data":"8752a2b91fedb59bcc37ccc3a756b891938dbf8a0e9eb8435a676ed4947e4a57"}
May 21 01:57:12.516412 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:12.516377    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-xgnlj" event={"ID":"4bff3103-88b4-4266-8e7b-14015ecf722a","Type":"ContainerStarted","Data":"aae4be917d19454081c107a02c86711ab0bfa0c57719da8516464ec2f7857ec5"}
May 21 01:57:12.516840 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:12.516418    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-xgnlj"
May 21 01:57:12.533925 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:12.533881    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-xgnlj" podStartSLOduration=0.977647796 podStartE2EDuration="3.533866832s" podCreationTimestamp="2026-05-21 01:57:09 +0000 UTC" firstStartedPulling="2026-05-21 01:57:09.761354054 +0000 UTC m=+568.048600814" lastFinishedPulling="2026-05-21 01:57:12.31757309 +0000 UTC m=+570.604819850" observedRunningTime="2026-05-21 01:57:12.530876521 +0000 UTC m=+570.818123310" watchObservedRunningTime="2026-05-21 01:57:12.533866832 +0000 UTC m=+570.821113620"
May 21 01:57:23.521689 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:23.521656    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-xgnlj"
May 21 01:57:25.793358 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:25.793326    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-xgnlj"]
May 21 01:57:25.793742 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:25.793564    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-xgnlj" podUID="4bff3103-88b4-4266-8e7b-14015ecf722a" containerName="limitador" containerID="cri-o://aae4be917d19454081c107a02c86711ab0bfa0c57719da8516464ec2f7857ec5" gracePeriod=30
May 21 01:57:26.572836 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:26.572806    2552 generic.go:358] "Generic (PLEG): container finished" podID="4bff3103-88b4-4266-8e7b-14015ecf722a" containerID="aae4be917d19454081c107a02c86711ab0bfa0c57719da8516464ec2f7857ec5" exitCode=0
May 21 01:57:26.572987 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:26.572886    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-xgnlj" event={"ID":"4bff3103-88b4-4266-8e7b-14015ecf722a","Type":"ContainerDied","Data":"aae4be917d19454081c107a02c86711ab0bfa0c57719da8516464ec2f7857ec5"}
May 21 01:57:26.732614 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:26.732587    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-xgnlj"
May 21 01:57:26.837499 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:26.837439    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4bff3103-88b4-4266-8e7b-14015ecf722a-config-file\") pod \"4bff3103-88b4-4266-8e7b-14015ecf722a\" (UID: \"4bff3103-88b4-4266-8e7b-14015ecf722a\") "
May 21 01:57:26.837836 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:26.837510    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttf9v\" (UniqueName: \"kubernetes.io/projected/4bff3103-88b4-4266-8e7b-14015ecf722a-kube-api-access-ttf9v\") pod \"4bff3103-88b4-4266-8e7b-14015ecf722a\" (UID: \"4bff3103-88b4-4266-8e7b-14015ecf722a\") "
May 21 01:57:26.837882 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:26.837852    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bff3103-88b4-4266-8e7b-14015ecf722a-config-file" (OuterVolumeSpecName: "config-file") pod "4bff3103-88b4-4266-8e7b-14015ecf722a" (UID: "4bff3103-88b4-4266-8e7b-14015ecf722a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 01:57:26.839470 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:26.839451    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bff3103-88b4-4266-8e7b-14015ecf722a-kube-api-access-ttf9v" (OuterVolumeSpecName: "kube-api-access-ttf9v") pod "4bff3103-88b4-4266-8e7b-14015ecf722a" (UID: "4bff3103-88b4-4266-8e7b-14015ecf722a"). InnerVolumeSpecName "kube-api-access-ttf9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:57:26.938732 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:26.938703    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttf9v\" (UniqueName: \"kubernetes.io/projected/4bff3103-88b4-4266-8e7b-14015ecf722a-kube-api-access-ttf9v\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:57:26.938732 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:26.938729    2552 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4bff3103-88b4-4266-8e7b-14015ecf722a-config-file\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:57:27.577581 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:27.577542    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-xgnlj"
May 21 01:57:27.577763 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:27.577541    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-xgnlj" event={"ID":"4bff3103-88b4-4266-8e7b-14015ecf722a","Type":"ContainerDied","Data":"8752a2b91fedb59bcc37ccc3a756b891938dbf8a0e9eb8435a676ed4947e4a57"}
May 21 01:57:27.577763 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:27.577668    2552 scope.go:117] "RemoveContainer" containerID="aae4be917d19454081c107a02c86711ab0bfa0c57719da8516464ec2f7857ec5"
May 21 01:57:27.598954 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:27.598917    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-xgnlj"]
May 21 01:57:27.601472 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:27.601449    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-xgnlj"]
May 21 01:57:28.322443 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:28.322414    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bff3103-88b4-4266-8e7b-14015ecf722a" path="/var/lib/kubelet/pods/4bff3103-88b4-4266-8e7b-14015ecf722a/volumes"
May 21 01:57:29.997610 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:29.997575    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-4cwkz"]
May 21 01:57:29.998191 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:29.998171    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bff3103-88b4-4266-8e7b-14015ecf722a" containerName="limitador"
May 21 01:57:29.998279 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:29.998194    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bff3103-88b4-4266-8e7b-14015ecf722a" containerName="limitador"
May 21 01:57:29.998333 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:29.998298    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="4bff3103-88b4-4266-8e7b-14015ecf722a" containerName="limitador"
May 21 01:57:30.002395 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:30.002375    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-4cwkz"
May 21 01:57:30.005427 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:30.005409    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-srzqv\""
May 21 01:57:30.006674 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:30.006658    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 21 01:57:30.008478 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:30.008458    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-4cwkz"]
May 21 01:57:30.163158 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:30.163129    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0882e520-90d9-4543-9def-20f3129e9c70-data\") pod \"postgres-68c4fbbd6f-4cwkz\" (UID: \"0882e520-90d9-4543-9def-20f3129e9c70\") " pod="opendatahub/postgres-68c4fbbd6f-4cwkz"
May 21 01:57:30.163309 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:30.163193    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z4vp\" (UniqueName: \"kubernetes.io/projected/0882e520-90d9-4543-9def-20f3129e9c70-kube-api-access-9z4vp\") pod \"postgres-68c4fbbd6f-4cwkz\" (UID: \"0882e520-90d9-4543-9def-20f3129e9c70\") " pod="opendatahub/postgres-68c4fbbd6f-4cwkz"
May 21 01:57:30.264043 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:30.263980    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0882e520-90d9-4543-9def-20f3129e9c70-data\") pod \"postgres-68c4fbbd6f-4cwkz\" (UID: \"0882e520-90d9-4543-9def-20f3129e9c70\") " pod="opendatahub/postgres-68c4fbbd6f-4cwkz"
May 21 01:57:30.264174 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:30.264046    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9z4vp\" (UniqueName: \"kubernetes.io/projected/0882e520-90d9-4543-9def-20f3129e9c70-kube-api-access-9z4vp\") pod \"postgres-68c4fbbd6f-4cwkz\" (UID: \"0882e520-90d9-4543-9def-20f3129e9c70\") " pod="opendatahub/postgres-68c4fbbd6f-4cwkz"
May 21 01:57:30.264377 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:30.264357    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0882e520-90d9-4543-9def-20f3129e9c70-data\") pod \"postgres-68c4fbbd6f-4cwkz\" (UID: \"0882e520-90d9-4543-9def-20f3129e9c70\") " pod="opendatahub/postgres-68c4fbbd6f-4cwkz"
May 21 01:57:30.271851 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:30.271832    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z4vp\" (UniqueName: \"kubernetes.io/projected/0882e520-90d9-4543-9def-20f3129e9c70-kube-api-access-9z4vp\") pod \"postgres-68c4fbbd6f-4cwkz\" (UID: \"0882e520-90d9-4543-9def-20f3129e9c70\") " pod="opendatahub/postgres-68c4fbbd6f-4cwkz"
May 21 01:57:30.316439 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:30.316415    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-4cwkz"
May 21 01:57:30.465395 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:30.465369    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-4cwkz"]
May 21 01:57:30.466693 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:57:30.466662    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0882e520_90d9_4543_9def_20f3129e9c70.slice/crio-031076d742c2a25032e67c338a6d2854f7b1047a7b6e7e3e538bf5dc8400b65c WatchSource:0}: Error finding container 031076d742c2a25032e67c338a6d2854f7b1047a7b6e7e3e538bf5dc8400b65c: Status 404 returned error can't find the container with id 031076d742c2a25032e67c338a6d2854f7b1047a7b6e7e3e538bf5dc8400b65c
May 21 01:57:30.597079 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:30.597006    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-4cwkz" event={"ID":"0882e520-90d9-4543-9def-20f3129e9c70","Type":"ContainerStarted","Data":"031076d742c2a25032e67c338a6d2854f7b1047a7b6e7e3e538bf5dc8400b65c"}
May 21 01:57:35.630178 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:35.630092    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-4cwkz" event={"ID":"0882e520-90d9-4543-9def-20f3129e9c70","Type":"ContainerStarted","Data":"5fa653f55331bb4df97efe9bf7e7784d089250a925538bbd4982688caafc0291"}
May 21 01:57:35.630526 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:35.630203    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-4cwkz"
May 21 01:57:35.648560 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:35.648485    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-4cwkz" podStartSLOduration=1.8280662730000001 podStartE2EDuration="6.6484673s" podCreationTimestamp="2026-05-21 01:57:29 +0000 UTC" firstStartedPulling="2026-05-21 01:57:30.468268894 +0000 UTC m=+588.755515654" lastFinishedPulling="2026-05-21 01:57:35.288669926 +0000 UTC m=+593.575916681" observedRunningTime="2026-05-21 01:57:35.644273428 +0000 UTC m=+593.931520223" watchObservedRunningTime="2026-05-21 01:57:35.6484673 +0000 UTC m=+593.935714078"
May 21 01:57:41.661170 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:41.661140    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-4cwkz"
May 21 01:57:42.278044 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:42.278014    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cgx9r_3a1d53d4-c866-4375-a183-ecfaa11e9d0b/console-operator/2.log"
May 21 01:57:42.278245 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:42.278138    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cgx9r_3a1d53d4-c866-4375-a183-ecfaa11e9d0b/console-operator/2.log"
May 21 01:57:47.065633 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.065602    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-4nz8t"]
May 21 01:57:47.206285 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.206225    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-4nz8t"]
May 21 01:57:47.206533 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.206387    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-4nz8t"
May 21 01:57:47.207029 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.207006    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bf576fcc5-k25r9"]
May 21 01:57:47.208831 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.208809    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 21 01:57:47.208938 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.208876    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9dj6m\""
May 21 01:57:47.227228 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.227209    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bf576fcc5-k25r9"]
May 21 01:57:47.227347 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.227303    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf576fcc5-k25r9"
May 21 01:57:47.305376 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.305345    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9854\" (UniqueName: \"kubernetes.io/projected/dad0941f-640a-4f1d-a63e-81df2fe1de4c-kube-api-access-w9854\") pod \"maas-controller-68fb5d86bc-4nz8t\" (UID: \"dad0941f-640a-4f1d-a63e-81df2fe1de4c\") " pod="opendatahub/maas-controller-68fb5d86bc-4nz8t"
May 21 01:57:47.305494 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.305382    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvp9x\" (UniqueName: \"kubernetes.io/projected/f5c8fde9-b30c-4576-bf4d-7550ac5c6eb6-kube-api-access-dvp9x\") pod \"maas-controller-7bf576fcc5-k25r9\" (UID: \"f5c8fde9-b30c-4576-bf4d-7550ac5c6eb6\") " pod="opendatahub/maas-controller-7bf576fcc5-k25r9"
May 21 01:57:47.323929 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.323871    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-4nz8t"]
May 21 01:57:47.324065 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:57:47.324048    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-w9854], unattached volumes=[], failed to process volumes=[]: context canceled" pod="opendatahub/maas-controller-68fb5d86bc-4nz8t" podUID="dad0941f-640a-4f1d-a63e-81df2fe1de4c"
May 21 01:57:47.350401 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.350375    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-585598586b-f2fnm"]
May 21 01:57:47.391664 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.391635    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-585598586b-f2fnm"]
May 21 01:57:47.391825 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.391780    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-585598586b-f2fnm"
May 21 01:57:47.406241 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.406214    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w9854\" (UniqueName: \"kubernetes.io/projected/dad0941f-640a-4f1d-a63e-81df2fe1de4c-kube-api-access-w9854\") pod \"maas-controller-68fb5d86bc-4nz8t\" (UID: \"dad0941f-640a-4f1d-a63e-81df2fe1de4c\") " pod="opendatahub/maas-controller-68fb5d86bc-4nz8t"
May 21 01:57:47.406365 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.406253    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dvp9x\" (UniqueName: \"kubernetes.io/projected/f5c8fde9-b30c-4576-bf4d-7550ac5c6eb6-kube-api-access-dvp9x\") pod \"maas-controller-7bf576fcc5-k25r9\" (UID: \"f5c8fde9-b30c-4576-bf4d-7550ac5c6eb6\") " pod="opendatahub/maas-controller-7bf576fcc5-k25r9"
May 21 01:57:47.406365 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.406284    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxqw8\" (UniqueName: \"kubernetes.io/projected/8f4a3fc7-e076-49c4-b68e-cc6b95d96246-kube-api-access-fxqw8\") pod \"maas-controller-585598586b-f2fnm\" (UID: \"8f4a3fc7-e076-49c4-b68e-cc6b95d96246\") " pod="opendatahub/maas-controller-585598586b-f2fnm"
May 21 01:57:47.413972 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.413945    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9854\" (UniqueName: \"kubernetes.io/projected/dad0941f-640a-4f1d-a63e-81df2fe1de4c-kube-api-access-w9854\") pod \"maas-controller-68fb5d86bc-4nz8t\" (UID: \"dad0941f-640a-4f1d-a63e-81df2fe1de4c\") " pod="opendatahub/maas-controller-68fb5d86bc-4nz8t"
May 21 01:57:47.414068 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.414019    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvp9x\" (UniqueName: \"kubernetes.io/projected/f5c8fde9-b30c-4576-bf4d-7550ac5c6eb6-kube-api-access-dvp9x\") pod \"maas-controller-7bf576fcc5-k25r9\" (UID: \"f5c8fde9-b30c-4576-bf4d-7550ac5c6eb6\") " pod="opendatahub/maas-controller-7bf576fcc5-k25r9"
May 21 01:57:47.506815 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.506785    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxqw8\" (UniqueName: \"kubernetes.io/projected/8f4a3fc7-e076-49c4-b68e-cc6b95d96246-kube-api-access-fxqw8\") pod \"maas-controller-585598586b-f2fnm\" (UID: \"8f4a3fc7-e076-49c4-b68e-cc6b95d96246\") " pod="opendatahub/maas-controller-585598586b-f2fnm"
May 21 01:57:47.514746 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.514717    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxqw8\" (UniqueName: \"kubernetes.io/projected/8f4a3fc7-e076-49c4-b68e-cc6b95d96246-kube-api-access-fxqw8\") pod \"maas-controller-585598586b-f2fnm\" (UID: \"8f4a3fc7-e076-49c4-b68e-cc6b95d96246\") " pod="opendatahub/maas-controller-585598586b-f2fnm"
May 21 01:57:47.537800 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.537772    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf576fcc5-k25r9"
May 21 01:57:47.667061 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.667038    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bf576fcc5-k25r9"]
May 21 01:57:47.668222 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:57:47.668197    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c8fde9_b30c_4576_bf4d_7550ac5c6eb6.slice/crio-ec67e0bcbc76c9a30c52cbc8e5a3c128dc04f5dfec61c9834a1c07c1c72155df WatchSource:0}: Error finding container ec67e0bcbc76c9a30c52cbc8e5a3c128dc04f5dfec61c9834a1c07c1c72155df: Status 404 returned error can't find the container with id ec67e0bcbc76c9a30c52cbc8e5a3c128dc04f5dfec61c9834a1c07c1c72155df
May 21 01:57:47.676218 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.676188    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf576fcc5-k25r9" event={"ID":"f5c8fde9-b30c-4576-bf4d-7550ac5c6eb6","Type":"ContainerStarted","Data":"ec67e0bcbc76c9a30c52cbc8e5a3c128dc04f5dfec61c9834a1c07c1c72155df"}
May 21 01:57:47.676301 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.676231    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-4nz8t"
May 21 01:57:47.681203 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.681186    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-4nz8t"
May 21 01:57:47.706245 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.706223    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-585598586b-f2fnm"
May 21 01:57:47.707941 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.707924    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9854\" (UniqueName: \"kubernetes.io/projected/dad0941f-640a-4f1d-a63e-81df2fe1de4c-kube-api-access-w9854\") pod \"dad0941f-640a-4f1d-a63e-81df2fe1de4c\" (UID: \"dad0941f-640a-4f1d-a63e-81df2fe1de4c\") "
May 21 01:57:47.709813 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.709793    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dad0941f-640a-4f1d-a63e-81df2fe1de4c-kube-api-access-w9854" (OuterVolumeSpecName: "kube-api-access-w9854") pod "dad0941f-640a-4f1d-a63e-81df2fe1de4c" (UID: "dad0941f-640a-4f1d-a63e-81df2fe1de4c"). InnerVolumeSpecName "kube-api-access-w9854". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:57:47.809281 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.809252    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9854\" (UniqueName: \"kubernetes.io/projected/dad0941f-640a-4f1d-a63e-81df2fe1de4c-kube-api-access-w9854\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:57:47.833071 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:47.833044    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-585598586b-f2fnm"]
May 21 01:57:47.834395 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:57:47.834327    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f4a3fc7_e076_49c4_b68e_cc6b95d96246.slice/crio-47dcd736b20dd27cccab804a0386e08203636247966931563d477aaf8b01bc62 WatchSource:0}: Error finding container 47dcd736b20dd27cccab804a0386e08203636247966931563d477aaf8b01bc62: Status 404 returned error can't find the container with id 47dcd736b20dd27cccab804a0386e08203636247966931563d477aaf8b01bc62
May 21 01:57:48.685405 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:48.685331    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-4nz8t"
May 21 01:57:48.685878 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:48.685325    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-585598586b-f2fnm" event={"ID":"8f4a3fc7-e076-49c4-b68e-cc6b95d96246","Type":"ContainerStarted","Data":"47dcd736b20dd27cccab804a0386e08203636247966931563d477aaf8b01bc62"}
May 21 01:57:48.719088 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:48.719059    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-4nz8t"]
May 21 01:57:48.724595 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:48.724569    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-4nz8t"]
May 21 01:57:50.324370 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:50.324286    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dad0941f-640a-4f1d-a63e-81df2fe1de4c" path="/var/lib/kubelet/pods/dad0941f-640a-4f1d-a63e-81df2fe1de4c/volumes"
May 21 01:57:50.697330 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:50.697232    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf576fcc5-k25r9" event={"ID":"f5c8fde9-b30c-4576-bf4d-7550ac5c6eb6","Type":"ContainerStarted","Data":"243d2645bc75252d8b70fb49af0365e7c3b1e0ffcfcc1b19ce55bcb9be1c38f6"}
May 21 01:57:50.697330 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:50.697287    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bf576fcc5-k25r9"
May 21 01:57:50.698670 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:50.698642    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-585598586b-f2fnm" event={"ID":"8f4a3fc7-e076-49c4-b68e-cc6b95d96246","Type":"ContainerStarted","Data":"07818b0d65827871ba58835ee5457507108067e6856bd8128656d2ead6d9a6a9"}
May 21 01:57:50.698805 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:50.698788    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-585598586b-f2fnm"
May 21 01:57:50.715445 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:50.715392    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7bf576fcc5-k25r9" podStartSLOduration=0.967047971 podStartE2EDuration="3.715378092s" podCreationTimestamp="2026-05-21 01:57:47 +0000 UTC" firstStartedPulling="2026-05-21 01:57:47.669486519 +0000 UTC m=+605.956733288" lastFinishedPulling="2026-05-21 01:57:50.417816651 +0000 UTC m=+608.705063409" observedRunningTime="2026-05-21 01:57:50.71400746 +0000 UTC m=+609.001254263" watchObservedRunningTime="2026-05-21 01:57:50.715378092 +0000 UTC m=+609.002624869"
May 21 01:57:50.740579 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:50.740499    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-585598586b-f2fnm" podStartSLOduration=1.146870765 podStartE2EDuration="3.740484226s" podCreationTimestamp="2026-05-21 01:57:47 +0000 UTC" firstStartedPulling="2026-05-21 01:57:47.83580722 +0000 UTC m=+606.123053975" lastFinishedPulling="2026-05-21 01:57:50.429420681 +0000 UTC m=+608.716667436" observedRunningTime="2026-05-21 01:57:50.738399983 +0000 UTC m=+609.025646759" watchObservedRunningTime="2026-05-21 01:57:50.740484226 +0000 UTC m=+609.027731002"
May 21 01:57:52.691329 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:52.691282    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-b5f499f69-48tsl"]
May 21 01:57:52.694826 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:52.694808    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-b5f499f69-48tsl"
May 21 01:57:52.697381 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:52.697358    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 21 01:57:52.706379 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:52.706359    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-b5f499f69-48tsl"]
May 21 01:57:52.759627 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:52.759600    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nsdz\" (UniqueName: \"kubernetes.io/projected/ba3d1dcb-e97b-4501-ae5d-e42807a40406-kube-api-access-6nsdz\") pod \"maas-api-b5f499f69-48tsl\" (UID: \"ba3d1dcb-e97b-4501-ae5d-e42807a40406\") " pod="opendatahub/maas-api-b5f499f69-48tsl"
May 21 01:57:52.759745 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:52.759633    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba3d1dcb-e97b-4501-ae5d-e42807a40406-maas-api-tls\") pod \"maas-api-b5f499f69-48tsl\" (UID: \"ba3d1dcb-e97b-4501-ae5d-e42807a40406\") " pod="opendatahub/maas-api-b5f499f69-48tsl"
May 21 01:57:52.860092 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:52.860063    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6nsdz\" (UniqueName: \"kubernetes.io/projected/ba3d1dcb-e97b-4501-ae5d-e42807a40406-kube-api-access-6nsdz\") pod \"maas-api-b5f499f69-48tsl\" (UID: \"ba3d1dcb-e97b-4501-ae5d-e42807a40406\") " pod="opendatahub/maas-api-b5f499f69-48tsl"
May 21 01:57:52.860228 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:52.860100    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba3d1dcb-e97b-4501-ae5d-e42807a40406-maas-api-tls\") pod \"maas-api-b5f499f69-48tsl\" (UID: \"ba3d1dcb-e97b-4501-ae5d-e42807a40406\") " pod="opendatahub/maas-api-b5f499f69-48tsl"
May 21 01:57:52.862614 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:52.862580    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba3d1dcb-e97b-4501-ae5d-e42807a40406-maas-api-tls\") pod \"maas-api-b5f499f69-48tsl\" (UID: \"ba3d1dcb-e97b-4501-ae5d-e42807a40406\") " pod="opendatahub/maas-api-b5f499f69-48tsl"
May 21 01:57:52.867897 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:52.867875    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nsdz\" (UniqueName: \"kubernetes.io/projected/ba3d1dcb-e97b-4501-ae5d-e42807a40406-kube-api-access-6nsdz\") pod \"maas-api-b5f499f69-48tsl\" (UID: \"ba3d1dcb-e97b-4501-ae5d-e42807a40406\") " pod="opendatahub/maas-api-b5f499f69-48tsl"
May 21 01:57:53.006530 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:53.006502    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-b5f499f69-48tsl"
May 21 01:57:53.036591 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:53.036560    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-xb8nc"]
May 21 01:57:53.041068 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:53.041043    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-xb8nc"
May 21 01:57:53.043433 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:53.043412    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-sfpxb\""
May 21 01:57:53.043647 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:53.043630    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
May 21 01:57:53.049511 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:53.049252    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-xb8nc"]
May 21 01:57:53.159978 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:53.159953    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-b5f499f69-48tsl"]
May 21 01:57:53.161857 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:57:53.161827    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba3d1dcb_e97b_4501_ae5d_e42807a40406.slice/crio-a287ffe90c9367113be9436aabd50b35e9f647289b44f34ada406a49969c01eb WatchSource:0}: Error finding container a287ffe90c9367113be9436aabd50b35e9f647289b44f34ada406a49969c01eb: Status 404 returned error can't find the container with id a287ffe90c9367113be9436aabd50b35e9f647289b44f34ada406a49969c01eb
May 21 01:57:53.162902 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:53.162874    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr599\" (UniqueName: \"kubernetes.io/projected/3977c0b1-ee3b-4679-8238-1c63e7bce80c-kube-api-access-nr599\") pod \"payload-processing-58b6c8fdc7-xb8nc\" (UID: \"3977c0b1-ee3b-4679-8238-1c63e7bce80c\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-xb8nc"
May 21 01:57:53.264005 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:53.263931    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nr599\" (UniqueName: \"kubernetes.io/projected/3977c0b1-ee3b-4679-8238-1c63e7bce80c-kube-api-access-nr599\") pod \"payload-processing-58b6c8fdc7-xb8nc\" (UID: \"3977c0b1-ee3b-4679-8238-1c63e7bce80c\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-xb8nc"
May 21 01:57:53.274723 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:53.274697    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr599\" (UniqueName: \"kubernetes.io/projected/3977c0b1-ee3b-4679-8238-1c63e7bce80c-kube-api-access-nr599\") pod \"payload-processing-58b6c8fdc7-xb8nc\" (UID: \"3977c0b1-ee3b-4679-8238-1c63e7bce80c\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-xb8nc"
May 21 01:57:53.355682 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:53.355651    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-xb8nc"
May 21 01:57:53.491793 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:57:53.491762    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3977c0b1_ee3b_4679_8238_1c63e7bce80c.slice/crio-feef2aeed7f3a80f6fce729bd3b85bfa24623b1b116e300e29842773774201a1 WatchSource:0}: Error finding container feef2aeed7f3a80f6fce729bd3b85bfa24623b1b116e300e29842773774201a1: Status 404 returned error can't find the container with id feef2aeed7f3a80f6fce729bd3b85bfa24623b1b116e300e29842773774201a1
May 21 01:57:53.491793 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:53.491796    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-xb8nc"]
May 21 01:57:53.493795 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:53.493780    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 01:57:53.713666 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:53.713584    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-b5f499f69-48tsl" event={"ID":"ba3d1dcb-e97b-4501-ae5d-e42807a40406","Type":"ContainerStarted","Data":"a287ffe90c9367113be9436aabd50b35e9f647289b44f34ada406a49969c01eb"}
May 21 01:57:53.715740 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:53.715580    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-xb8nc" event={"ID":"3977c0b1-ee3b-4679-8238-1c63e7bce80c","Type":"ContainerStarted","Data":"feef2aeed7f3a80f6fce729bd3b85bfa24623b1b116e300e29842773774201a1"}
May 21 01:57:56.730697 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:56.730663    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-b5f499f69-48tsl" event={"ID":"ba3d1dcb-e97b-4501-ae5d-e42807a40406","Type":"ContainerStarted","Data":"033a7363b021c2336432cf860909760111af128729d4d87f253c1f1158e4b644"}
May 21 01:57:56.731104 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:56.730767    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-b5f499f69-48tsl"
May 21 01:57:56.732101 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:56.732077    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-xb8nc" event={"ID":"3977c0b1-ee3b-4679-8238-1c63e7bce80c","Type":"ContainerStarted","Data":"a18b830a91cdd129076ea2d0937a28754f724696b45d6b68513025417418ed1d"}
May 21 01:57:56.732248 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:56.732178    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-xb8nc"
May 21 01:57:56.748257 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:56.748214    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-b5f499f69-48tsl" podStartSLOduration=2.229137647 podStartE2EDuration="4.748203947s" podCreationTimestamp="2026-05-21 01:57:52 +0000 UTC" firstStartedPulling="2026-05-21 01:57:53.163098904 +0000 UTC m=+611.450345663" lastFinishedPulling="2026-05-21 01:57:55.682165209 +0000 UTC m=+613.969411963" observedRunningTime="2026-05-21 01:57:56.745215727 +0000 UTC m=+615.032462503" watchObservedRunningTime="2026-05-21 01:57:56.748203947 +0000 UTC m=+615.035450776"
May 21 01:57:56.762138 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:57:56.762092    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-xb8nc" podStartSLOduration=1.574207229 podStartE2EDuration="3.762077502s" podCreationTimestamp="2026-05-21 01:57:53 +0000 UTC" firstStartedPulling="2026-05-21 01:57:53.49390889 +0000 UTC m=+611.781155645" lastFinishedPulling="2026-05-21 01:57:55.681779154 +0000 UTC m=+613.969025918" observedRunningTime="2026-05-21 01:57:56.758735719 +0000 UTC m=+615.045982499" watchObservedRunningTime="2026-05-21 01:57:56.762077502 +0000 UTC m=+615.049324280"
May 21 01:58:01.708406 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:01.708365    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-585598586b-f2fnm"
May 21 01:58:01.708898 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:01.708777    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bf576fcc5-k25r9"
May 21 01:58:01.764181 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:01.764153    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bf576fcc5-k25r9"]
May 21 01:58:01.764385 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:01.764362    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7bf576fcc5-k25r9" podUID="f5c8fde9-b30c-4576-bf4d-7550ac5c6eb6" containerName="manager" containerID="cri-o://243d2645bc75252d8b70fb49af0365e7c3b1e0ffcfcc1b19ce55bcb9be1c38f6" gracePeriod=30
May 21 01:58:01.923784 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:01.923750    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56f7fd9c8-vcf8g"]
May 21 01:58:01.927353 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:01.927336    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56f7fd9c8-vcf8g"
May 21 01:58:01.936398 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:01.935904    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56f7fd9c8-vcf8g"]
May 21 01:58:02.017779 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:02.017760    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf576fcc5-k25r9"
May 21 01:58:02.039326 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:02.039298    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z6pd\" (UniqueName: \"kubernetes.io/projected/b97fc9a2-0dde-43c6-80d5-9551dd9917ce-kube-api-access-6z6pd\") pod \"maas-controller-56f7fd9c8-vcf8g\" (UID: \"b97fc9a2-0dde-43c6-80d5-9551dd9917ce\") " pod="opendatahub/maas-controller-56f7fd9c8-vcf8g"
May 21 01:58:02.139727 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:02.139705    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvp9x\" (UniqueName: \"kubernetes.io/projected/f5c8fde9-b30c-4576-bf4d-7550ac5c6eb6-kube-api-access-dvp9x\") pod \"f5c8fde9-b30c-4576-bf4d-7550ac5c6eb6\" (UID: \"f5c8fde9-b30c-4576-bf4d-7550ac5c6eb6\") "
May 21 01:58:02.139901 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:02.139881    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6z6pd\" (UniqueName: \"kubernetes.io/projected/b97fc9a2-0dde-43c6-80d5-9551dd9917ce-kube-api-access-6z6pd\") pod \"maas-controller-56f7fd9c8-vcf8g\" (UID: \"b97fc9a2-0dde-43c6-80d5-9551dd9917ce\") " pod="opendatahub/maas-controller-56f7fd9c8-vcf8g"
May 21 01:58:02.141849 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:02.141818    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5c8fde9-b30c-4576-bf4d-7550ac5c6eb6-kube-api-access-dvp9x" (OuterVolumeSpecName: "kube-api-access-dvp9x") pod "f5c8fde9-b30c-4576-bf4d-7550ac5c6eb6" (UID: "f5c8fde9-b30c-4576-bf4d-7550ac5c6eb6"). InnerVolumeSpecName "kube-api-access-dvp9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:58:02.147334 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:02.147313    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z6pd\" (UniqueName: \"kubernetes.io/projected/b97fc9a2-0dde-43c6-80d5-9551dd9917ce-kube-api-access-6z6pd\") pod \"maas-controller-56f7fd9c8-vcf8g\" (UID: \"b97fc9a2-0dde-43c6-80d5-9551dd9917ce\") " pod="opendatahub/maas-controller-56f7fd9c8-vcf8g"
May 21 01:58:02.240734 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:02.240712    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56f7fd9c8-vcf8g"
May 21 01:58:02.240939 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:02.240920    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvp9x\" (UniqueName: \"kubernetes.io/projected/f5c8fde9-b30c-4576-bf4d-7550ac5c6eb6-kube-api-access-dvp9x\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:58:02.370631 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:02.370610    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56f7fd9c8-vcf8g"]
May 21 01:58:02.371643 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:58:02.371616    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb97fc9a2_0dde_43c6_80d5_9551dd9917ce.slice/crio-293eb199a8d5956d69fd8d5d5301b38abdd4381cc14b98a9ffa61e26d6740d81 WatchSource:0}: Error finding container 293eb199a8d5956d69fd8d5d5301b38abdd4381cc14b98a9ffa61e26d6740d81: Status 404 returned error can't find the container with id 293eb199a8d5956d69fd8d5d5301b38abdd4381cc14b98a9ffa61e26d6740d81
May 21 01:58:02.741644 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:02.741619    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-b5f499f69-48tsl"
May 21 01:58:02.765114 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:02.765079    2552 generic.go:358] "Generic (PLEG): container finished" podID="f5c8fde9-b30c-4576-bf4d-7550ac5c6eb6" containerID="243d2645bc75252d8b70fb49af0365e7c3b1e0ffcfcc1b19ce55bcb9be1c38f6" exitCode=0
May 21 01:58:02.765588 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:02.765137    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf576fcc5-k25r9"
May 21 01:58:02.765588 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:02.765203    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf576fcc5-k25r9" event={"ID":"f5c8fde9-b30c-4576-bf4d-7550ac5c6eb6","Type":"ContainerDied","Data":"243d2645bc75252d8b70fb49af0365e7c3b1e0ffcfcc1b19ce55bcb9be1c38f6"}
May 21 01:58:02.765588 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:02.765296    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf576fcc5-k25r9" event={"ID":"f5c8fde9-b30c-4576-bf4d-7550ac5c6eb6","Type":"ContainerDied","Data":"ec67e0bcbc76c9a30c52cbc8e5a3c128dc04f5dfec61c9834a1c07c1c72155df"}
May 21 01:58:02.765588 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:02.765320    2552 scope.go:117] "RemoveContainer" containerID="243d2645bc75252d8b70fb49af0365e7c3b1e0ffcfcc1b19ce55bcb9be1c38f6"
May 21 01:58:02.768044 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:02.767594    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56f7fd9c8-vcf8g" event={"ID":"b97fc9a2-0dde-43c6-80d5-9551dd9917ce","Type":"ContainerStarted","Data":"18293263a983abfcd895c0adaa4789efefdd1ca5eb2d56fcf96e6708bfef77f8"}
May 21 01:58:02.768044 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:02.767626    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56f7fd9c8-vcf8g" event={"ID":"b97fc9a2-0dde-43c6-80d5-9551dd9917ce","Type":"ContainerStarted","Data":"293eb199a8d5956d69fd8d5d5301b38abdd4381cc14b98a9ffa61e26d6740d81"}
May 21 01:58:02.768245 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:02.768128    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56f7fd9c8-vcf8g"
May 21 01:58:02.777998 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:02.777976    2552 scope.go:117] "RemoveContainer" containerID="243d2645bc75252d8b70fb49af0365e7c3b1e0ffcfcc1b19ce55bcb9be1c38f6"
May 21 01:58:02.778295 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:58:02.778266    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"243d2645bc75252d8b70fb49af0365e7c3b1e0ffcfcc1b19ce55bcb9be1c38f6\": container with ID starting with 243d2645bc75252d8b70fb49af0365e7c3b1e0ffcfcc1b19ce55bcb9be1c38f6 not found: ID does not exist" containerID="243d2645bc75252d8b70fb49af0365e7c3b1e0ffcfcc1b19ce55bcb9be1c38f6"
May 21 01:58:02.778390 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:02.778304    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"243d2645bc75252d8b70fb49af0365e7c3b1e0ffcfcc1b19ce55bcb9be1c38f6"} err="failed to get container status \"243d2645bc75252d8b70fb49af0365e7c3b1e0ffcfcc1b19ce55bcb9be1c38f6\": rpc error: code = NotFound desc = could not find container \"243d2645bc75252d8b70fb49af0365e7c3b1e0ffcfcc1b19ce55bcb9be1c38f6\": container with ID starting with 243d2645bc75252d8b70fb49af0365e7c3b1e0ffcfcc1b19ce55bcb9be1c38f6 not found: ID does not exist"
May 21 01:58:02.788858 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:02.788811    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-56f7fd9c8-vcf8g" podStartSLOduration=1.520818507 podStartE2EDuration="1.788797303s" podCreationTimestamp="2026-05-21 01:58:01 +0000 UTC" firstStartedPulling="2026-05-21 01:58:02.372905967 +0000 UTC m=+620.660152723" lastFinishedPulling="2026-05-21 01:58:02.640884697 +0000 UTC m=+620.928131519" observedRunningTime="2026-05-21 01:58:02.784967072 +0000 UTC m=+621.072213851" watchObservedRunningTime="2026-05-21 01:58:02.788797303 +0000 UTC m=+621.076044081"
May 21 01:58:02.798900 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:02.798876    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bf576fcc5-k25r9"]
May 21 01:58:02.801150 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:02.801127    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bf576fcc5-k25r9"]
May 21 01:58:04.323020 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:04.322983    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5c8fde9-b30c-4576-bf4d-7550ac5c6eb6" path="/var/lib/kubelet/pods/f5c8fde9-b30c-4576-bf4d-7550ac5c6eb6/volumes"
May 21 01:58:07.739089 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:07.739062    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-xb8nc"
May 21 01:58:14.784011 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:14.783977    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56f7fd9c8-vcf8g"
May 21 01:58:14.821716 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:14.821681    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-585598586b-f2fnm"]
May 21 01:58:14.822161 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:14.822002    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-585598586b-f2fnm" podUID="8f4a3fc7-e076-49c4-b68e-cc6b95d96246" containerName="manager" containerID="cri-o://07818b0d65827871ba58835ee5457507108067e6856bd8128656d2ead6d9a6a9" gracePeriod=30
May 21 01:58:15.064356 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:15.064332    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-585598586b-f2fnm"
May 21 01:58:15.140906 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:15.140877    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxqw8\" (UniqueName: \"kubernetes.io/projected/8f4a3fc7-e076-49c4-b68e-cc6b95d96246-kube-api-access-fxqw8\") pod \"8f4a3fc7-e076-49c4-b68e-cc6b95d96246\" (UID: \"8f4a3fc7-e076-49c4-b68e-cc6b95d96246\") "
May 21 01:58:15.142732 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:15.142708    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f4a3fc7-e076-49c4-b68e-cc6b95d96246-kube-api-access-fxqw8" (OuterVolumeSpecName: "kube-api-access-fxqw8") pod "8f4a3fc7-e076-49c4-b68e-cc6b95d96246" (UID: "8f4a3fc7-e076-49c4-b68e-cc6b95d96246"). InnerVolumeSpecName "kube-api-access-fxqw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:58:15.241911 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:15.241889    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxqw8\" (UniqueName: \"kubernetes.io/projected/8f4a3fc7-e076-49c4-b68e-cc6b95d96246-kube-api-access-fxqw8\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:58:15.822734 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:15.822702    2552 generic.go:358] "Generic (PLEG): container finished" podID="8f4a3fc7-e076-49c4-b68e-cc6b95d96246" containerID="07818b0d65827871ba58835ee5457507108067e6856bd8128656d2ead6d9a6a9" exitCode=0
May 21 01:58:15.823137 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:15.822786    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-585598586b-f2fnm"
May 21 01:58:15.823137 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:15.822798    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-585598586b-f2fnm" event={"ID":"8f4a3fc7-e076-49c4-b68e-cc6b95d96246","Type":"ContainerDied","Data":"07818b0d65827871ba58835ee5457507108067e6856bd8128656d2ead6d9a6a9"}
May 21 01:58:15.823137 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:15.822842    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-585598586b-f2fnm" event={"ID":"8f4a3fc7-e076-49c4-b68e-cc6b95d96246","Type":"ContainerDied","Data":"47dcd736b20dd27cccab804a0386e08203636247966931563d477aaf8b01bc62"}
May 21 01:58:15.823137 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:15.822859    2552 scope.go:117] "RemoveContainer" containerID="07818b0d65827871ba58835ee5457507108067e6856bd8128656d2ead6d9a6a9"
May 21 01:58:15.834564 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:15.834529    2552 scope.go:117] "RemoveContainer" containerID="07818b0d65827871ba58835ee5457507108067e6856bd8128656d2ead6d9a6a9"
May 21 01:58:15.834823 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:58:15.834803    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07818b0d65827871ba58835ee5457507108067e6856bd8128656d2ead6d9a6a9\": container with ID starting with 07818b0d65827871ba58835ee5457507108067e6856bd8128656d2ead6d9a6a9 not found: ID does not exist" containerID="07818b0d65827871ba58835ee5457507108067e6856bd8128656d2ead6d9a6a9"
May 21 01:58:15.834903 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:15.834831    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07818b0d65827871ba58835ee5457507108067e6856bd8128656d2ead6d9a6a9"} err="failed to get container status \"07818b0d65827871ba58835ee5457507108067e6856bd8128656d2ead6d9a6a9\": rpc error: code = NotFound desc = could not find container \"07818b0d65827871ba58835ee5457507108067e6856bd8128656d2ead6d9a6a9\": container with ID starting with 07818b0d65827871ba58835ee5457507108067e6856bd8128656d2ead6d9a6a9 not found: ID does not exist"
May 21 01:58:15.846403 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:15.846380    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-585598586b-f2fnm"]
May 21 01:58:15.850521 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:15.850501    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-585598586b-f2fnm"]
May 21 01:58:16.321862 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:16.321833    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f4a3fc7-e076-49c4-b68e-cc6b95d96246" path="/var/lib/kubelet/pods/8f4a3fc7-e076-49c4-b68e-cc6b95d96246/volumes"
May 21 01:58:25.390681 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.390645    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5"]
May 21 01:58:25.391595 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.391571    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f4a3fc7-e076-49c4-b68e-cc6b95d96246" containerName="manager"
May 21 01:58:25.391595 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.391597    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f4a3fc7-e076-49c4-b68e-cc6b95d96246" containerName="manager"
May 21 01:58:25.391771 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.391641    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5c8fde9-b30c-4576-bf4d-7550ac5c6eb6" containerName="manager"
May 21 01:58:25.391771 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.391650    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5c8fde9-b30c-4576-bf4d-7550ac5c6eb6" containerName="manager"
May 21 01:58:25.391878 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.391869    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="f5c8fde9-b30c-4576-bf4d-7550ac5c6eb6" containerName="manager"
May 21 01:58:25.391926 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.391885    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f4a3fc7-e076-49c4-b68e-cc6b95d96246" containerName="manager"
May 21 01:58:25.400012 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.399987    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5"
May 21 01:58:25.400331 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.400310    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5"]
May 21 01:58:25.402520 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.402483    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 21 01:58:25.402664 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.402594    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8vpnv\""
May 21 01:58:25.403782 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.403760    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 21 01:58:25.403890 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.403853    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 21 01:58:25.531131 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.531099    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5\" (UID: \"8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5"
May 21 01:58:25.531274 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.531144    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5\" (UID: \"8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5"
May 21 01:58:25.531274 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.531162    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5\" (UID: \"8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5"
May 21 01:58:25.531274 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.531202    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5\" (UID: \"8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5"
May 21 01:58:25.531274 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.531224    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5\" (UID: \"8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5"
May 21 01:58:25.531414 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.531321    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4dl7\" (UniqueName: \"kubernetes.io/projected/8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10-kube-api-access-g4dl7\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5\" (UID: \"8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5"
May 21 01:58:25.632709 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.632675    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g4dl7\" (UniqueName: \"kubernetes.io/projected/8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10-kube-api-access-g4dl7\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5\" (UID: \"8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5"
May 21 01:58:25.632866 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.632749    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5\" (UID: \"8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5"
May 21 01:58:25.632866 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.632791    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5\" (UID: \"8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5"
May 21 01:58:25.632866 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.632809    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5\" (UID: \"8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5"
May 21 01:58:25.632866 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.632827    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5\" (UID: \"8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5"
May 21 01:58:25.633067 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.633034    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5\" (UID: \"8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5"
May 21 01:58:25.633229 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.633211    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5\" (UID: \"8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5"
May 21 01:58:25.633323 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.633263    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5\" (UID: \"8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5"
May 21 01:58:25.633406 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.633386    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5\" (UID: \"8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5"
May 21 01:58:25.635193 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.635169    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5\" (UID: \"8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5"
May 21 01:58:25.635505 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.635488    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5\" (UID: \"8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5"
May 21 01:58:25.639653 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.639631    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4dl7\" (UniqueName: \"kubernetes.io/projected/8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10-kube-api-access-g4dl7\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5\" (UID: \"8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5"
May 21 01:58:25.710897 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.710840    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5"
May 21 01:58:25.858353 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:25.858244    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5"]
May 21 01:58:25.860918 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:58:25.860875    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d9d7fb3_0d0b_45fa_8d2b_8745d96d8d10.slice/crio-e7c41508786331394eda130750839eb5dabc7e6466ae9d7b490f9d7b2ae59d09 WatchSource:0}: Error finding container e7c41508786331394eda130750839eb5dabc7e6466ae9d7b490f9d7b2ae59d09: Status 404 returned error can't find the container with id e7c41508786331394eda130750839eb5dabc7e6466ae9d7b490f9d7b2ae59d09
May 21 01:58:26.869474 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:26.869435    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5" event={"ID":"8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10","Type":"ContainerStarted","Data":"e7c41508786331394eda130750839eb5dabc7e6466ae9d7b490f9d7b2ae59d09"}
May 21 01:58:31.901745 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:31.901712    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5" event={"ID":"8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10","Type":"ContainerStarted","Data":"9568867ed70ba6ad639da56bf2c4dcc465a05c334c64574ea5415c3c82a1588d"}
May 21 01:58:37.590840 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:37.590802    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm"]
May 21 01:58:37.595787 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:37.595767    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm"
May 21 01:58:37.599183 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:37.599161    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
May 21 01:58:37.602138 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:37.602116    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm"]
May 21 01:58:37.647979 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:37.647955    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6cf9af1-7c87-4059-b892-041862a9a739-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm\" (UID: \"a6cf9af1-7c87-4059-b892-041862a9a739\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm"
May 21 01:58:37.648910 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:37.648887    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6cf9af1-7c87-4059-b892-041862a9a739-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm\" (UID: \"a6cf9af1-7c87-4059-b892-041862a9a739\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm"
May 21 01:58:37.649236 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:37.649219    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a6cf9af1-7c87-4059-b892-041862a9a739-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm\" (UID: \"a6cf9af1-7c87-4059-b892-041862a9a739\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm"
May 21 01:58:37.649525 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:37.649511    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcwj4\" (UniqueName: \"kubernetes.io/projected/a6cf9af1-7c87-4059-b892-041862a9a739-kube-api-access-mcwj4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm\" (UID: \"a6cf9af1-7c87-4059-b892-041862a9a739\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm"
May 21 01:58:37.649765 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:37.649749    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6cf9af1-7c87-4059-b892-041862a9a739-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm\" (UID: \"a6cf9af1-7c87-4059-b892-041862a9a739\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm"
May 21 01:58:37.649989 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:37.649974    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6cf9af1-7c87-4059-b892-041862a9a739-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm\" (UID: \"a6cf9af1-7c87-4059-b892-041862a9a739\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm"
May 21 01:58:37.751576 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:37.751529    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6cf9af1-7c87-4059-b892-041862a9a739-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm\" (UID: \"a6cf9af1-7c87-4059-b892-041862a9a739\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm"
May 21 01:58:37.751822 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:37.751805    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6cf9af1-7c87-4059-b892-041862a9a739-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm\" (UID: \"a6cf9af1-7c87-4059-b892-041862a9a739\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm"
May 21 01:58:37.751964 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:37.751949    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a6cf9af1-7c87-4059-b892-041862a9a739-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm\" (UID: \"a6cf9af1-7c87-4059-b892-041862a9a739\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm"
May 21 01:58:37.752113 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:37.752101    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mcwj4\" (UniqueName: \"kubernetes.io/projected/a6cf9af1-7c87-4059-b892-041862a9a739-kube-api-access-mcwj4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm\" (UID: \"a6cf9af1-7c87-4059-b892-041862a9a739\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm"
May 21 01:58:37.752212 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:37.752200    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6cf9af1-7c87-4059-b892-041862a9a739-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm\" (UID: \"a6cf9af1-7c87-4059-b892-041862a9a739\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm"
May 21 01:58:37.752306 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:37.752295    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6cf9af1-7c87-4059-b892-041862a9a739-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm\" (UID: \"a6cf9af1-7c87-4059-b892-041862a9a739\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm"
May 21 01:58:37.752486 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:37.752460    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a6cf9af1-7c87-4059-b892-041862a9a739-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm\" (UID: \"a6cf9af1-7c87-4059-b892-041862a9a739\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm"
May 21 01:58:37.752739 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:37.752719    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6cf9af1-7c87-4059-b892-041862a9a739-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm\" (UID: \"a6cf9af1-7c87-4059-b892-041862a9a739\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm"
May 21 01:58:37.752998 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:37.752250    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6cf9af1-7c87-4059-b892-041862a9a739-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm\" (UID: \"a6cf9af1-7c87-4059-b892-041862a9a739\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm"
May 21 01:58:37.754286 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:37.754264    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6cf9af1-7c87-4059-b892-041862a9a739-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm\" (UID: \"a6cf9af1-7c87-4059-b892-041862a9a739\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm"
May 21 01:58:37.755478 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:37.755456    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6cf9af1-7c87-4059-b892-041862a9a739-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm\" (UID: \"a6cf9af1-7c87-4059-b892-041862a9a739\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm"
May 21 01:58:37.760038 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:37.760009    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcwj4\" (UniqueName: \"kubernetes.io/projected/a6cf9af1-7c87-4059-b892-041862a9a739-kube-api-access-mcwj4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm\" (UID: \"a6cf9af1-7c87-4059-b892-041862a9a739\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm"
May 21 01:58:37.907154 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:37.907073    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm"
May 21 01:58:38.082059 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:38.082012    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm"]
May 21 01:58:38.083534 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:58:38.083505    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6cf9af1_7c87_4059_b892_041862a9a739.slice/crio-feb3e7f053e68034b10892b09ba4260a7c718d1ae1113392cf350dcd3a3efef8 WatchSource:0}: Error finding container feb3e7f053e68034b10892b09ba4260a7c718d1ae1113392cf350dcd3a3efef8: Status 404 returned error can't find the container with id feb3e7f053e68034b10892b09ba4260a7c718d1ae1113392cf350dcd3a3efef8
May 21 01:58:38.937412 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:38.937378    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm" event={"ID":"a6cf9af1-7c87-4059-b892-041862a9a739","Type":"ContainerStarted","Data":"53ec480e5185db2e1dd48685e27897aae8e478d6bfea79e14dd17795ab92a00f"}
May 21 01:58:38.937939 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:38.937421    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm" event={"ID":"a6cf9af1-7c87-4059-b892-041862a9a739","Type":"ContainerStarted","Data":"feb3e7f053e68034b10892b09ba4260a7c718d1ae1113392cf350dcd3a3efef8"}
May 21 01:58:40.948908 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:40.948871    2552 generic.go:358] "Generic (PLEG): container finished" podID="8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10" containerID="9568867ed70ba6ad639da56bf2c4dcc465a05c334c64574ea5415c3c82a1588d" exitCode=0
May 21 01:58:40.949560 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:40.948943    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5" event={"ID":"8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10","Type":"ContainerDied","Data":"9568867ed70ba6ad639da56bf2c4dcc465a05c334c64574ea5415c3c82a1588d"}
May 21 01:58:42.971072 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:42.971033    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5" event={"ID":"8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10","Type":"ContainerStarted","Data":"084e58f9c0a93aafa3d580f70c55e169900b1ba68b726bf05b9d26b66414d028"}
May 21 01:58:42.971446 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:42.971230    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5"
May 21 01:58:42.990555 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:42.990499    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5" podStartSLOduration=1.599913308 podStartE2EDuration="17.990487514s" podCreationTimestamp="2026-05-21 01:58:25 +0000 UTC" firstStartedPulling="2026-05-21 01:58:25.863072218 +0000 UTC m=+644.150318973" lastFinishedPulling="2026-05-21 01:58:42.253646419 +0000 UTC m=+660.540893179" observedRunningTime="2026-05-21 01:58:42.987326222 +0000 UTC m=+661.274573000" watchObservedRunningTime="2026-05-21 01:58:42.990487514 +0000 UTC m=+661.277734308"
May 21 01:58:43.455596 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:43.455562    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-b5f499f69-48tsl"]
May 21 01:58:43.456357 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:43.456098    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-b5f499f69-48tsl" podUID="ba3d1dcb-e97b-4501-ae5d-e42807a40406" containerName="maas-api" containerID="cri-o://033a7363b021c2336432cf860909760111af128729d4d87f253c1f1158e4b644" gracePeriod=30
May 21 01:58:43.733696 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:43.733672    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-b5f499f69-48tsl"
May 21 01:58:43.811614 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:43.811581    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba3d1dcb-e97b-4501-ae5d-e42807a40406-maas-api-tls\") pod \"ba3d1dcb-e97b-4501-ae5d-e42807a40406\" (UID: \"ba3d1dcb-e97b-4501-ae5d-e42807a40406\") "
May 21 01:58:43.811786 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:43.811708    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nsdz\" (UniqueName: \"kubernetes.io/projected/ba3d1dcb-e97b-4501-ae5d-e42807a40406-kube-api-access-6nsdz\") pod \"ba3d1dcb-e97b-4501-ae5d-e42807a40406\" (UID: \"ba3d1dcb-e97b-4501-ae5d-e42807a40406\") "
May 21 01:58:43.813652 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:43.813618    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba3d1dcb-e97b-4501-ae5d-e42807a40406-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ba3d1dcb-e97b-4501-ae5d-e42807a40406" (UID: "ba3d1dcb-e97b-4501-ae5d-e42807a40406"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:58:43.813771 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:43.813676    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba3d1dcb-e97b-4501-ae5d-e42807a40406-kube-api-access-6nsdz" (OuterVolumeSpecName: "kube-api-access-6nsdz") pod "ba3d1dcb-e97b-4501-ae5d-e42807a40406" (UID: "ba3d1dcb-e97b-4501-ae5d-e42807a40406"). InnerVolumeSpecName "kube-api-access-6nsdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:58:43.912566 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:43.912511    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nsdz\" (UniqueName: \"kubernetes.io/projected/ba3d1dcb-e97b-4501-ae5d-e42807a40406-kube-api-access-6nsdz\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:58:43.912566 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:43.912538    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba3d1dcb-e97b-4501-ae5d-e42807a40406-maas-api-tls\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 01:58:43.977055 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:43.976992    2552 generic.go:358] "Generic (PLEG): container finished" podID="a6cf9af1-7c87-4059-b892-041862a9a739" containerID="53ec480e5185db2e1dd48685e27897aae8e478d6bfea79e14dd17795ab92a00f" exitCode=0
May 21 01:58:43.977433 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:43.977059    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm" event={"ID":"a6cf9af1-7c87-4059-b892-041862a9a739","Type":"ContainerDied","Data":"53ec480e5185db2e1dd48685e27897aae8e478d6bfea79e14dd17795ab92a00f"}
May 21 01:58:43.978319 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:43.978263    2552 generic.go:358] "Generic (PLEG): container finished" podID="ba3d1dcb-e97b-4501-ae5d-e42807a40406" containerID="033a7363b021c2336432cf860909760111af128729d4d87f253c1f1158e4b644" exitCode=0
May 21 01:58:43.978393 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:43.978333    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-b5f499f69-48tsl"
May 21 01:58:43.978393 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:43.978341    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-b5f499f69-48tsl" event={"ID":"ba3d1dcb-e97b-4501-ae5d-e42807a40406","Type":"ContainerDied","Data":"033a7363b021c2336432cf860909760111af128729d4d87f253c1f1158e4b644"}
May 21 01:58:43.978393 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:43.978387    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-b5f499f69-48tsl" event={"ID":"ba3d1dcb-e97b-4501-ae5d-e42807a40406","Type":"ContainerDied","Data":"a287ffe90c9367113be9436aabd50b35e9f647289b44f34ada406a49969c01eb"}
May 21 01:58:43.978564 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:43.978406    2552 scope.go:117] "RemoveContainer" containerID="033a7363b021c2336432cf860909760111af128729d4d87f253c1f1158e4b644"
May 21 01:58:43.987567 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:43.987531    2552 scope.go:117] "RemoveContainer" containerID="033a7363b021c2336432cf860909760111af128729d4d87f253c1f1158e4b644"
May 21 01:58:43.987821 ip-10-0-141-162 kubenswrapper[2552]: E0521 01:58:43.987804    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"033a7363b021c2336432cf860909760111af128729d4d87f253c1f1158e4b644\": container with ID starting with 033a7363b021c2336432cf860909760111af128729d4d87f253c1f1158e4b644 not found: ID does not exist" containerID="033a7363b021c2336432cf860909760111af128729d4d87f253c1f1158e4b644"
May 21 01:58:43.987870 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:43.987828    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"033a7363b021c2336432cf860909760111af128729d4d87f253c1f1158e4b644"} err="failed to get container status \"033a7363b021c2336432cf860909760111af128729d4d87f253c1f1158e4b644\": rpc error: code = NotFound desc = could not find container \"033a7363b021c2336432cf860909760111af128729d4d87f253c1f1158e4b644\": container with ID starting with 033a7363b021c2336432cf860909760111af128729d4d87f253c1f1158e4b644 not found: ID does not exist"
May 21 01:58:44.006019 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:44.005995    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-b5f499f69-48tsl"]
May 21 01:58:44.009813 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:44.009794    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-b5f499f69-48tsl"]
May 21 01:58:44.322487 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:44.322459    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba3d1dcb-e97b-4501-ae5d-e42807a40406" path="/var/lib/kubelet/pods/ba3d1dcb-e97b-4501-ae5d-e42807a40406/volumes"
May 21 01:58:44.983771 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:44.983736    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm" event={"ID":"a6cf9af1-7c87-4059-b892-041862a9a739","Type":"ContainerStarted","Data":"0ff5caa24338ce137176f11fef7d592ba768572dd26c4250c6588ef336bf60fd"}
May 21 01:58:44.984206 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:44.983947    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm"
May 21 01:58:45.003587 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:45.003524    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm" podStartSLOduration=7.821492566 podStartE2EDuration="8.003511555s" podCreationTimestamp="2026-05-21 01:58:37 +0000 UTC" firstStartedPulling="2026-05-21 01:58:43.97787881 +0000 UTC m=+662.265125567" lastFinishedPulling="2026-05-21 01:58:44.159897792 +0000 UTC m=+662.447144556" observedRunningTime="2026-05-21 01:58:45.00166664 +0000 UTC m=+663.288913418" watchObservedRunningTime="2026-05-21 01:58:45.003511555 +0000 UTC m=+663.290758351"
May 21 01:58:53.991635 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:53.991600    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5"
May 21 01:58:56.001078 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:58:56.001047    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm"
May 21 01:59:03.091238 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.091204    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz"]
May 21 01:59:03.091713 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.091603    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba3d1dcb-e97b-4501-ae5d-e42807a40406" containerName="maas-api"
May 21 01:59:03.091713 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.091614    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba3d1dcb-e97b-4501-ae5d-e42807a40406" containerName="maas-api"
May 21 01:59:03.091713 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.091696    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="ba3d1dcb-e97b-4501-ae5d-e42807a40406" containerName="maas-api"
May 21 01:59:03.109129 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.109103    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz"]
May 21 01:59:03.109268 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.109211    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz"
May 21 01:59:03.111805 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.111782    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
May 21 01:59:03.185350 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.185327    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0049d6c-8eb1-458a-b4dd-08a75e4598b4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-msxxz\" (UID: \"b0049d6c-8eb1-458a-b4dd-08a75e4598b4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz"
May 21 01:59:03.185474 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.185386    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0049d6c-8eb1-458a-b4dd-08a75e4598b4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-msxxz\" (UID: \"b0049d6c-8eb1-458a-b4dd-08a75e4598b4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz"
May 21 01:59:03.185474 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.185411    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b0049d6c-8eb1-458a-b4dd-08a75e4598b4-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-msxxz\" (UID: \"b0049d6c-8eb1-458a-b4dd-08a75e4598b4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz"
May 21 01:59:03.185474 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.185434    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0049d6c-8eb1-458a-b4dd-08a75e4598b4-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-msxxz\" (UID: \"b0049d6c-8eb1-458a-b4dd-08a75e4598b4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz"
May 21 01:59:03.185597 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.185513    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r57f8\" (UniqueName: \"kubernetes.io/projected/b0049d6c-8eb1-458a-b4dd-08a75e4598b4-kube-api-access-r57f8\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-msxxz\" (UID: \"b0049d6c-8eb1-458a-b4dd-08a75e4598b4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz"
May 21 01:59:03.185632 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.185611    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0049d6c-8eb1-458a-b4dd-08a75e4598b4-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-msxxz\" (UID: \"b0049d6c-8eb1-458a-b4dd-08a75e4598b4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz"
May 21 01:59:03.286934 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.286908    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0049d6c-8eb1-458a-b4dd-08a75e4598b4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-msxxz\" (UID: \"b0049d6c-8eb1-458a-b4dd-08a75e4598b4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz"
May 21 01:59:03.287074 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.286947    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b0049d6c-8eb1-458a-b4dd-08a75e4598b4-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-msxxz\" (UID: \"b0049d6c-8eb1-458a-b4dd-08a75e4598b4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz"
May 21 01:59:03.287074 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.286985    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0049d6c-8eb1-458a-b4dd-08a75e4598b4-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-msxxz\" (UID: \"b0049d6c-8eb1-458a-b4dd-08a75e4598b4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz"
May 21 01:59:03.287074 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.287024    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r57f8\" (UniqueName: \"kubernetes.io/projected/b0049d6c-8eb1-458a-b4dd-08a75e4598b4-kube-api-access-r57f8\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-msxxz\" (UID: \"b0049d6c-8eb1-458a-b4dd-08a75e4598b4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz"
May 21 01:59:03.287198 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.287105    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0049d6c-8eb1-458a-b4dd-08a75e4598b4-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-msxxz\" (UID: \"b0049d6c-8eb1-458a-b4dd-08a75e4598b4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz"
May 21 01:59:03.287198 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.287135    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0049d6c-8eb1-458a-b4dd-08a75e4598b4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-msxxz\" (UID: \"b0049d6c-8eb1-458a-b4dd-08a75e4598b4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz"
May 21 01:59:03.287405 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.287361    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b0049d6c-8eb1-458a-b4dd-08a75e4598b4-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-msxxz\" (UID: \"b0049d6c-8eb1-458a-b4dd-08a75e4598b4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz"
May 21 01:59:03.287793 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.287769    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0049d6c-8eb1-458a-b4dd-08a75e4598b4-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-msxxz\" (UID: \"b0049d6c-8eb1-458a-b4dd-08a75e4598b4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz"
May 21 01:59:03.287893 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.287880    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0049d6c-8eb1-458a-b4dd-08a75e4598b4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-msxxz\" (UID: \"b0049d6c-8eb1-458a-b4dd-08a75e4598b4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz"
May 21 01:59:03.289411 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.289386    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0049d6c-8eb1-458a-b4dd-08a75e4598b4-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-msxxz\" (UID: \"b0049d6c-8eb1-458a-b4dd-08a75e4598b4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz"
May 21 01:59:03.289690 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.289672    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0049d6c-8eb1-458a-b4dd-08a75e4598b4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-msxxz\" (UID: \"b0049d6c-8eb1-458a-b4dd-08a75e4598b4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz"
May 21 01:59:03.295125 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.295102    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r57f8\" (UniqueName: \"kubernetes.io/projected/b0049d6c-8eb1-458a-b4dd-08a75e4598b4-kube-api-access-r57f8\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-msxxz\" (UID: \"b0049d6c-8eb1-458a-b4dd-08a75e4598b4\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz"
May 21 01:59:03.419529 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.419434    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz"
May 21 01:59:03.558706 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:03.558674    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz"]
May 21 01:59:03.559962 ip-10-0-141-162 kubenswrapper[2552]: W0521 01:59:03.559940    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0049d6c_8eb1_458a_b4dd_08a75e4598b4.slice/crio-5550594fe3224cc6fcf7d9f3f47a9d56bfe9221bfcb5dd2914784c1343df512a WatchSource:0}: Error finding container 5550594fe3224cc6fcf7d9f3f47a9d56bfe9221bfcb5dd2914784c1343df512a: Status 404 returned error can't find the container with id 5550594fe3224cc6fcf7d9f3f47a9d56bfe9221bfcb5dd2914784c1343df512a
May 21 01:59:04.071594 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:04.071541    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz" event={"ID":"b0049d6c-8eb1-458a-b4dd-08a75e4598b4","Type":"ContainerStarted","Data":"b0eef8e648d48f64bf51759cf7673036e1f491f808b36d172667c7cb8b50dd34"}
May 21 01:59:04.071594 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:04.071595    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz" event={"ID":"b0049d6c-8eb1-458a-b4dd-08a75e4598b4","Type":"ContainerStarted","Data":"5550594fe3224cc6fcf7d9f3f47a9d56bfe9221bfcb5dd2914784c1343df512a"}
May 21 01:59:09.095498 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:09.095466    2552 generic.go:358] "Generic (PLEG): container finished" podID="b0049d6c-8eb1-458a-b4dd-08a75e4598b4" containerID="b0eef8e648d48f64bf51759cf7673036e1f491f808b36d172667c7cb8b50dd34" exitCode=0
May 21 01:59:09.095876 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:09.095560    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz" event={"ID":"b0049d6c-8eb1-458a-b4dd-08a75e4598b4","Type":"ContainerDied","Data":"b0eef8e648d48f64bf51759cf7673036e1f491f808b36d172667c7cb8b50dd34"}
May 21 01:59:10.101141 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:10.101106    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz" event={"ID":"b0049d6c-8eb1-458a-b4dd-08a75e4598b4","Type":"ContainerStarted","Data":"f8a37263e33c8e88776228993e8319d658f887ee7c261b7d7d62ed72a8b6aebd"}
May 21 01:59:10.101576 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:10.101308    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz"
May 21 01:59:10.120842 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:10.120770    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz" podStartSLOduration=6.958025878 podStartE2EDuration="7.12075686s" podCreationTimestamp="2026-05-21 01:59:03 +0000 UTC" firstStartedPulling="2026-05-21 01:59:09.096226544 +0000 UTC m=+687.383473299" lastFinishedPulling="2026-05-21 01:59:09.258957514 +0000 UTC m=+687.546204281" observedRunningTime="2026-05-21 01:59:10.119795986 +0000 UTC m=+688.407042764" watchObservedRunningTime="2026-05-21 01:59:10.12075686 +0000 UTC m=+688.408003638"
May 21 01:59:21.119226 ip-10-0-141-162 kubenswrapper[2552]: I0521 01:59:21.119151    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-msxxz"
May 21 02:00:41.576074 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:00:41.576044    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56f7fd9c8-vcf8g"]
May 21 02:00:41.576589 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:00:41.576241    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-56f7fd9c8-vcf8g" podUID="b97fc9a2-0dde-43c6-80d5-9551dd9917ce" containerName="manager" containerID="cri-o://18293263a983abfcd895c0adaa4789efefdd1ca5eb2d56fcf96e6708bfef77f8" gracePeriod=30
May 21 02:00:41.825021 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:00:41.824998    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56f7fd9c8-vcf8g"
May 21 02:00:41.872531 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:00:41.872463    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6z6pd\" (UniqueName: \"kubernetes.io/projected/b97fc9a2-0dde-43c6-80d5-9551dd9917ce-kube-api-access-6z6pd\") pod \"b97fc9a2-0dde-43c6-80d5-9551dd9917ce\" (UID: \"b97fc9a2-0dde-43c6-80d5-9551dd9917ce\") "
May 21 02:00:41.874387 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:00:41.874367    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b97fc9a2-0dde-43c6-80d5-9551dd9917ce-kube-api-access-6z6pd" (OuterVolumeSpecName: "kube-api-access-6z6pd") pod "b97fc9a2-0dde-43c6-80d5-9551dd9917ce" (UID: "b97fc9a2-0dde-43c6-80d5-9551dd9917ce"). InnerVolumeSpecName "kube-api-access-6z6pd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 02:00:41.974086 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:00:41.974059    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6z6pd\" (UniqueName: \"kubernetes.io/projected/b97fc9a2-0dde-43c6-80d5-9551dd9917ce-kube-api-access-6z6pd\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 02:00:42.490317 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:00:42.490287    2552 generic.go:358] "Generic (PLEG): container finished" podID="b97fc9a2-0dde-43c6-80d5-9551dd9917ce" containerID="18293263a983abfcd895c0adaa4789efefdd1ca5eb2d56fcf96e6708bfef77f8" exitCode=0
May 21 02:00:42.490469 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:00:42.490341    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56f7fd9c8-vcf8g"
May 21 02:00:42.490469 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:00:42.490367    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56f7fd9c8-vcf8g" event={"ID":"b97fc9a2-0dde-43c6-80d5-9551dd9917ce","Type":"ContainerDied","Data":"18293263a983abfcd895c0adaa4789efefdd1ca5eb2d56fcf96e6708bfef77f8"}
May 21 02:00:42.490469 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:00:42.490401    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56f7fd9c8-vcf8g" event={"ID":"b97fc9a2-0dde-43c6-80d5-9551dd9917ce","Type":"ContainerDied","Data":"293eb199a8d5956d69fd8d5d5301b38abdd4381cc14b98a9ffa61e26d6740d81"}
May 21 02:00:42.490469 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:00:42.490420    2552 scope.go:117] "RemoveContainer" containerID="18293263a983abfcd895c0adaa4789efefdd1ca5eb2d56fcf96e6708bfef77f8"
May 21 02:00:42.499278 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:00:42.499262    2552 scope.go:117] "RemoveContainer" containerID="18293263a983abfcd895c0adaa4789efefdd1ca5eb2d56fcf96e6708bfef77f8"
May 21 02:00:42.499482 ip-10-0-141-162 kubenswrapper[2552]: E0521 02:00:42.499465    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18293263a983abfcd895c0adaa4789efefdd1ca5eb2d56fcf96e6708bfef77f8\": container with ID starting with 18293263a983abfcd895c0adaa4789efefdd1ca5eb2d56fcf96e6708bfef77f8 not found: ID does not exist" containerID="18293263a983abfcd895c0adaa4789efefdd1ca5eb2d56fcf96e6708bfef77f8"
May 21 02:00:42.499541 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:00:42.499488    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18293263a983abfcd895c0adaa4789efefdd1ca5eb2d56fcf96e6708bfef77f8"} err="failed to get container status \"18293263a983abfcd895c0adaa4789efefdd1ca5eb2d56fcf96e6708bfef77f8\": rpc error: code = NotFound desc = could not find container \"18293263a983abfcd895c0adaa4789efefdd1ca5eb2d56fcf96e6708bfef77f8\": container with ID starting with 18293263a983abfcd895c0adaa4789efefdd1ca5eb2d56fcf96e6708bfef77f8 not found: ID does not exist"
May 21 02:00:42.509858 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:00:42.509835    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56f7fd9c8-vcf8g"]
May 21 02:00:42.512484 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:00:42.512459    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-56f7fd9c8-vcf8g"]
May 21 02:00:44.322450 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:00:44.322415    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b97fc9a2-0dde-43c6-80d5-9551dd9917ce" path="/var/lib/kubelet/pods/b97fc9a2-0dde-43c6-80d5-9551dd9917ce/volumes"
May 21 02:02:42.316147 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:02:42.316118    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cgx9r_3a1d53d4-c866-4375-a183-ecfaa11e9d0b/console-operator/2.log"
May 21 02:02:42.318129 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:02:42.318102    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cgx9r_3a1d53d4-c866-4375-a183-ecfaa11e9d0b/console-operator/2.log"
May 21 02:07:42.355326 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:07:42.355295    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cgx9r_3a1d53d4-c866-4375-a183-ecfaa11e9d0b/console-operator/2.log"
May 21 02:07:42.359010 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:07:42.358984    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cgx9r_3a1d53d4-c866-4375-a183-ecfaa11e9d0b/console-operator/2.log"
May 21 02:10:58.837956 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:10:58.837923    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fb62m"]
May 21 02:10:58.840164 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:10:58.838146    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fb62m" podUID="8cfae2f7-a1bd-484c-914d-b04b2945ce97" containerName="manager" containerID="cri-o://f93a9488cae44a65708804b9c68956151f03fbf85303d381707e96a2440053c8" gracePeriod=10
May 21 02:10:59.685872 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:10:59.685845    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fb62m"
May 21 02:10:59.795808 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:10:59.795780    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdmgx\" (UniqueName: \"kubernetes.io/projected/8cfae2f7-a1bd-484c-914d-b04b2945ce97-kube-api-access-sdmgx\") pod \"8cfae2f7-a1bd-484c-914d-b04b2945ce97\" (UID: \"8cfae2f7-a1bd-484c-914d-b04b2945ce97\") "
May 21 02:10:59.795960 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:10:59.795910    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8cfae2f7-a1bd-484c-914d-b04b2945ce97-extensions-socket-volume\") pod \"8cfae2f7-a1bd-484c-914d-b04b2945ce97\" (UID: \"8cfae2f7-a1bd-484c-914d-b04b2945ce97\") "
May 21 02:10:59.796280 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:10:59.796257    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cfae2f7-a1bd-484c-914d-b04b2945ce97-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8cfae2f7-a1bd-484c-914d-b04b2945ce97" (UID: "8cfae2f7-a1bd-484c-914d-b04b2945ce97"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 02:10:59.797843 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:10:59.797823    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cfae2f7-a1bd-484c-914d-b04b2945ce97-kube-api-access-sdmgx" (OuterVolumeSpecName: "kube-api-access-sdmgx") pod "8cfae2f7-a1bd-484c-914d-b04b2945ce97" (UID: "8cfae2f7-a1bd-484c-914d-b04b2945ce97"). InnerVolumeSpecName "kube-api-access-sdmgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 02:10:59.897329 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:10:59.897291    2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8cfae2f7-a1bd-484c-914d-b04b2945ce97-extensions-socket-volume\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 02:10:59.897329 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:10:59.897320    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdmgx\" (UniqueName: \"kubernetes.io/projected/8cfae2f7-a1bd-484c-914d-b04b2945ce97-kube-api-access-sdmgx\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
May 21 02:11:00.040744 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:11:00.040658    2552 generic.go:358] "Generic (PLEG): container finished" podID="8cfae2f7-a1bd-484c-914d-b04b2945ce97" containerID="f93a9488cae44a65708804b9c68956151f03fbf85303d381707e96a2440053c8" exitCode=0
May 21 02:11:00.040744 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:11:00.040716    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fb62m" event={"ID":"8cfae2f7-a1bd-484c-914d-b04b2945ce97","Type":"ContainerDied","Data":"f93a9488cae44a65708804b9c68956151f03fbf85303d381707e96a2440053c8"}
May 21 02:11:00.040744 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:11:00.040722    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fb62m"
May 21 02:11:00.041019 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:11:00.040750    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fb62m" event={"ID":"8cfae2f7-a1bd-484c-914d-b04b2945ce97","Type":"ContainerDied","Data":"39d6626bf69be2e954937768837b9f429db3c00595748f54ad3410846b2a033b"}
May 21 02:11:00.041019 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:11:00.040769    2552 scope.go:117] "RemoveContainer" containerID="f93a9488cae44a65708804b9c68956151f03fbf85303d381707e96a2440053c8"
May 21 02:11:00.050908 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:11:00.050891    2552 scope.go:117] "RemoveContainer" containerID="f93a9488cae44a65708804b9c68956151f03fbf85303d381707e96a2440053c8"
May 21 02:11:00.051136 ip-10-0-141-162 kubenswrapper[2552]: E0521 02:11:00.051119    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f93a9488cae44a65708804b9c68956151f03fbf85303d381707e96a2440053c8\": container with ID starting with f93a9488cae44a65708804b9c68956151f03fbf85303d381707e96a2440053c8 not found: ID does not exist" containerID="f93a9488cae44a65708804b9c68956151f03fbf85303d381707e96a2440053c8"
May 21 02:11:00.051184 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:11:00.051143    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f93a9488cae44a65708804b9c68956151f03fbf85303d381707e96a2440053c8"} err="failed to get container status \"f93a9488cae44a65708804b9c68956151f03fbf85303d381707e96a2440053c8\": rpc error: code = NotFound desc = could not find container \"f93a9488cae44a65708804b9c68956151f03fbf85303d381707e96a2440053c8\": container with ID starting with f93a9488cae44a65708804b9c68956151f03fbf85303d381707e96a2440053c8 not found: ID does not exist"
May 21 02:11:00.065171 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:11:00.065145    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fb62m"]
May 21 02:11:00.067673 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:11:00.067654    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-fb62m"]
May 21 02:11:00.323611 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:11:00.323489    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cfae2f7-a1bd-484c-914d-b04b2945ce97" path="/var/lib/kubelet/pods/8cfae2f7-a1bd-484c-914d-b04b2945ce97/volumes"
May 21 02:12:04.902642 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:04.902610    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tcpn"]
May 21 02:12:04.903090 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:04.902989    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cfae2f7-a1bd-484c-914d-b04b2945ce97" containerName="manager"
May 21 02:12:04.903090 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:04.902999    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cfae2f7-a1bd-484c-914d-b04b2945ce97" containerName="manager"
May 21 02:12:04.903090 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:04.903006    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b97fc9a2-0dde-43c6-80d5-9551dd9917ce" containerName="manager"
May 21 02:12:04.903090 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:04.903011    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b97fc9a2-0dde-43c6-80d5-9551dd9917ce" containerName="manager"
May 21 02:12:04.903225 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:04.903103    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="b97fc9a2-0dde-43c6-80d5-9551dd9917ce" containerName="manager"
May 21 02:12:04.903225 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:04.903114    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="8cfae2f7-a1bd-484c-914d-b04b2945ce97" containerName="manager"
May 21 02:12:04.906193 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:04.906178    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tcpn"
May 21 02:12:04.908862 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:04.908836    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 02:12:04.909010 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:04.908844    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 02:12:04.909010 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:04.908848    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-w4hrb\""
May 21 02:12:04.915984 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:04.915964    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tcpn"]
May 21 02:12:05.034053 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:05.034025    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr6t9\" (UniqueName: \"kubernetes.io/projected/56a28ef1-2530-48dc-b31d-6c2e952865d0-kube-api-access-nr6t9\") pod \"kuadrant-operator-controller-manager-55c7f4c975-4tcpn\" (UID: \"56a28ef1-2530-48dc-b31d-6c2e952865d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tcpn"
May 21 02:12:05.034169 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:05.034097    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56a28ef1-2530-48dc-b31d-6c2e952865d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-4tcpn\" (UID: \"56a28ef1-2530-48dc-b31d-6c2e952865d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tcpn"
May 21 02:12:05.135023 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:05.134995    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nr6t9\" (UniqueName: \"kubernetes.io/projected/56a28ef1-2530-48dc-b31d-6c2e952865d0-kube-api-access-nr6t9\") pod \"kuadrant-operator-controller-manager-55c7f4c975-4tcpn\" (UID: \"56a28ef1-2530-48dc-b31d-6c2e952865d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tcpn"
May 21 02:12:05.135135 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:05.135057    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56a28ef1-2530-48dc-b31d-6c2e952865d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-4tcpn\" (UID: \"56a28ef1-2530-48dc-b31d-6c2e952865d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tcpn"
May 21 02:12:05.135355 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:05.135339    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56a28ef1-2530-48dc-b31d-6c2e952865d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-4tcpn\" (UID: \"56a28ef1-2530-48dc-b31d-6c2e952865d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tcpn"
May 21 02:12:05.144244 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:05.144221    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr6t9\" (UniqueName: \"kubernetes.io/projected/56a28ef1-2530-48dc-b31d-6c2e952865d0-kube-api-access-nr6t9\") pod \"kuadrant-operator-controller-manager-55c7f4c975-4tcpn\" (UID: \"56a28ef1-2530-48dc-b31d-6c2e952865d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tcpn"
May 21 02:12:05.217486 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:05.217429    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tcpn"
May 21 02:12:05.362425 ip-10-0-141-162 kubenswrapper[2552]: W0521 02:12:05.362386    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56a28ef1_2530_48dc_b31d_6c2e952865d0.slice/crio-13ec2de635b95be6633524de30f965d90970969bca44ba19fd1ab098aae52f0a WatchSource:0}: Error finding container 13ec2de635b95be6633524de30f965d90970969bca44ba19fd1ab098aae52f0a: Status 404 returned error can't find the container with id 13ec2de635b95be6633524de30f965d90970969bca44ba19fd1ab098aae52f0a
May 21 02:12:05.362669 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:05.362646    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tcpn"]
May 21 02:12:05.365027 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:05.365009    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 02:12:06.305316 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:06.305280    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tcpn" event={"ID":"56a28ef1-2530-48dc-b31d-6c2e952865d0","Type":"ContainerStarted","Data":"6bf72455f61357b1c7b87654104c91028df17508e21d8c796b85a556cb5af720"}
May 21 02:12:06.305316 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:06.305317    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tcpn" event={"ID":"56a28ef1-2530-48dc-b31d-6c2e952865d0","Type":"ContainerStarted","Data":"13ec2de635b95be6633524de30f965d90970969bca44ba19fd1ab098aae52f0a"}
May 21 02:12:06.305752 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:06.305399    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tcpn"
May 21 02:12:06.326686 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:06.326642    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tcpn" podStartSLOduration=2.326628876 podStartE2EDuration="2.326628876s" podCreationTimestamp="2026-05-21 02:12:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 02:12:06.323390276 +0000 UTC m=+1464.610637055" watchObservedRunningTime="2026-05-21 02:12:06.326628876 +0000 UTC m=+1464.613875653"
May 21 02:12:17.312392 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:17.312364    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-4tcpn"
May 21 02:12:42.390778 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:42.390742    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cgx9r_3a1d53d4-c866-4375-a183-ecfaa11e9d0b/console-operator/2.log"
May 21 02:12:42.394754 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:12:42.394733    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cgx9r_3a1d53d4-c866-4375-a183-ecfaa11e9d0b/console-operator/2.log"
May 21 02:17:42.427176 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:17:42.427152    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cgx9r_3a1d53d4-c866-4375-a183-ecfaa11e9d0b/console-operator/2.log"
May 21 02:17:42.433359 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:17:42.433333    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cgx9r_3a1d53d4-c866-4375-a183-ecfaa11e9d0b/console-operator/2.log"
May 21 02:21:47.250344 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:47.250312    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-qcw9p_e96cf395-ac55-402d-9f2d-a16cca875874/manager/0.log"
May 21 02:21:47.827906 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:47.827872    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-k9rqh_1460cc92-e201-416d-952c-6a40466f4289/manager/2.log"
May 21 02:21:47.942488 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:47.942459    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64cdd6779c-2257z_14857875-dfa0-4628-88e1-b3b11dbe6745/manager/0.log"
May 21 02:21:48.270628 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:48.270594    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-4cwkz_0882e520-90d9-4543-9def-20f3129e9c70/postgres/0.log"
May 21 02:21:49.014691 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:49.014658    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc_fc23f2c2-13f7-4c4a-a055-ead09b9252eb/extract/0.log"
May 21 02:21:49.020722 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:49.020698    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc_fc23f2c2-13f7-4c4a-a055-ead09b9252eb/util/0.log"
May 21 02:21:49.027479 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:49.027461    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc_fc23f2c2-13f7-4c4a-a055-ead09b9252eb/pull/0.log"
May 21 02:21:49.133986 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:49.133946    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp_8dee67b1-02f2-441d-9c78-2c6eec920608/util/0.log"
May 21 02:21:49.139712 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:49.139692    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp_8dee67b1-02f2-441d-9c78-2c6eec920608/pull/0.log"
May 21 02:21:49.146237 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:49.146217    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp_8dee67b1-02f2-441d-9c78-2c6eec920608/extract/0.log"
May 21 02:21:49.252720 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:49.252689    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46_033a590b-7c99-4331-9389-da559b7e21e8/pull/0.log"
May 21 02:21:49.258889 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:49.258869    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46_033a590b-7c99-4331-9389-da559b7e21e8/extract/0.log"
May 21 02:21:49.265186 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:49.265130    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46_033a590b-7c99-4331-9389-da559b7e21e8/util/0.log"
May 21 02:21:49.366678 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:49.366651    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf_cd68ef76-4a7e-43a1-86cd-4d4b159f520d/extract/0.log"
May 21 02:21:49.372228 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:49.372208    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf_cd68ef76-4a7e-43a1-86cd-4d4b159f520d/util/0.log"
May 21 02:21:49.377818 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:49.377802    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf_cd68ef76-4a7e-43a1-86cd-4d4b159f520d/pull/0.log"
May 21 02:21:50.039556 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:50.039466    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-4tcpn_56a28ef1-2530-48dc-b31d-6c2e952865d0/manager/0.log"
May 21 02:21:50.687739 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:50.687712    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-2bzjc_1b1df4eb-c8e3-42c9-8f8b-bc68e1773158/discovery/0.log"
May 21 02:21:50.903110 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:50.903086    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f6cbd8488-xcjvc_55811ffa-4427-4e2d-8282-2faa23f57c5f/kube-auth-proxy/0.log"
May 21 02:21:51.122304 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:51.122276    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-xb8nc_3977c0b1-ee3b-4679-8238-1c63e7bce80c/payload-processing/0.log"
May 21 02:21:51.783690 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:51.783660    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-msxxz_b0049d6c-8eb1-458a-b4dd-08a75e4598b4/storage-initializer/0.log"
May 21 02:21:51.790675 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:51.790648    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-msxxz_b0049d6c-8eb1-458a-b4dd-08a75e4598b4/main/0.log"
May 21 02:21:51.898685 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:51.898657    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm_a6cf9af1-7c87-4059-b892-041862a9a739/storage-initializer/0.log"
May 21 02:21:51.905599 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:51.905575    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcccwjqm_a6cf9af1-7c87-4059-b892-041862a9a739/main/0.log"
May 21 02:21:52.117439 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:52.117361    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5_8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10/storage-initializer/0.log"
May 21 02:21:52.123955 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:52.123929    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-5tzx5_8d9d7fb3-0d0b-45fa-8d2b-8745d96d8d10/main/0.log"
May 21 02:21:58.394890 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:58.394857    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5qwhb_1cbee653-ebf7-4239-8337-0a77d3b870aa/global-pull-secret-syncer/0.log"
May 21 02:21:58.515757 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:58.515728    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hq6nm_ee5c3804-f1e0-4ad7-b349-aa9227318c9c/konnectivity-agent/0.log"
May 21 02:21:58.629409 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:21:58.629378    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-162.ec2.internal_e8729e0afae81f85f1fdd1f8713f60cd/haproxy/0.log"
May 21 02:22:02.211758 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:02.211731    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc_fc23f2c2-13f7-4c4a-a055-ead09b9252eb/extract/0.log"
May 21 02:22:02.229940 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:02.229913    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc_fc23f2c2-13f7-4c4a-a055-ead09b9252eb/util/0.log"
May 21 02:22:02.246297 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:02.246276    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wpnjc_fc23f2c2-13f7-4c4a-a055-ead09b9252eb/pull/0.log"
May 21 02:22:02.271776 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:02.271753    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp_8dee67b1-02f2-441d-9c78-2c6eec920608/extract/0.log"
May 21 02:22:02.293499 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:02.293465    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp_8dee67b1-02f2-441d-9c78-2c6eec920608/util/0.log"
May 21 02:22:02.324859 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:02.324835    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqlhp_8dee67b1-02f2-441d-9c78-2c6eec920608/pull/0.log"
May 21 02:22:02.354938 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:02.354912    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46_033a590b-7c99-4331-9389-da559b7e21e8/extract/0.log"
May 21 02:22:02.385629 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:02.385595    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46_033a590b-7c99-4331-9389-da559b7e21e8/util/0.log"
May 21 02:22:02.404895 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:02.404872    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734nn46_033a590b-7c99-4331-9389-da559b7e21e8/pull/0.log"
May 21 02:22:02.431273 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:02.431251    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf_cd68ef76-4a7e-43a1-86cd-4d4b159f520d/extract/0.log"
May 21 02:22:02.456452 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:02.456427    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf_cd68ef76-4a7e-43a1-86cd-4d4b159f520d/util/0.log"
May 21 02:22:02.476144 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:02.476083    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bbbf_cd68ef76-4a7e-43a1-86cd-4d4b159f520d/pull/0.log"
May 21 02:22:02.896201 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:02.896171    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-4tcpn_56a28ef1-2530-48dc-b31d-6c2e952865d0/manager/0.log"
May 21 02:22:04.133848 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:04.133817    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eee54894-1321-485d-8741-deaad2c1bdfa/alertmanager/0.log"
May 21 02:22:04.151965 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:04.151941    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eee54894-1321-485d-8741-deaad2c1bdfa/config-reloader/0.log"
May 21 02:22:04.170956 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:04.170933    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eee54894-1321-485d-8741-deaad2c1bdfa/kube-rbac-proxy-web/0.log"
May 21 02:22:04.187711 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:04.187686    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eee54894-1321-485d-8741-deaad2c1bdfa/kube-rbac-proxy/0.log"
May 21 02:22:04.205676 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:04.205651    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eee54894-1321-485d-8741-deaad2c1bdfa/kube-rbac-proxy-metric/0.log"
May 21 02:22:04.226679 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:04.226659    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eee54894-1321-485d-8741-deaad2c1bdfa/prom-label-proxy/0.log"
May 21 02:22:04.243598 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:04.243574    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eee54894-1321-485d-8741-deaad2c1bdfa/init-config-reloader/0.log"
May 21 02:22:04.383702 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:04.383670    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-8g95c_a6eae7b5-96c4-4160-934b-e33199f0262c/monitoring-plugin/0.log"
May 21 02:22:04.466762 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:04.466686    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jwkbz_669ca936-566e-4bd2-9518-580b2b801ca0/node-exporter/0.log"
May 21 02:22:04.489383 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:04.489356    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jwkbz_669ca936-566e-4bd2-9518-580b2b801ca0/kube-rbac-proxy/0.log"
May 21 02:22:04.506694 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:04.506668    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jwkbz_669ca936-566e-4bd2-9518-580b2b801ca0/init-textfile/0.log"
May 21 02:22:04.614967 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:04.614939    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-wkvdh_27ac9d1b-8dee-43d8-bd76-71130a367415/kube-rbac-proxy-main/0.log"
May 21 02:22:04.643430 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:04.643406    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-wkvdh_27ac9d1b-8dee-43d8-bd76-71130a367415/kube-rbac-proxy-self/0.log"
May 21 02:22:04.658941 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:04.658911    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-wkvdh_27ac9d1b-8dee-43d8-bd76-71130a367415/openshift-state-metrics/0.log"
May 21 02:22:04.866754 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:04.866721    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-lxwgf_21c7c3fa-0919-4d6e-b3e2-d5f9498b056c/prometheus-operator-admission-webhook/0.log"
May 21 02:22:04.892932 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:04.892908    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-54f6dc646-9b9fd_1ed7f816-35a4-47e8-892a-1f0441be15f2/telemeter-client/0.log"
May 21 02:22:04.909371 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:04.909346    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-54f6dc646-9b9fd_1ed7f816-35a4-47e8-892a-1f0441be15f2/reload/0.log"
May 21 02:22:04.927425 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:04.927404    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-54f6dc646-9b9fd_1ed7f816-35a4-47e8-892a-1f0441be15f2/kube-rbac-proxy/0.log"
May 21 02:22:04.987050 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:04.987025    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546559fdb7-hjhkj_49f4bf49-3780-44fe-b29f-cefda31f9b11/thanos-query/0.log"
May 21 02:22:05.040776 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:05.040752    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546559fdb7-hjhkj_49f4bf49-3780-44fe-b29f-cefda31f9b11/kube-rbac-proxy-web/0.log"
May 21 02:22:05.068533 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:05.068509    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546559fdb7-hjhkj_49f4bf49-3780-44fe-b29f-cefda31f9b11/kube-rbac-proxy/0.log"
May 21 02:22:05.089520 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:05.089498    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546559fdb7-hjhkj_49f4bf49-3780-44fe-b29f-cefda31f9b11/prom-label-proxy/0.log"
May 21 02:22:05.112829 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:05.112806    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546559fdb7-hjhkj_49f4bf49-3780-44fe-b29f-cefda31f9b11/kube-rbac-proxy-rules/0.log"
May 21 02:22:05.134209 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:05.134150    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546559fdb7-hjhkj_49f4bf49-3780-44fe-b29f-cefda31f9b11/kube-rbac-proxy-metrics/0.log"
May 21 02:22:06.264022 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:06.263989    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-45zcp_4f2e354c-ffc1-4e58-bd46-9da06b775bfe/networking-console-plugin/0.log"
May 21 02:22:06.755327 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:06.755300    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cgx9r_3a1d53d4-c866-4375-a183-ecfaa11e9d0b/console-operator/2.log"
May 21 02:22:06.759640 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:06.759600    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cgx9r_3a1d53d4-c866-4375-a183-ecfaa11e9d0b/console-operator/3.log"
May 21 02:22:07.116541 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.116467    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mwfm7/perf-node-gather-daemonset-7cs69"]
May 21 02:22:07.120311 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.120293    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-7cs69"
May 21 02:22:07.122882 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.122857    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mwfm7\"/\"openshift-service-ca.crt\""
May 21 02:22:07.123965 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.123945    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mwfm7\"/\"kube-root-ca.crt\""
May 21 02:22:07.124110 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.124004    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mwfm7\"/\"default-dockercfg-zddpb\""
May 21 02:22:07.129474 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.129451    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mwfm7/perf-node-gather-daemonset-7cs69"]
May 21 02:22:07.192958 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.192931    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6567b8bc58-2whkw_a729947f-93c5-4816-ac92-f95eb137db06/console/0.log"
May 21 02:22:07.263463 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.263436    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98cqt\" (UniqueName: \"kubernetes.io/projected/092b1af8-3610-4133-b921-be384c7b28d2-kube-api-access-98cqt\") pod \"perf-node-gather-daemonset-7cs69\" (UID: \"092b1af8-3610-4133-b921-be384c7b28d2\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-7cs69"
May 21 02:22:07.263634 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.263490    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/092b1af8-3610-4133-b921-be384c7b28d2-sys\") pod \"perf-node-gather-daemonset-7cs69\" (UID: \"092b1af8-3610-4133-b921-be384c7b28d2\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-7cs69"
May 21 02:22:07.263634 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.263516    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/092b1af8-3610-4133-b921-be384c7b28d2-lib-modules\") pod \"perf-node-gather-daemonset-7cs69\" (UID: \"092b1af8-3610-4133-b921-be384c7b28d2\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-7cs69"
May 21 02:22:07.263634 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.263606    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/092b1af8-3610-4133-b921-be384c7b28d2-podres\") pod \"perf-node-gather-daemonset-7cs69\" (UID: \"092b1af8-3610-4133-b921-be384c7b28d2\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-7cs69"
May 21 02:22:07.263749 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.263684    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/092b1af8-3610-4133-b921-be384c7b28d2-proc\") pod \"perf-node-gather-daemonset-7cs69\" (UID: \"092b1af8-3610-4133-b921-be384c7b28d2\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-7cs69"
May 21 02:22:07.364498 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.364459    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/092b1af8-3610-4133-b921-be384c7b28d2-podres\") pod \"perf-node-gather-daemonset-7cs69\" (UID: \"092b1af8-3610-4133-b921-be384c7b28d2\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-7cs69"
May 21 02:22:07.364926 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.364558    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/092b1af8-3610-4133-b921-be384c7b28d2-proc\") pod \"perf-node-gather-daemonset-7cs69\" (UID: \"092b1af8-3610-4133-b921-be384c7b28d2\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-7cs69"
May 21 02:22:07.364926 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.364616    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-98cqt\" (UniqueName: \"kubernetes.io/projected/092b1af8-3610-4133-b921-be384c7b28d2-kube-api-access-98cqt\") pod \"perf-node-gather-daemonset-7cs69\" (UID: \"092b1af8-3610-4133-b921-be384c7b28d2\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-7cs69"
May 21 02:22:07.364926 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.364653    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/092b1af8-3610-4133-b921-be384c7b28d2-podres\") pod \"perf-node-gather-daemonset-7cs69\" (UID: \"092b1af8-3610-4133-b921-be384c7b28d2\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-7cs69"
May 21 02:22:07.364926 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.364676    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/092b1af8-3610-4133-b921-be384c7b28d2-sys\") pod \"perf-node-gather-daemonset-7cs69\" (UID: \"092b1af8-3610-4133-b921-be384c7b28d2\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-7cs69"
May 21 02:22:07.364926 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.364685    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/092b1af8-3610-4133-b921-be384c7b28d2-proc\") pod \"perf-node-gather-daemonset-7cs69\" (UID: \"092b1af8-3610-4133-b921-be384c7b28d2\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-7cs69"
May 21 02:22:07.364926 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.364733    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/092b1af8-3610-4133-b921-be384c7b28d2-sys\") pod \"perf-node-gather-daemonset-7cs69\" (UID: \"092b1af8-3610-4133-b921-be384c7b28d2\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-7cs69"
May 21 02:22:07.364926 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.364784    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/092b1af8-3610-4133-b921-be384c7b28d2-lib-modules\") pod \"perf-node-gather-daemonset-7cs69\" (UID: \"092b1af8-3610-4133-b921-be384c7b28d2\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-7cs69"
May 21 02:22:07.364926 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.364917    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/092b1af8-3610-4133-b921-be384c7b28d2-lib-modules\") pod \"perf-node-gather-daemonset-7cs69\" (UID: \"092b1af8-3610-4133-b921-be384c7b28d2\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-7cs69"
May 21 02:22:07.372322 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.372254    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98cqt\" (UniqueName: \"kubernetes.io/projected/092b1af8-3610-4133-b921-be384c7b28d2-kube-api-access-98cqt\") pod \"perf-node-gather-daemonset-7cs69\" (UID: \"092b1af8-3610-4133-b921-be384c7b28d2\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-7cs69"
May 21 02:22:07.431227 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.431202    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-7cs69"
May 21 02:22:07.566410 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.566369    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mwfm7/perf-node-gather-daemonset-7cs69"]
May 21 02:22:07.567827 ip-10-0-141-162 kubenswrapper[2552]: W0521 02:22:07.567799    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod092b1af8_3610_4133_b921_be384c7b28d2.slice/crio-507f0ccfea45dcbcb51a23db2f1dea3fb5dd75b3120a564262d50f4044031e53 WatchSource:0}: Error finding container 507f0ccfea45dcbcb51a23db2f1dea3fb5dd75b3120a564262d50f4044031e53: Status 404 returned error can't find the container with id 507f0ccfea45dcbcb51a23db2f1dea3fb5dd75b3120a564262d50f4044031e53
May 21 02:22:07.569567 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.569526    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 02:22:07.689816 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.689793    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-w8fwv_72f54f15-db03-429e-90e5-e3b11d5bc31f/volume-data-source-validator/0.log"
May 21 02:22:07.785143 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.785103    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-7cs69" event={"ID":"092b1af8-3610-4133-b921-be384c7b28d2","Type":"ContainerStarted","Data":"a5025a799e38837a7af0234279f1ffbd7d71f52d23799652a89cd56793aa07b0"}
May 21 02:22:07.785143 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.785145    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-7cs69" event={"ID":"092b1af8-3610-4133-b921-be384c7b28d2","Type":"ContainerStarted","Data":"507f0ccfea45dcbcb51a23db2f1dea3fb5dd75b3120a564262d50f4044031e53"}
May 21 02:22:07.785369 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.785262    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-7cs69"
May 21 02:22:07.799691 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:07.799647    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-7cs69" podStartSLOduration=0.799636217 podStartE2EDuration="799.636217ms" podCreationTimestamp="2026-05-21 02:22:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 02:22:07.798640335 +0000 UTC m=+2066.085887110" watchObservedRunningTime="2026-05-21 02:22:07.799636217 +0000 UTC m=+2066.086882993"
May 21 02:22:08.471537 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:08.471505    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-msfwg_7309acd7-d8d3-4e93-9eee-df1cbc2af69e/dns/0.log"
May 21 02:22:08.487595 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:08.487568    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-msfwg_7309acd7-d8d3-4e93-9eee-df1cbc2af69e/kube-rbac-proxy/0.log"
May 21 02:22:08.554804 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:08.554780    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2jn8b_c246e67d-eb3e-4599-8d35-e25d77dc3d6b/dns-node-resolver/0.log"
May 21 02:22:09.006155 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:09.006124    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-9445cc9fd-5pns8_4c5416ce-b7f8-4361-82d8-5fc911786d0f/registry/0.log"
May 21 02:22:09.022562 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:09.022527    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-49shb_a4b8a809-3e02-4dd9-aba5-092aa39a344f/node-ca/0.log"
May 21 02:22:09.906341 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:09.906310    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-2bzjc_1b1df4eb-c8e3-42c9-8f8b-bc68e1773158/discovery/0.log"
May 21 02:22:09.943006 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:09.942982    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f6cbd8488-xcjvc_55811ffa-4427-4e2d-8282-2faa23f57c5f/kube-auth-proxy/0.log"
May 21 02:22:10.055315 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:10.055284    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-xb8nc_3977c0b1-ee3b-4679-8238-1c63e7bce80c/payload-processing/0.log"
May 21 02:22:10.520705 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:10.520672    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-748dc_0d7dcaae-df99-4c98-a24b-a13f5cad4b75/serve-healthcheck-canary/0.log"
May 21 02:22:11.000049 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:11.000022    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-g7xz9_2fb97518-73b0-46b5-af75-6646323566c6/insights-operator/1.log"
May 21 02:22:11.000439 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:11.000233    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-g7xz9_2fb97518-73b0-46b5-af75-6646323566c6/insights-operator/0.log"
May 21 02:22:11.070087 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:11.070056    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n8lc5_0933cbc7-7406-4c3e-9a83-9fc541f11c95/kube-rbac-proxy/0.log"
May 21 02:22:11.086745 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:11.086716    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n8lc5_0933cbc7-7406-4c3e-9a83-9fc541f11c95/exporter/0.log"
May 21 02:22:11.106920 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:11.106892    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n8lc5_0933cbc7-7406-4c3e-9a83-9fc541f11c95/extractor/0.log"
May 21 02:22:12.880121 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:12.880091    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-qcw9p_e96cf395-ac55-402d-9f2d-a16cca875874/manager/0.log"
May 21 02:22:13.016874 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:13.016841    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-k9rqh_1460cc92-e201-416d-952c-6a40466f4289/manager/1.log"
May 21 02:22:13.027792 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:13.027767    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-k9rqh_1460cc92-e201-416d-952c-6a40466f4289/manager/2.log"
May 21 02:22:13.069270 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:13.069236    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64cdd6779c-2257z_14857875-dfa0-4628-88e1-b3b11dbe6745/manager/0.log"
May 21 02:22:13.125467 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:13.125438    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-4cwkz_0882e520-90d9-4543-9def-20f3129e9c70/postgres/0.log"
May 21 02:22:13.799657 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:13.799630    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-7cs69"
May 21 02:22:19.915908 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:19.915877    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v9vqz_3dd449c6-c30a-404a-8163-d12b70542e94/kube-multus-additional-cni-plugins/0.log"
May 21 02:22:19.935269 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:19.935246    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v9vqz_3dd449c6-c30a-404a-8163-d12b70542e94/egress-router-binary-copy/0.log"
May 21 02:22:19.952189 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:19.952166    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v9vqz_3dd449c6-c30a-404a-8163-d12b70542e94/cni-plugins/0.log"
May 21 02:22:19.969302 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:19.969280    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v9vqz_3dd449c6-c30a-404a-8163-d12b70542e94/bond-cni-plugin/0.log"
May 21 02:22:19.986476 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:19.986454    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v9vqz_3dd449c6-c30a-404a-8163-d12b70542e94/routeoverride-cni/0.log"
May 21 02:22:20.003667 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:20.003647    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v9vqz_3dd449c6-c30a-404a-8163-d12b70542e94/whereabouts-cni-bincopy/0.log"
May 21 02:22:20.019826 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:20.019800    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v9vqz_3dd449c6-c30a-404a-8163-d12b70542e94/whereabouts-cni/0.log"
May 21 02:22:20.069537 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:20.069507    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jt6xm_553e91d1-f895-496b-9432-4c1ab85db2d9/kube-multus/0.log"
May 21 02:22:20.141492 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:20.141465    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hn6dl_95930799-a903-46cc-b0ac-b157dfbd4bb8/network-metrics-daemon/0.log"
May 21 02:22:20.157257 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:20.157233    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hn6dl_95930799-a903-46cc-b0ac-b157dfbd4bb8/kube-rbac-proxy/0.log"
May 21 02:22:21.437192 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:21.437165    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8sf4_0d57ff45-b79d-46a9-9f26-b8b9a064ab4a/ovn-controller/0.log"
May 21 02:22:21.498625 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:21.498595    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8sf4_0d57ff45-b79d-46a9-9f26-b8b9a064ab4a/ovn-acl-logging/0.log"
May 21 02:22:21.513806 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:21.513781    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8sf4_0d57ff45-b79d-46a9-9f26-b8b9a064ab4a/kube-rbac-proxy-node/0.log"
May 21 02:22:21.531668 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:21.531637    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8sf4_0d57ff45-b79d-46a9-9f26-b8b9a064ab4a/kube-rbac-proxy-ovn-metrics/0.log"
May 21 02:22:21.546510 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:21.546484    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8sf4_0d57ff45-b79d-46a9-9f26-b8b9a064ab4a/northd/0.log"
May 21 02:22:21.562924 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:21.562902    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8sf4_0d57ff45-b79d-46a9-9f26-b8b9a064ab4a/nbdb/0.log"
May 21 02:22:21.580248 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:21.580225    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8sf4_0d57ff45-b79d-46a9-9f26-b8b9a064ab4a/sbdb/0.log"
May 21 02:22:21.681104 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:21.681070    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8sf4_0d57ff45-b79d-46a9-9f26-b8b9a064ab4a/ovnkube-controller/0.log"
May 21 02:22:22.654635 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:22.654599    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-6ld5n_5eed9975-086b-4431-910d-aa0d9cf2dc74/network-check-target-container/0.log"
May 21 02:22:23.638542 ip-10-0-141-162 kubenswrapper[2552]: I0521 02:22:23.638502    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-sswsj_4da4318a-ab5c-41e6-b839-c03f4a319ec6/iptables-alerter/0.log"